-- Logs begin at Tue 2022-05-10 20:11:25 UTC, end at Tue 2022-05-10 21:42:44 UTC. -- May 10 21:00:24.778817 dv-cinder-836083-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 10 21:00:24.788013 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 10 21:00:24.790000 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 21:00:24 2022] *** May 10 21:00:24.790000 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 21:00:24.790000 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 21:00:24.790000 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: nodename: dv-cinder-836083-6-iscsi May 10 21:00:24.790000 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: machine: x86_64 May 10 21:00:24.790000 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: clock source: unix May 10 21:00:24.790000 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: pcre jit disabled May 10 21:00:24.790000 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: detected number of CPU cores: 4 May 10 21:00:24.790000 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: current working directory: / May 10 21:00:24.790000 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: detected binary path: /usr/bin/uwsgi-core May 10 21:00:24.790000 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: your processes number limit is 47680 May 10 21:00:24.790656 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: your memory page size is 4096 bytes May 10 21:00:24.790656 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: detected max file descriptor number: 2048 May 10 21:00:24.790656 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: lock engine: pthread robust mutexes May 10 21:00:24.790656 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: thunder lock: enabled May 10 21:00:24.790656 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 10 21:00:24.790656 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 21:00:24.836905 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: Python main interpreter initialized at 0x5605942979c0 May 10 21:00:24.836905 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: python threads support enabled May 10 21:00:24.836905 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: your server socket listen backlog is limited to 100 connections May 10 21:00:24.836905 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: your mercy for graceful operations on workers is 90 seconds May 10 21:00:24.837256 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: mapped 403077 bytes (393 KB) for 2 cores May 10 21:00:24.837334 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: *** Operational MODE: preforking *** May 10 21:00:24.837583 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: *** uWSGI is running in multiple interpreter mode *** May 10 21:00:24.837583 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: spawned uWSGI master process (pid: 80442) May 10 21:00:24.837816 dv-cinder-836083-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 10 21:00:24.838806 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: spawned uWSGI worker 1 (pid: 80454, cores: 1) May 10 21:00:24.838806 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: spawned uWSGI worker 2 (pid: 80455, cores: 1) May 10 21:00:24.840240 dv-cinder-836083-6-iscsi devstack@keystone.service[80442]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 21:00:30.652774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 21:00:30.652774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: from cryptography.utils import int_from_bytes May 10 21:00:30.653663 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 21:00:30.653663 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: from cryptography.utils import int_from_bytes May 10 21:00:30.654269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 21:00:30.654269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: from cryptography.utils import int_from_bytes May 10 21:00:30.654853 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 21:00:30.654853 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: from cryptography.utils import int_from_bytes May 10 21:00:30.705071 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 21:00:30.705250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 21:00:30.705339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 21:00:30.705432 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] command line args: [] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 21:00:30.705507 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 21:00:30.705685 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] command line args: [] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 21:00:30.705777 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 21:00:30.705849 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ================================================================================ {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 21:00:30.705956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 21:00:30.706106 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] admin_token = **** {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.706191 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ================================================================================ {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 21:00:30.706353 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] config_dir = [] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.706452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] admin_token = **** {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.706569 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.706655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] config_dir = [] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.706753 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] config_source = [] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.706831 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.706935 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] debug = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.707020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] config_source = [] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.707136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.707430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] debug = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.707430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.707651 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.707747 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.707847 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.707942 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.708052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.708158 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.708260 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.708360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.708460 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] list_limit = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.708599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] list_limit = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.708700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] log_config_append = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.708802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] log_config_append = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.708897 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.709003 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.709104 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] log_dir = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.709199 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] log_dir = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.709302 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] log_file = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.709418 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] log_file = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.709504 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.709581 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.709698 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.709779 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.709850 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.709972 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.710054 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.710135 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.710253 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.710369 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.710484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.710608 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.710695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.710773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.710897 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.710979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.711096 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.711219 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.711305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.711422 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.711503 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.711574 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.711699 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.711783 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.711892 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.712018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.712144 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.712289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.712420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.712513 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.712913 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.712995 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.713102 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] publish_errors = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.713184 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] publish_errors = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.713339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.713420 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.713575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.713656 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.713756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.713841 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.714005 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.714105 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.714264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.714346 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.714481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] standard_threads = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.714566 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] standard_threads = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.714718 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.714799 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.714961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.715038 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.715137 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.715216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.715299 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] use_journal = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.715371 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] use_journal = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.715475 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] use_json = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.715561 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] use_json = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.715634 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] use_stderr = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.715709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] use_stderr = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.715849 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] use_syslog = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.715929 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] use_syslog = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.716086 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.716237 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:30.716347 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.716590 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.716709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.716853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.716961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.717094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.717227 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.717345 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.717472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.717587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.717727 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.717837 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.717970 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.718076 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.718222 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.718325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.718478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.718599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.718734 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.718851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.718986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.719087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.719233 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.719337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.719468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.719574 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.719732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.719808 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.719942 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.720058 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.720188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.720296 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.720437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.720551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.720674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.720805 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.720936 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.721052 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.721191 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.721291 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.721435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.721544 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.721669 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.721806 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.721921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.722060 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.722183 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.722310 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.722446 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.722565 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.722704 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.722783 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.722934 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.723019 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.723165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.723252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.723396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.723475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.723631 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.723711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.723880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.723969 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.724128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.724214 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.724359 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.724440 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.724589 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.724666 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.724834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.724904 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.725079 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.725147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.725310 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.725454 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.725617 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.725703 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.725778 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.725900 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.725989 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.726073 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.726205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.726291 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.726477 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.726561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.726687 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.726777 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.726915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.726990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.727146 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.727227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.727383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.727472 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.727620 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.727712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.727851 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.727929 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.728086 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.728165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.728316 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.728396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.728553 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.728635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.728784 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.728863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.729039 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.729125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.729258 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.729348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.729485 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.729566 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.729720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.729828 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.729957 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.730041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.730185 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.730264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.730420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.730520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.730673 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.730753 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.730919 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.730999 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.731151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.731239 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.731436 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.731524 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.731775 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.731936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.732157 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.732239 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.732403 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.732610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.732752 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.732885 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.733027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.733156 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.733291 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.733423 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.733558 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.733686 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.733823 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.733950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.734079 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.734213 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.734356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.734517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.734652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.734781 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.734910 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.735038 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.735162 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.735291 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.735431 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.735570 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.735709 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.735837 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.735965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.736101 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.736238 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.736365 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.736503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.736633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.736761 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.736887 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.737016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.737143 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.737279 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.737406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.737535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.737671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.737805 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.737940 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.738079 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.738207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.738343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.738490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.738614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.738755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.738885 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.739014 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.739142 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.739270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.739403 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.739539 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.739668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.739668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.739920 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.739920 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.740163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.740303 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.740427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.740558 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.740697 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.740827 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.740955 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.741091 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.741221 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.741356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.741485 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.741624 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.741754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.741892 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.742021 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.742149 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.742277 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.742405 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.742547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] auth.external = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.742686 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.742822 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.742950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.743078 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.743207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] auth.external = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.743341 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.743509 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.743648 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] auth.password = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.743648 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] auth.token = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.743901 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.743901 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.744147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.744276 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] auth.password = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.744405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.744545 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] auth.token = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.744681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.744810 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.744941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.745070 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.745210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.745348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.745478 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.745612 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.745748 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.745878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.746017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] credential.caching = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.746155 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.746291 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.746417 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.746554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.746685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] credential.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.746820 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.747513 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.747715 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.747927 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.748109 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.748239 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.748370 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.748509 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.748638 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.748773 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.748904 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.749034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.749165 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.749303 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.749433 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.749573 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.749703 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.749839 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.749973 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.750111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.750111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.750366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.750549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.750676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.750805 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.750948 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.751086 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.751218 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] federation.caching = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.751218 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.751473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.751473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] federation.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.751730 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.751860 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.751989 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.752116 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.752247 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.752374 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.752511 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.752641 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.752770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.752898 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.753027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.753182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.753315 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.753450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.753586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.753717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.753846 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.753983 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.754111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.754238 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.754368 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] identity.caching = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.754509 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.754663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.754808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.754943 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.755082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.755210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.755335 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.755465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.755598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.755734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.755861 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.755986 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.756112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.756237 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.756371 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.756499 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.756631 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.756768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.756894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.757020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.757020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.757265 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.757391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.757517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.757517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.757757 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.757891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.758018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.758143 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.758268 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.758394 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.758584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.758726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.758858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.758988 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.759118 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.759247 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.759376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.759511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.759644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.759772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.759901 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.760035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.760171 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.760317 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.760446 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.760575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.760706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.760833 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.760962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.761099 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.761229 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.761358 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.761487 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.761616 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.761747 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.761881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.762012 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.762150 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.762279 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.762406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.762547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.762740 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.762868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.763512 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.763640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.763767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.763894 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.764030 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.764158 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.764284 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.764411 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.764548 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.764684 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.764846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.765000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.765128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.765255 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.765380 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.765516 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.765643 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.765769 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.765895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.766021 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.766147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.766291 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.766419 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.766603 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.766732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.766862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.766993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.767133 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.767263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.767392 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.767528 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.767660 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.767789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.767926 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.768058 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.768198 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.768198 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.user = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.768441 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.768570 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.768708 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.768843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.768843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.769088 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.769218 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.769344 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.769481 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.769481 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.769726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.769856 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.769856 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.770111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.770252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.770252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.770510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.770644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.770644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.770644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.771015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.771146 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.771275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.771404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.771530 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.771669 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.771808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.771938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.772068 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.772198 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.772326 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.772454 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.772589 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.772719 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.772849 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.772977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.773105 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.773234 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.773439 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.773580 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.773709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.773838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.773965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.774094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.774094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.774346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.774346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.774630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.774759 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.774888 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.775026 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.775155 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.775155 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.775411 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.775541 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.775669 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.775805 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.775934 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.776063 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.776191 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.776320 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.776450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.776586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.776715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.776841 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.776969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.777108 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] resource.caching = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.777236 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.777372 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.777504 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.777636 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.777758 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.777887 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.778015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.778152 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.778281 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.778410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.778554 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.778684 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.778814 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.779104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.779242 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.779367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.779498 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.779629 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.779758 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] resource.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.779897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] role.caching = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.780028 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.780155 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] role.driver = sql {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.780280 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.780407 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.780534 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.780669 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.780796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.780932 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.781060 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.781186 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.781319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.781448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.781575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.781701 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.781827 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.781952 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.782086 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.782213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.782339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] role.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.782510 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.782652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] role.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.782783 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.782921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.783052 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.783181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.783181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.783424 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.783424 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.783681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.783813 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.783942 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.784071 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.784197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.784337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.784473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.784602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.784732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.784861 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.784989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.785117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.785253 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.785396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.785522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.785652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.785779 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.785909 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.786046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.786185 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.786313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.786458 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.786458 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.786700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.786842 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.786972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.787101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.787231 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.787307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.787448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.787572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.787698 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.787836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.787965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.788091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.788224 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.788351 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.788476 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.788602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.788727 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.788853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] token.caching = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.788987 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.789114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.789239 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.789371 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.789508 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.789635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.789768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.789895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.790022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.790148 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.790273 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.790398 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.790561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.790688 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.790813 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.790813 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.791055 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.791180 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.791321 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.791452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] token.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.791603 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.791726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.791853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.791978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.792112 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.792243 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.792369 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.792493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.792619 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.792749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.792882 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.793008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.793145 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.793271 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.793397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.793521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.793654 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] database.connection = **** {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.793793 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.793957 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.794088 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.794215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.794340 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.794505 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.794642 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.794773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.794912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.795033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.795160 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.795287 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.795424 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.795554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.795682 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.795812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.795940 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.796069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.796069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.796383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] database.connection = **** {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.796522 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.796659 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.796798 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.796926 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.797054 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.797181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.797320 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.797452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.797579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.797708 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.797840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.797968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.798105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.798233 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.798362 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.798506 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.798640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 21:00:30.798767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.798767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.798767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.798767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.798767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.798767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.798767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.798767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.798767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.799796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:30.799796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 21:00:30.823775 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:30.823996 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:30.824225 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:30.826609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:30.826850 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:30.827082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:30.833592 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:30.835814 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:30.862390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:30.862658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:30.862891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:30.863127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:30.916275 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:30.916958 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:30.970180 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:30.970406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:30.970539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:30.970669 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.037400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.037627 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.037801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.037905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.038037 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.038121 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.038264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.038347 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.038504 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.038603 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.038737 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.038960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.062303 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.062556 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.062670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.062785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.062867 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.063007 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.063089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.063225 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.063308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.063440 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.063522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.063656 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.063746 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.063874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.075078 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.075848 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.090227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.090408 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.090533 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.090670 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.091340 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.091460 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.091578 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.091808 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.091891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.092032 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.092212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.092292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.092467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.092687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 21:00:31.109507 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.109719 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 21:00:31.109985 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.110072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.110200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 21:00:31.110287 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 21:00:31.110528 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.110614 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.110764 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 21:00:31.110863 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.111033 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.111119 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.111287 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.111368 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.111544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.111801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.122318 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.122623 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.122895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.123181 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.123281 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.123548 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.123818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.124098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.131274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.132198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.142998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.142998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.142998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.142998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.142998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.143293 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.143360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.143421 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.143482 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.143542 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.143610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.143610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.143721 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.143783 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.143844 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.143912 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.143975 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.143975 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.143975 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.143975 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.143975 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.143975 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.165380 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.167079 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.167246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.167331 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.168910 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.169323 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.172672 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.172949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.173229 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.174889 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.175170 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.175450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.180818 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.181102 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.183042 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.183335 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.185771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.186056 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.186336 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.186641 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.186918 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.187193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.187465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.187732 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.188391 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.188679 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.188961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.189246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.189526 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.189802 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.190074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.190345 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.206784 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.207062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.209838 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.210118 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.211549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.214640 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.215165 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.215460 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.219079 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.219376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.220945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.224318 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.224522 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.227892 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.228252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.228549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.228830 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.229112 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.229387 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.229671 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.231735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.232246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.232577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.232869 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.233152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.233436 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.248867 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.249246 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.249518 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.249783 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.252710 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.253087 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.253358 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.253624 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.257650 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.259416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.259694 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.261457 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.263308 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.263580 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.263868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.264104 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.264224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.264410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.264555 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.268083 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.268361 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.268639 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.268917 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.269193 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.277903 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.278180 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.279168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.279463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.279748 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.280042 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.280318 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.283396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.283678 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.283962 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.284254 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.284535 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.284818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.285104 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.298276 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.301798 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.303560 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.305151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.306783 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.306866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.308400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.308679 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.308982 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.310945 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.312568 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.314200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.314505 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.314800 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.317107 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.318743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.321939 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.322186 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.322321 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.322523 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.322804 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.323825 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.327945 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.328236 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.328520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.328794 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.332637 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.332938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.333227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.337924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.338228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.338540 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.341266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.341542 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.341822 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.342096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.342368 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.342679 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.342952 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.343229 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.343495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.343768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.344037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.344311 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.344575 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.344833 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.346907 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 21:00:31.347186 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.347473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.347749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.348022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.348307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.348580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.348854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.349122 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.349398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.349668 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.349949 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.350222 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.350502 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 21:00:31.384177 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5605942979c0 pid: 80455 (default app) May 10 21:00:31.387497 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5098ef-70fd-4f61-b4a3-ff5830936221 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:31.388431 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5098ef-70fd-4f61-b4a3-ff5830936221 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:31.388813 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5098ef-70fd-4f61-b4a3-ff5830936221 None None] PATH_INFO: `/v3` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:31.390906 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5605942979c0 pid: 80454 (default app) May 10 21:00:31.393010 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Tue May 10 21:00:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:00:40.047608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67b034-c211-4bd3-903f-a41e8b92d59c None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:40.048176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67b034-c211-4bd3-903f-a41e8b92d59c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:40.048176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67b034-c211-4bd3-903f-a41e8b92d59c None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:40.052769 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:00:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:00:40.057947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ddb58-5729-4928-a014-03732080c1fb None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:40.058357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ddb58-5729-4928-a014-03732080c1fb None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:40.058543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ddb58-5729-4928-a014-03732080c1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:40.089059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG oslo_db.sqlalchemy.engines [None req-a30ddb58-5729-4928-a014-03732080c1fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80455) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:00:40.271360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG passlib.handlers.bcrypt [None req-a30ddb58-5729-4928-a014-03732080c1fb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80455) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 21:00:40.271786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG passlib.handlers.bcrypt [None req-a30ddb58-5729-4928-a014-03732080c1fb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80455) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 21:00:40.327908 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-a30ddb58-5729-4928-a014-03732080c1fb None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:40.329507 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a30ddb58-5729-4928-a014-03732080c1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:40.453438 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:00:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 10 21:00:40.618507 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67b034-c211-4bd3-903f-a41e8b92d59c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:40.652765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG oslo_db.sqlalchemy.engines [None req-1f67b034-c211-4bd3-903f-a41e8b92d59c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80454) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:00:40.777619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67b034-c211-4bd3-903f-a41e8b92d59c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:40.782651 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eafa0e-a85c-4ce6-b50c-80011a41d732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:40.783301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eafa0e-a85c-4ce6-b50c-80011a41d732 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:40.783585 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eafa0e-a85c-4ce6-b50c-80011a41d732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:40.783862 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eafa0e-a85c-4ce6-b50c-80011a41d732 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:40.791708 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eafa0e-a85c-4ce6-b50c-80011a41d732 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:40.843739 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: WARNING keystone.common.rbac_enforcer.enforcer [None req-46eafa0e-a85c-4ce6-b50c-80011a41d732 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 21:00:40.843851 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eafa0e-a85c-4ce6-b50c-80011a41d732 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:40.853292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Tue May 10 21:00:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 21:00:40.859168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ddb58-5729-4928-a014-03732080c1fb None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:40.873479 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ddb58-5729-4928-a014-03732080c1fb None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:40.877779 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bcc9b-8b10-4f14-bc0a-c1987dfabbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:40.878932 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bcc9b-8b10-4f14-bc0a-c1987dfabbee admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:40.879221 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bcc9b-8b10-4f14-bc0a-c1987dfabbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:40.879498 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bcc9b-8b10-4f14-bc0a-c1987dfabbee admin admin] PATH_INFO: `/v3/projects/3ea6acf0b7844ccca48ba57f57c13860` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:40.881010 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bcc9b-8b10-4f14-bc0a-c1987dfabbee admin admin] RBAC: Authorizing `identity:get_project(project_id=3ea6acf0b7844ccca48ba57f57c13860)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:40.931619 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5d3bcc9b-8b10-4f14-bc0a-c1987dfabbee admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 21:00:40.931960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bcc9b-8b10-4f14-bc0a-c1987dfabbee admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:40.936499 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Tue May 10 21:00:40 2022] GET /identity/v3/projects/3ea6acf0b7844ccca48ba57f57c13860 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:00:43.133770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381b4ef-c510-48a5-934c-492cec97dd63 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:43.134291 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381b4ef-c510-48a5-934c-492cec97dd63 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:43.134386 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381b4ef-c510-48a5-934c-492cec97dd63 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:43.139065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:00:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:43.144433 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f14a7-7261-4823-a8fc-2f21f6394cfc None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:43.144853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f14a7-7261-4823-a8fc-2f21f6394cfc None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:43.144982 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f14a7-7261-4823-a8fc-2f21f6394cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:43.165620 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-747f14a7-7261-4823-a8fc-2f21f6394cfc None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:43.167150 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-747f14a7-7261-4823-a8fc-2f21f6394cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:43.175097 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:00:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 10 21:00:43.197319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381b4ef-c510-48a5-934c-492cec97dd63 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:43.209965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381b4ef-c510-48a5-934c-492cec97dd63 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:43.214131 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1312c-405e-4453-bd1f-3e1925347205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:43.214800 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1312c-405e-4453-bd1f-3e1925347205 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:43.215089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1312c-405e-4453-bd1f-3e1925347205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:43.215370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1312c-405e-4453-bd1f-3e1925347205 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:43.223968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1312c-405e-4453-bd1f-3e1925347205 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:43.225733 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1312c-405e-4453-bd1f-3e1925347205 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:43.234647 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Tue May 10 21:00:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 21:00:43.239793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f14a7-7261-4823-a8fc-2f21f6394cfc None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:43.248510 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f14a7-7261-4823-a8fc-2f21f6394cfc None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:43.252816 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff19103-95b3-431c-a586-35c87d2d83e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:43.253671 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff19103-95b3-431c-a586-35c87d2d83e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:43.253951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff19103-95b3-431c-a586-35c87d2d83e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:43.254223 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff19103-95b3-431c-a586-35c87d2d83e6 admin admin] PATH_INFO: `/v3/users/94be445c202a4e67aef3505af25af405` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:43.255623 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff19103-95b3-431c-a586-35c87d2d83e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=94be445c202a4e67aef3505af25af405)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:43.257411 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff19103-95b3-431c-a586-35c87d2d83e6 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:43.258973 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Tue May 10 21:00:43 2022] GET /identity/v3/users/94be445c202a4e67aef3505af25af405 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:00:45.577214 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133ce42-147f-48d0-bf87-6c9c929e0ae3 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:45.577757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133ce42-147f-48d0-bf87-6c9c929e0ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:45.577940 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133ce42-147f-48d0-bf87-6c9c929e0ae3 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:45.579052 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7ed57-bd3f-4ba1-b0c0-8ee73419d11c None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:45.579417 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:45.579501 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7ed57-bd3f-4ba1-b0c0-8ee73419d11c None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:45.579679 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7ed57-bd3f-4ba1-b0c0-8ee73419d11c None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:45.581093 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:00:45.584257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e89da-cf94-4e34-ad51-94ef8dec3c8e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:45.584546 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e89da-cf94-4e34-ad51-94ef8dec3c8e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:45.584897 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e89da-cf94-4e34-ad51-94ef8dec3c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:45.586348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d331908-d6f4-4156-8d5a-2ca5386322c8 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:45.586677 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d331908-d6f4-4156-8d5a-2ca5386322c8 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:45.586964 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d331908-d6f4-4156-8d5a-2ca5386322c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:45.628528 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG passlib.handlers.bcrypt [None req-6b0e89da-cf94-4e34-ad51-94ef8dec3c8e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80454) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 21:00:45.628950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG passlib.handlers.bcrypt [None req-6b0e89da-cf94-4e34-ad51-94ef8dec3c8e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80454) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 21:00:45.678464 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6b0e89da-cf94-4e34-ad51-94ef8dec3c8e None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:45.680091 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6b0e89da-cf94-4e34-ad51-94ef8dec3c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:45.712305 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-2d331908-d6f4-4156-8d5a-2ca5386322c8 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:45.713513 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-2d331908-d6f4-4156-8d5a-2ca5386322c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:45.791439 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 7/12] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:00:45.797973 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 6/13] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:00:45.815186 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d331908-d6f4-4156-8d5a-2ca5386322c8 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:45.819906 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e89da-cf94-4e34-ad51-94ef8dec3c8e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:45.914957 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d331908-d6f4-4156-8d5a-2ca5386322c8 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:45.915984 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e89da-cf94-4e34-ad51-94ef8dec3c8e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:45.946858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ade02-681e-4748-a8db-60dd54324b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:45.947659 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ade02-681e-4748-a8db-60dd54324b97 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:45.947797 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0eca00-b68e-45cf-89c9-dc7c5ec4aed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:45.947947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ade02-681e-4748-a8db-60dd54324b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:45.948227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ade02-681e-4748-a8db-60dd54324b97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:45.948705 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0eca00-b68e-45cf-89c9-dc7c5ec4aed0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:45.948995 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0eca00-b68e-45cf-89c9-dc7c5ec4aed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:45.949278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0eca00-b68e-45cf-89c9-dc7c5ec4aed0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:45.959869 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ade02-681e-4748-a8db-60dd54324b97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:00:45.971583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-4c3ade02-681e-4748-a8db-60dd54324b97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:00:45.971583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:00:45.971583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:00:45.971583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:00:45.971583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:00:45.971583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:00:45.971583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:00:45.971583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:00:45.971583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:00:45.971583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:00:45.971583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:00:45.971583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:00:45.971583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:00:45.971583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:00:45.971583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:00:45.971583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:00:45.972538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:00:45.972538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:00:45.972538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:00:45.972538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:00:45.972538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:00:45.972538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:00:45.972538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:00:45.972538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:00:45.972538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:00:45.972538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:00:45.972538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:00:45.972538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:00:45.972538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:00:45.972538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:00:45.972538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:00:45.972538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:00:45.973493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:00:45.973493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:00:45.973493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:00:45.973493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:00:45.973493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:00:45.973493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:00:45.973493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:00:45.973493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:00:45.973493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:00:45.973493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:00:45.973493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:00:45.973493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:00:45.973493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 8/14] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:00:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:00:45.978529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ade02-681e-4748-a8db-60dd54324b97 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:46.015660 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0eca00-b68e-45cf-89c9-dc7c5ec4aed0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:46.017189 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0eca00-b68e-45cf-89c9-dc7c5ec4aed0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:46.074645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ade02-681e-4748-a8db-60dd54324b97 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:46.109376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbcc22-dbec-4099-a0d0-c20f1c885a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:46.110067 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbcc22-dbec-4099-a0d0-c20f1c885a3e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:46.110353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbcc22-dbec-4099-a0d0-c20f1c885a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:46.110663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbcc22-dbec-4099-a0d0-c20f1c885a3e None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:46.111443 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbcc22-dbec-4099-a0d0-c20f1c885a3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:00:46.111758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbcc22-dbec-4099-a0d0-c20f1c885a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:46.113204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbcc22-dbec-4099-a0d0-c20f1c885a3e None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:46.126596 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 9/15] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:00:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:00:46.132509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbcc22-dbec-4099-a0d0-c20f1c885a3e None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:46.219815 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 7/16] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:00:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 21:00:46.225294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0eca00-b68e-45cf-89c9-dc7c5ec4aed0 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:46.235164 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbcc22-dbec-4099-a0d0-c20f1c885a3e None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:46.267622 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12912fa-767f-4761-8751-7dba495e911f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:46.268497 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12912fa-767f-4761-8751-7dba495e911f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:46.268784 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12912fa-767f-4761-8751-7dba495e911f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:46.269063 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12912fa-767f-4761-8751-7dba495e911f None admin] PATH_INFO: `/v3/users/94be445c202a4e67aef3505af25af405` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:46.270281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12912fa-767f-4761-8751-7dba495e911f None admin] RBAC: Authorizing `identity:get_user(user_id=94be445c202a4e67aef3505af25af405)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:46.271786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12912fa-767f-4761-8751-7dba495e911f None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:46.273389 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 10/17] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:00:46 2022] GET /identity/v3/users/94be445c202a4e67aef3505af25af405 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:00:46.279306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12912fa-767f-4761-8751-7dba495e911f None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:46.319230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0eca00-b68e-45cf-89c9-dc7c5ec4aed0 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:46.351011 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b531d23-b40e-4250-b3de-701af1c4dcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:46.351801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b531d23-b40e-4250-b3de-701af1c4dcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:46.352082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b531d23-b40e-4250-b3de-701af1c4dcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:46.352353 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b531d23-b40e-4250-b3de-701af1c4dcb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:46.370238 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b531d23-b40e-4250-b3de-701af1c4dcb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:46.371658 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b531d23-b40e-4250-b3de-701af1c4dcb6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:46.373497 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12912fa-767f-4761-8751-7dba495e911f None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:46.392450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-4b531d23-b40e-4250-b3de-701af1c4dcb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:00:46.392450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:00:46.392450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:00:46.392450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:00:46.392450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:00:46.392450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:00:46.392450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:00:46.392450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:00:46.392450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:00:46.392450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:00:46.392450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:00:46.392450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:00:46.392450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:00:46.392450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:00:46.392450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:00:46.393301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:00:46.393301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:00:46.393301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:00:46.393301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:00:46.393301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:00:46.393301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:00:46.393301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:00:46.393301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:00:46.393301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:00:46.393301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:00:46.393301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:00:46.393301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:00:46.393301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:00:46.393301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:00:46.393301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:00:46.393301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:00:46.393301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:00:46.394124 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:00:46.394124 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:00:46.394124 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:00:46.394124 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:00:46.394124 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 8/18] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:00:46.399600 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b531d23-b40e-4250-b3de-701af1c4dcb6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:46.406282 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad0f2f-3552-4717-b9a7-d9db9c62a5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:46.407222 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad0f2f-3552-4717-b9a7-d9db9c62a5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:46.407518 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad0f2f-3552-4717-b9a7-d9db9c62a5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:46.407796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad0f2f-3552-4717-b9a7-d9db9c62a5c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:46.408991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad0f2f-3552-4717-b9a7-d9db9c62a5c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:46.410452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad0f2f-3552-4717-b9a7-d9db9c62a5c2 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:46.412187 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 11/19] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:00:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:00:46.417528 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad0f2f-3552-4717-b9a7-d9db9c62a5c2 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:46.493747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b531d23-b40e-4250-b3de-701af1c4dcb6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:46.513510 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad0f2f-3552-4717-b9a7-d9db9c62a5c2 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:46.526408 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87216109-d263-401c-8ce5-6cbbcbb6f28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:46.527095 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87216109-d263-401c-8ce5-6cbbcbb6f28b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:46.527382 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87216109-d263-401c-8ce5-6cbbcbb6f28b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:46.527664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87216109-d263-401c-8ce5-6cbbcbb6f28b None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:46.528422 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87216109-d263-401c-8ce5-6cbbcbb6f28b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:00:46.528732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87216109-d263-401c-8ce5-6cbbcbb6f28b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:46.530111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87216109-d263-401c-8ce5-6cbbcbb6f28b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:46.545595 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342febe4-5d22-4b36-8e28-3299dc6524d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:46.546247 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342febe4-5d22-4b36-8e28-3299dc6524d1 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:46.546518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 9/20] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:00:46.546651 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342febe4-5d22-4b36-8e28-3299dc6524d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:46.546837 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342febe4-5d22-4b36-8e28-3299dc6524d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:46.547684 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342febe4-5d22-4b36-8e28-3299dc6524d1 None admin] RBAC: Adding query filter params (role.id=5cd001edc58744738aa57180c0be68a9, scope.domain.id=default, user.id=94be445c202a4e67aef3505af25af405) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:00:46.547998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342febe4-5d22-4b36-8e28-3299dc6524d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:46.549449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342febe4-5d22-4b36-8e28-3299dc6524d1 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:46.557128 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 12/21] 10.222.0.25 () {56 vars in 1322 bytes} [Tue May 10 21:00:46 2022] GET /identity/v3/role_assignments?user.id=94be445c202a4e67aef3505af25af405&scope.domain.id=default&role.id=5cd001edc58744738aa57180c0be68a9 => generated 233 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:00:49.118960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d4dc4-7589-431b-94ca-ebd324ac8060 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:49.119472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d4dc4-7589-431b-94ca-ebd324ac8060 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:49.119569 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d4dc4-7589-431b-94ca-ebd324ac8060 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:49.121195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 10/22] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:49.126763 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b528f87-378a-461e-bea7-f983cfcc08c7 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:49.127194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b528f87-378a-461e-bea7-f983cfcc08c7 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:49.127383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b528f87-378a-461e-bea7-f983cfcc08c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:49.148943 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-6b528f87-378a-461e-bea7-f983cfcc08c7 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:49.150127 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-6b528f87-378a-461e-bea7-f983cfcc08c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:49.238305 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 13/23] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:00:49.252933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9398c5-6f58-4890-bf93-f8380ad79f31 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:49.253524 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9398c5-6f58-4890-bf93-f8380ad79f31 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:49.254007 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9398c5-6f58-4890-bf93-f8380ad79f31 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:49.255851 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 11/24] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:00:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:49.261366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3545-d3cf-494e-9789-31a17ae21e94 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:49.261927 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3545-d3cf-494e-9789-31a17ae21e94 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:49.262565 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3545-d3cf-494e-9789-31a17ae21e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:49.276743 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9398c5-6f58-4890-bf93-f8380ad79f31 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:49.292385 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-980c3545-d3cf-494e-9789-31a17ae21e94 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:49.293602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-980c3545-d3cf-494e-9789-31a17ae21e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:49.425008 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 14/25] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:00:49.466724 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c3545-d3cf-494e-9789-31a17ae21e94 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:49.474177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9398c5-6f58-4890-bf93-f8380ad79f31 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:49.514651 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d92498-54a9-41ad-a6a6-cadfb24741e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:49.515456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d92498-54a9-41ad-a6a6-cadfb24741e9 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:49.515756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d92498-54a9-41ad-a6a6-cadfb24741e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:49.516022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d92498-54a9-41ad-a6a6-cadfb24741e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:49.540263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d92498-54a9-41ad-a6a6-cadfb24741e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:00:49.549544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-96d92498-54a9-41ad-a6a6-cadfb24741e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:00:49.549544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:00:49.549544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:00:49.549544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:00:49.549544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:00:49.549544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:00:49.549544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:00:49.549544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:00:49.549544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:00:49.549544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:00:49.549544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:00:49.549544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:00:49.549544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:00:49.549544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:00:49.549544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:00:49.549544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:00:49.550911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:00:49.550911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:00:49.550911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:00:49.550911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:00:49.550911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:00:49.550911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:00:49.550911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:00:49.550911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:00:49.550911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:00:49.550911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:00:49.550911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:00:49.550911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:00:49.550911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:00:49.550911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:00:49.550911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:00:49.550911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:00:49.551877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:00:49.551877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:00:49.551877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:00:49.551877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:00:49.551877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:00:49.551877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:00:49.551877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:00:49.551877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:00:49.551877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:00:49.551877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:00:49.551877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:00:49.551877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:00:49.554291 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 12/26] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:00:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:00:49.555839 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd01bb-f7ea-4a7b-932e-eae6b0775849 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:49.556264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd01bb-f7ea-4a7b-932e-eae6b0775849 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:49.556709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd01bb-f7ea-4a7b-932e-eae6b0775849 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:49.558420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:49.564646 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357229a9-43cb-4d96-bb32-ab55b6a62451 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:49.565214 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357229a9-43cb-4d96-bb32-ab55b6a62451 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:49.565724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357229a9-43cb-4d96-bb32-ab55b6a62451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:49.594280 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-357229a9-43cb-4d96-bb32-ab55b6a62451 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:49.595491 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-357229a9-43cb-4d96-bb32-ab55b6a62451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:49.681940 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c3545-d3cf-494e-9789-31a17ae21e94 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:49.723523 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 14/28] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:00:49.724545 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357229a9-43cb-4d96-bb32-ab55b6a62451 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:49.784078 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6e5a7-6e89-4169-ae2e-592fa66eb123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:49.784765 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6e5a7-6e89-4169-ae2e-592fa66eb123 None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:49.785052 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6e5a7-6e89-4169-ae2e-592fa66eb123 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:49.785329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6e5a7-6e89-4169-ae2e-592fa66eb123 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:49.786088 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6e5a7-6e89-4169-ae2e-592fa66eb123 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:49.787510 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6e5a7-6e89-4169-ae2e-592fa66eb123 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:49.839904 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357229a9-43cb-4d96-bb32-ab55b6a62451 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:49.876693 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d17fb-d568-4a36-a019-fe025a86805b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:49.877371 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d17fb-d568-4a36-a019-fe025a86805b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:49.877665 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d17fb-d568-4a36-a019-fe025a86805b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:49.877938 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d17fb-d568-4a36-a019-fe025a86805b None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:49.878806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d17fb-d568-4a36-a019-fe025a86805b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:00:49.879119 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d17fb-d568-4a36-a019-fe025a86805b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:49.880516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d17fb-d568-4a36-a019-fe025a86805b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:49.893846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 15/29] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:00:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:00:49.898808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d17fb-d568-4a36-a019-fe025a86805b None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:50.002222 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d17fb-d568-4a36-a019-fe025a86805b None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:50.036496 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d09ea2-7c65-4a8e-9396-6f245f0ee388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:50.037298 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d09ea2-7c65-4a8e-9396-6f245f0ee388 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:50.037585 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d09ea2-7c65-4a8e-9396-6f245f0ee388 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:50.037869 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d09ea2-7c65-4a8e-9396-6f245f0ee388 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:50.048572 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d09ea2-7c65-4a8e-9396-6f245f0ee388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:50.050043 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d09ea2-7c65-4a8e-9396-6f245f0ee388 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:50.064367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 15/30] 10.222.0.25 () {60 vars in 1131 bytes} [Tue May 10 21:00:49 2022] POST /identity/v3/roles => generated 219 bytes in 598 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:00:50.065288 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6e5a7-6e89-4169-ae2e-592fa66eb123 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:50.069148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-19d09ea2-7c65-4a8e-9396-6f245f0ee388 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:00:50.069148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:00:50.069148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:00:50.069148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:00:50.069148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:00:50.069148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:00:50.069148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:00:50.069148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:00:50.069148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:00:50.069148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:00:50.069148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:00:50.069148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:00:50.069148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:00:50.069148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:00:50.069148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:00:50.071109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:00:50.071109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:00:50.071109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:00:50.071109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:00:50.071109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:00:50.071109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:00:50.071109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:00:50.071109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:00:50.071109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:00:50.071109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:00:50.071109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:00:50.071109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:00:50.071109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:00:50.071109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:00:50.071109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:00:50.071109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:00:50.071109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:00:50.073098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:00:50.073098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:00:50.073098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:00:50.073098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:00:50.073098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 16/31] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:00:50.073098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1bbe8-7b85-414b-a002-58f14b5223e7 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:50.073098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1bbe8-7b85-414b-a002-58f14b5223e7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:50.073098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1bbe8-7b85-414b-a002-58f14b5223e7 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:50.074071 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 17/32] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:50.083533 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1bbe8-7b85-414b-a002-58f14b5223e7 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:50.188329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6e5a7-6e89-4169-ae2e-592fa66eb123 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:50.240200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1bbe8-7b85-414b-a002-58f14b5223e7 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:50.266912 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f4bbf-1bd5-468c-87d0-f42bfb478a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:50.268149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4bbf-1bd5-468c-87d0-f42bfb478a70 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:50.268636 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4bbf-1bd5-468c-87d0-f42bfb478a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:50.269123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4bbf-1bd5-468c-87d0-f42bfb478a70 None admin] PATH_INFO: `/v3/users/94be445c202a4e67aef3505af25af405` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:50.271154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f4bbf-1bd5-468c-87d0-f42bfb478a70 None admin] RBAC: Authorizing `identity:get_user(user_id=94be445c202a4e67aef3505af25af405)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:50.272919 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f4bbf-1bd5-468c-87d0-f42bfb478a70 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:50.274814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 16/33] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:00:50 2022] GET /identity/v3/users/94be445c202a4e67aef3505af25af405 => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:00:50.276814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f4aaa-3d09-4086-acec-c1cb7e2fd87f None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:50.277340 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f4aaa-3d09-4086-acec-c1cb7e2fd87f None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:50.277815 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f4aaa-3d09-4086-acec-c1cb7e2fd87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:50.278930 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bb214-fdae-4ad7-8bf7-381ec3767a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:50.279611 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bb214-fdae-4ad7-8bf7-381ec3767a03 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:50.279915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bb214-fdae-4ad7-8bf7-381ec3767a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:50.280181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bb214-fdae-4ad7-8bf7-381ec3767a03 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:50.281942 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bb214-fdae-4ad7-8bf7-381ec3767a03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:00:50.281942 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bb214-fdae-4ad7-8bf7-381ec3767a03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:50.282784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bb214-fdae-4ad7-8bf7-381ec3767a03 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:50.296203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 18/34] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:00:50.297399 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bb214-fdae-4ad7-8bf7-381ec3767a03 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:50.302125 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-9e0f4aaa-3d09-4086-acec-c1cb7e2fd87f None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:50.304029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-9e0f4aaa-3d09-4086-acec-c1cb7e2fd87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:50.400375 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 17/35] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:00:50.401769 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f4aaa-3d09-4086-acec-c1cb7e2fd87f None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:50.422557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bb214-fdae-4ad7-8bf7-381ec3767a03 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:50.461058 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afef9d-bd5e-409f-8742-8683ced4d45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:50.461878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afef9d-bd5e-409f-8742-8683ced4d45a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:50.462166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afef9d-bd5e-409f-8742-8683ced4d45a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:50.462464 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afef9d-bd5e-409f-8742-8683ced4d45a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:50.464018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afef9d-bd5e-409f-8742-8683ced4d45a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:50.465575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afef9d-bd5e-409f-8742-8683ced4d45a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:50.467980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 19/36] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:00:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:00:50.468823 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afef9d-bd5e-409f-8742-8683ced4d45a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:50.526876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f4aaa-3d09-4086-acec-c1cb7e2fd87f None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:50.561375 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bd27f-6d99-403d-8a6b-4bd4a46e7801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:50.562045 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bd27f-6d99-403d-8a6b-4bd4a46e7801 None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:50.562334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bd27f-6d99-403d-8a6b-4bd4a46e7801 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:50.562640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bd27f-6d99-403d-8a6b-4bd4a46e7801 None admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:50.563358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20bd27f-6d99-403d-8a6b-4bd4a46e7801 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:50.564793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20bd27f-6d99-403d-8a6b-4bd4a46e7801 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:50.583048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afef9d-bd5e-409f-8742-8683ced4d45a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:50.615612 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50095c9-0590-4ec7-b537-1c1cea44a019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:50.616280 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50095c9-0590-4ec7-b537-1c1cea44a019 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:50.616567 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50095c9-0590-4ec7-b537-1c1cea44a019 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:50.616898 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50095c9-0590-4ec7-b537-1c1cea44a019 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:50.617631 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50095c9-0590-4ec7-b537-1c1cea44a019 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:50.619075 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50095c9-0590-4ec7-b537-1c1cea44a019 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:50.650394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 10 21:00:50 2022] POST /identity/v3/projects => generated 301 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:00:50.651236 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bd27f-6d99-403d-8a6b-4bd4a46e7801 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:50.782495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bd27f-6d99-403d-8a6b-4bd4a46e7801 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:50.806217 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 20/38] 10.222.0.25 () {60 vars in 1131 bytes} [Tue May 10 21:00:50 2022] POST /identity/v3/roles => generated 225 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:00:50.808180 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b61a6-a797-445d-90ce-57babdbf0f8c None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:50.808481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b61a6-a797-445d-90ce-57babdbf0f8c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:50.808766 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b61a6-a797-445d-90ce-57babdbf0f8c None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:50.810965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 21/39] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:50.816947 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73341b-570f-4c66-aec5-3d1f5ede6b49 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:50.817259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73341b-570f-4c66-aec5-3d1f5ede6b49 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:50.817534 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73341b-570f-4c66-aec5-3d1f5ede6b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:50.831637 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cfb83-8875-4304-b435-090cda45f12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:50.833281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cfb83-8875-4304-b435-090cda45f12e None admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:50.833778 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cfb83-8875-4304-b435-090cda45f12e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:50.834271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cfb83-8875-4304-b435-090cda45f12e None admin] PATH_INFO: `/v3/domains/default/users/94be445c202a4e67aef3505af25af405/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:50.836622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7c73341b-570f-4c66-aec5-3d1f5ede6b49 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:50.836995 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277cfb83-8875-4304-b435-090cda45f12e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=94be445c202a4e67aef3505af25af405, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:50.838204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7c73341b-570f-4c66-aec5-3d1f5ede6b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:50.838932 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277cfb83-8875-4304-b435-090cda45f12e None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:50.928036 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 22/40] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:00:50.949684 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 19/41] 10.222.0.25 () {58 vars in 1361 bytes} [Tue May 10 21:00:50 2022] PUT /identity/v3/domains/default/users/94be445c202a4e67aef3505af25af405/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:00:50.952188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73341b-570f-4c66-aec5-3d1f5ede6b49 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:51.079341 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d8365-02a1-47e6-8bb1-94b710c25c0d None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:51.079743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d8365-02a1-47e6-8bb1-94b710c25c0d None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:51.079855 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d8365-02a1-47e6-8bb1-94b710c25c0d None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:51.080856 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73341b-570f-4c66-aec5-3d1f5ede6b49 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:51.081385 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 20/42] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:00:51.086867 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bb71b-ac2c-4424-8e08-5a3e962f7f62 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:51.087161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bb71b-ac2c-4424-8e08-5a3e962f7f62 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:51.087448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bb71b-ac2c-4424-8e08-5a3e962f7f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:51.109874 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-b82bb71b-ac2c-4424-8e08-5a3e962f7f62 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:51.111474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-b82bb71b-ac2c-4424-8e08-5a3e962f7f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:51.118106 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf898dc-e378-4695-9fdf-1b2558bc909c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:51.118826 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf898dc-e378-4695-9fdf-1b2558bc909c None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:51.119115 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf898dc-e378-4695-9fdf-1b2558bc909c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:51.119395 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf898dc-e378-4695-9fdf-1b2558bc909c None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:51.120249 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf898dc-e378-4695-9fdf-1b2558bc909c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:51.124110 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf898dc-e378-4695-9fdf-1b2558bc909c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:51.186564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 21/43] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:00:51.203559 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1131 bytes} [Tue May 10 21:00:50 2022] POST /identity/v3/roles => generated 223 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:00:51.210098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bb71b-ac2c-4424-8e08-5a3e962f7f62 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:51.319825 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bb71b-ac2c-4424-8e08-5a3e962f7f62 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:51.356734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63350ff3-2222-45ca-b64d-14f35534acac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:51.358187 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63350ff3-2222-45ca-b64d-14f35534acac None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:51.358697 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63350ff3-2222-45ca-b64d-14f35534acac None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:51.359125 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63350ff3-2222-45ca-b64d-14f35534acac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:51.360609 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63350ff3-2222-45ca-b64d-14f35534acac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:51.362313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63350ff3-2222-45ca-b64d-14f35534acac None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:51.364171 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 22/45] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:00:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:00:51.370113 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf898dc-e378-4695-9fdf-1b2558bc909c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:51.474572 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf898dc-e378-4695-9fdf-1b2558bc909c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:51.507247 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d2d56-0f37-4878-a1ab-5f0eb0ecfa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:51.507921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d2d56-0f37-4878-a1ab-5f0eb0ecfa2d None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:51.508210 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d2d56-0f37-4878-a1ab-5f0eb0ecfa2d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:51.508490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d2d56-0f37-4878-a1ab-5f0eb0ecfa2d None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:51.509219 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d2d56-0f37-4878-a1ab-5f0eb0ecfa2d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:51.510706 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d2d56-0f37-4878-a1ab-5f0eb0ecfa2d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:51.598706 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 10 21:00:51 2022] POST /identity/v3/projects => generated 312 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:00:53.226722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2af36-5b7c-4324-8144-44a41c7388d0 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:53.227264 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2af36-5b7c-4324-8144-44a41c7388d0 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:53.227264 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2af36-5b7c-4324-8144-44a41c7388d0 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:53.228653 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 23/47] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:53.234187 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780aec6-5dc2-4537-ab45-ca523064e36b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:53.234633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780aec6-5dc2-4537-ab45-ca523064e36b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:53.234775 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780aec6-5dc2-4537-ab45-ca523064e36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:53.251670 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b780aec6-5dc2-4537-ab45-ca523064e36b None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:53.252863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b780aec6-5dc2-4537-ab45-ca523064e36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:53.316901 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 25/48] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:00:53.340185 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2af36-5b7c-4324-8144-44a41c7388d0 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:53.438667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2af36-5b7c-4324-8144-44a41c7388d0 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:53.470735 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cf6f5-2b29-47d3-acbf-568a7049414b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:53.471532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cf6f5-2b29-47d3-acbf-568a7049414b None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:53.471818 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cf6f5-2b29-47d3-acbf-568a7049414b None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:53.472096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cf6f5-2b29-47d3-acbf-568a7049414b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:53.482412 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cf6f5-2b29-47d3-acbf-568a7049414b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:00:53.489990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-4b6cf6f5-2b29-47d3-acbf-568a7049414b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:00:53.489990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:00:53.489990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:00:53.489990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:00:53.489990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:00:53.489990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:00:53.489990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:00:53.489990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:00:53.489990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:00:53.489990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:00:53.489990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:00:53.489990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:00:53.489990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:00:53.489990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:00:53.489990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:00:53.489990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:00:53.490984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:00:53.490984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:00:53.490984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:00:53.490984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:00:53.490984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:00:53.490984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:00:53.490984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:00:53.490984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:00:53.490984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:00:53.490984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:00:53.490984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:00:53.490984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:00:53.490984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:00:53.490984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:00:53.490984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:00:53.490984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:00:53.491774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:00:53.491774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:00:53.491774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:00:53.491774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:00:53.491774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:00:53.491774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:00:53.491774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:00:53.491774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:00:53.491774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:00:53.491774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:00:53.491774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:00:53.491774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:00:53.491774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 24/49] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:00:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:00:53.496956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780aec6-5dc2-4537-ab45-ca523064e36b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:53.590514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780aec6-5dc2-4537-ab45-ca523064e36b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:53.624184 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d5a7b-a878-410c-b8be-4e8da290841c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:53.624889 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d5a7b-a878-410c-b8be-4e8da290841c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:53.625179 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d5a7b-a878-410c-b8be-4e8da290841c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:53.625461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d5a7b-a878-410c-b8be-4e8da290841c None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:53.626252 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d5a7b-a878-410c-b8be-4e8da290841c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:00:53.626609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d5a7b-a878-410c-b8be-4e8da290841c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:53.628056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d5a7b-a878-410c-b8be-4e8da290841c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:53.637782 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 26/50] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:00:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:00:53.643338 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cf6f5-2b29-47d3-acbf-568a7049414b None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:53.740555 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cf6f5-2b29-47d3-acbf-568a7049414b None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:53.773469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e540a-6910-4f53-8884-2aab1b1250db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:53.774349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e540a-6910-4f53-8884-2aab1b1250db None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:53.774662 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e540a-6910-4f53-8884-2aab1b1250db None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:53.774941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e540a-6910-4f53-8884-2aab1b1250db None admin] PATH_INFO: `/v3/users/94be445c202a4e67aef3505af25af405` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:53.776146 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e540a-6910-4f53-8884-2aab1b1250db None admin] RBAC: Authorizing `identity:get_user(user_id=94be445c202a4e67aef3505af25af405)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:53.777593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e540a-6910-4f53-8884-2aab1b1250db None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:53.779953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 25/51] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:00:53 2022] GET /identity/v3/users/94be445c202a4e67aef3505af25af405 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:00:53.785772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d5a7b-a878-410c-b8be-4e8da290841c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:53.811412 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73b084-f6b3-4cd1-8a6f-5d73b631f9ee None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:53.811702 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73b084-f6b3-4cd1-8a6f-5d73b631f9ee None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:53.811988 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73b084-f6b3-4cd1-8a6f-5d73b631f9ee None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:53.813337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 26/52] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:00:53.818140 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c90c0-970b-4b2a-98c8-0b4b235e07cd None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:53.818428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c90c0-970b-4b2a-98c8-0b4b235e07cd None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:53.818732 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c90c0-970b-4b2a-98c8-0b4b235e07cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:53.834630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-988c90c0-970b-4b2a-98c8-0b4b235e07cd None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:53.835874 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-988c90c0-970b-4b2a-98c8-0b4b235e07cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:53.883717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d5a7b-a878-410c-b8be-4e8da290841c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:53.903634 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 27/53] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:00:53.915454 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce3ca1-c49d-46d6-9e3b-6b49aa54e27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:53.916248 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce3ca1-c49d-46d6-9e3b-6b49aa54e27f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:53.916534 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce3ca1-c49d-46d6-9e3b-6b49aa54e27f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:53.916812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce3ca1-c49d-46d6-9e3b-6b49aa54e27f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:53.917972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce3ca1-c49d-46d6-9e3b-6b49aa54e27f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:53.920042 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce3ca1-c49d-46d6-9e3b-6b49aa54e27f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:53.921623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 27/54] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:00:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:00:53.926831 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c90c0-970b-4b2a-98c8-0b4b235e07cd None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:53.927432 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce3ca1-c49d-46d6-9e3b-6b49aa54e27f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:54.017803 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c90c0-970b-4b2a-98c8-0b4b235e07cd None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:54.019649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce3ca1-c49d-46d6-9e3b-6b49aa54e27f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:54.049411 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35f53e-aa2a-4cf1-bf6e-2842b8d8e41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:54.050496 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35f53e-aa2a-4cf1-bf6e-2842b8d8e41f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:54.050773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35f53e-aa2a-4cf1-bf6e-2842b8d8e41f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:54.051050 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35f53e-aa2a-4cf1-bf6e-2842b8d8e41f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:54.051630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92aab7-c7e3-425d-8a19-405f0e6533e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:54.052218 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35f53e-aa2a-4cf1-bf6e-2842b8d8e41f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:54.052304 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92aab7-c7e3-425d-8a19-405f0e6533e8 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:54.052561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92aab7-c7e3-425d-8a19-405f0e6533e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:54.052844 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92aab7-c7e3-425d-8a19-405f0e6533e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:54.053651 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35f53e-aa2a-4cf1-bf6e-2842b8d8e41f None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:54.053735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92aab7-c7e3-425d-8a19-405f0e6533e8 None admin] RBAC: Adding query filter params (role.id=5cd001edc58744738aa57180c0be68a9, scope.domain.id=default, user.id=94be445c202a4e67aef3505af25af405) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:00:54.053983 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92aab7-c7e3-425d-8a19-405f0e6533e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:54.055273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 28/55] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:00:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:00:54.055477 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92aab7-c7e3-425d-8a19-405f0e6533e8 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:54.061292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35f53e-aa2a-4cf1-bf6e-2842b8d8e41f None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:54.065147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 28/56] 10.222.0.25 () {56 vars in 1322 bytes} [Tue May 10 21:00:53 2022] GET /identity/v3/role_assignments?user.id=94be445c202a4e67aef3505af25af405&scope.domain.id=default&role.id=5cd001edc58744738aa57180c0be68a9 => generated 530 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:00:54.161576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35f53e-aa2a-4cf1-bf6e-2842b8d8e41f None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:54.196772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f613d-3955-4008-bebc-77605dcb00b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:54.197457 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f613d-3955-4008-bebc-77605dcb00b7 None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:54.197744 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f613d-3955-4008-bebc-77605dcb00b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:54.198029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f613d-3955-4008-bebc-77605dcb00b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:54.198784 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f613d-3955-4008-bebc-77605dcb00b7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:54.200677 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f613d-3955-4008-bebc-77605dcb00b7 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:54.289878 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 29/57] 10.222.0.25 () {60 vars in 1140 bytes} [Tue May 10 21:00:54 2022] POST /identity/v3/projects => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:00:56.479596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e87f4c-e80a-48e9-a8a9-185dcf5bb5db None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:56.480124 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e87f4c-e80a-48e9-a8a9-185dcf5bb5db None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:56.480213 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e87f4c-e80a-48e9-a8a9-185dcf5bb5db None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:56.482301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 29/58] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:56.487575 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdde037-42ed-4c76-9980-00d4097c9cb9 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:56.487982 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdde037-42ed-4c76-9980-00d4097c9cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:56.488137 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdde037-42ed-4c76-9980-00d4097c9cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:56.504886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-4bdde037-42ed-4c76-9980-00d4097c9cb9 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:56.506066 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4bdde037-42ed-4c76-9980-00d4097c9cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:56.568143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 30/59] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:00:56.591718 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e87f4c-e80a-48e9-a8a9-185dcf5bb5db None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:56.686029 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e87f4c-e80a-48e9-a8a9-185dcf5bb5db None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:56.718005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f2c8a-73ab-4422-81ea-95f3af4d3743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:56.718809 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f2c8a-73ab-4422-81ea-95f3af4d3743 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:56.719098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f2c8a-73ab-4422-81ea-95f3af4d3743 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:56.719376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f2c8a-73ab-4422-81ea-95f3af4d3743 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:56.720537 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f2c8a-73ab-4422-81ea-95f3af4d3743 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:56.721965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f2c8a-73ab-4422-81ea-95f3af4d3743 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:56.723553 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 30/60] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:00:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:00:56.728836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdde037-42ed-4c76-9980-00d4097c9cb9 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:56.822532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdde037-42ed-4c76-9980-00d4097c9cb9 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:56.854619 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9a2da-b8be-4308-92fb-ee82e5d19658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:56.855301 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9a2da-b8be-4308-92fb-ee82e5d19658 None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:56.855590 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9a2da-b8be-4308-92fb-ee82e5d19658 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:56.855871 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9a2da-b8be-4308-92fb-ee82e5d19658 None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:56.856595 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9a2da-b8be-4308-92fb-ee82e5d19658 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:56.858048 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9a2da-b8be-4308-92fb-ee82e5d19658 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:56.940060 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 31/61] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 10 21:00:56 2022] POST /identity/v3/users => generated 275 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:01:00.379873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e52160-21c4-4b10-9980-425375d93ba7 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:00.379873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e52160-21c4-4b10-9980-425375d93ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:00.379873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e52160-21c4-4b10-9980-425375d93ba7 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:00.381014 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 31/62] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:00.385107 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade25cf-d9f5-4d0c-89ad-5bb4a10b2829 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:00.385877 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade25cf-d9f5-4d0c-89ad-5bb4a10b2829 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:00.386351 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade25cf-d9f5-4d0c-89ad-5bb4a10b2829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:00.411445 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-0ade25cf-d9f5-4d0c-89ad-5bb4a10b2829 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:00.412986 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-0ade25cf-d9f5-4d0c-89ad-5bb4a10b2829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:00.440487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ab16a-bef3-49b1-94aa-8448786f9e9d None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:00.441104 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ab16a-bef3-49b1-94aa-8448786f9e9d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:00.441582 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ab16a-bef3-49b1-94aa-8448786f9e9d None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:00.443172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 32/63] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:01:00.452442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a6426-618a-4f4a-bb81-7b6bc30d002a None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:00.453475 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a6426-618a-4f4a-bb81-7b6bc30d002a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:00.454318 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a6426-618a-4f4a-bb81-7b6bc30d002a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:00.489428 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-510a6426-618a-4f4a-bb81-7b6bc30d002a None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:00.490640 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-510a6426-618a-4f4a-bb81-7b6bc30d002a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:00.494949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 32/64] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:00.535790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade25cf-d9f5-4d0c-89ad-5bb4a10b2829 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:00.602286 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 33/65] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:00.642989 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade25cf-d9f5-4d0c-89ad-5bb4a10b2829 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:00.649643 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a6426-618a-4f4a-bb81-7b6bc30d002a None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:00.687245 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7505a-d3d6-41e9-a814-8ac3f17534a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:00.688361 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7505a-d3d6-41e9-a814-8ac3f17534a4 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:00.689580 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7505a-d3d6-41e9-a814-8ac3f17534a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:00.692781 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7505a-d3d6-41e9-a814-8ac3f17534a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:00.723090 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7505a-d3d6-41e9-a814-8ac3f17534a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:00.732015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-bba7505a-d3d6-41e9-a814-8ac3f17534a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:00.732015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:00.732015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:00.732015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:00.732015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:00.732015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:00.732015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:00.732015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:00.732015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:00.732015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:00.732015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:00.732015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:00.732015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:00.732015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:00.732015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:00.732015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:00.732868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:00.732868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:00.732868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:00.732868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:00.732868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:00.732868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:00.732868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:00.732868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:00.732868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:00.732868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:00.732868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:00.732868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:00.732868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:00.732868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:00.732868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:00.732868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:00.733610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:00.733610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:00.733610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:00.733610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:00.733610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:00.733610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:00.733610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:00.733610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:00.733610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:00.733610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:00.733610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:00.733610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:00.735996 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 33/66] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:01:00.737434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb926a-3389-400e-9eed-c3bd2a383cbc None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:00.737918 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb926a-3389-400e-9eed-c3bd2a383cbc None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:00.738386 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb926a-3389-400e-9eed-c3bd2a383cbc None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:00.739871 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 34/67] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:00.741376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb926a-3389-400e-9eed-c3bd2a383cbc None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:00.785857 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a6426-618a-4f4a-bb81-7b6bc30d002a None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:00.827573 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a74941-3f90-4c6e-9840-cd74bb366401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:00.828792 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a74941-3f90-4c6e-9840-cd74bb366401 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:00.829922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a74941-3f90-4c6e-9840-cd74bb366401 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:00.830249 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a74941-3f90-4c6e-9840-cd74bb366401 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:00.843924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a74941-3f90-4c6e-9840-cd74bb366401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:00.852055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-64a74941-3f90-4c6e-9840-cd74bb366401 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:00.852055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:00.852055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:00.852055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:00.852055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:00.852055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:00.852055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:00.852055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:00.852055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:00.852055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:00.852055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:00.852055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:00.852055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:00.852055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:00.852055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:00.852055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:00.852912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:00.852912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:00.852912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:00.852912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:00.852912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:00.852912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:00.852912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:00.852912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:00.852912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:00.852912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:00.852912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:00.852912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:00.852912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:00.852912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:00.852912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:00.852912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:00.853652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:00.853652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:00.853652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:00.853652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:00.853652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:00.853652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:00.853652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:00.853652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:00.853652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:00.853652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:00.853652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:00.853652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:00.853652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 34/68] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:01:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:01:00.854846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfdaa5-c884-4be7-b1c2-28213eb4bdf9 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:00.855137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfdaa5-c884-4be7-b1c2-28213eb4bdf9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:00.855420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfdaa5-c884-4be7-b1c2-28213eb4bdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:00.869557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb926a-3389-400e-9eed-c3bd2a383cbc None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:00.872207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7cbfdaa5-c884-4be7-b1c2-28213eb4bdf9 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:00.873380 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7cbfdaa5-c884-4be7-b1c2-28213eb4bdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:00.903498 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4b211-c5b7-4174-ab86-eb7add6be6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:00.904098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4b211-c5b7-4174-ab86-eb7add6be6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:00.904387 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4b211-c5b7-4174-ab86-eb7add6be6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:00.904668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4b211-c5b7-4174-ab86-eb7add6be6c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:00.905425 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4b211-c5b7-4174-ab86-eb7add6be6c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:00.905735 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4b211-c5b7-4174-ab86-eb7add6be6c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:00.907156 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4b211-c5b7-4174-ab86-eb7add6be6c8 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:00.915250 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 35/69] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:00.916443 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6165b8-1f7a-4335-9e8f-7d6c96ccf629 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:00.916744 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6165b8-1f7a-4335-9e8f-7d6c96ccf629 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:00.917028 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6165b8-1f7a-4335-9e8f-7d6c96ccf629 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:00.922531 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 36/70] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:00.922531 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6165b8-1f7a-4335-9e8f-7d6c96ccf629 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:00.942722 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 35/71] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:00.945013 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a9665-60ef-40f4-be6e-f5f629c5205b None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:00.945388 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a9665-60ef-40f4-be6e-f5f629c5205b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:00.945593 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a9665-60ef-40f4-be6e-f5f629c5205b None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:00.946924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 36/72] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:00.947617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a9665-60ef-40f4-be6e-f5f629c5205b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:01.020116 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6165b8-1f7a-4335-9e8f-7d6c96ccf629 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:01.044257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a9665-60ef-40f4-be6e-f5f629c5205b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:01.052825 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1dd2c1-0e61-40fb-ad92-e6e2db75c101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:01.053502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dd2c1-0e61-40fb-ad92-e6e2db75c101 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:01.053796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dd2c1-0e61-40fb-ad92-e6e2db75c101 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:01.054081 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dd2c1-0e61-40fb-ad92-e6e2db75c101 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:01.054922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1dd2c1-0e61-40fb-ad92-e6e2db75c101 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:01.055242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1dd2c1-0e61-40fb-ad92-e6e2db75c101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:01.056641 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1dd2c1-0e61-40fb-ad92-e6e2db75c101 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:01.064418 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 37/73] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:01:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:01.065594 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b7332-7d35-4059-afbf-aab060d59af4 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:01.065890 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b7332-7d35-4059-afbf-aab060d59af4 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:01.066176 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b7332-7d35-4059-afbf-aab060d59af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:01.077958 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979623b-83a9-4aee-8fc1-59293dada486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:01.078866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979623b-83a9-4aee-8fc1-59293dada486 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:01.079148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979623b-83a9-4aee-8fc1-59293dada486 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:01.079422 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979623b-83a9-4aee-8fc1-59293dada486 None admin] PATH_INFO: `/v3/users/33781cd02a6e417a9a09ee0ca6390d4d` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:01.082177 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-4d9b7332-7d35-4059-afbf-aab060d59af4 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:01.083414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4d9b7332-7d35-4059-afbf-aab060d59af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:01.094516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979623b-83a9-4aee-8fc1-59293dada486 None admin] RBAC: Authorizing `identity:get_user(user_id=33781cd02a6e417a9a09ee0ca6390d4d)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:01.095988 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979623b-83a9-4aee-8fc1-59293dada486 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:01.097638 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 37/74] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:00 2022] GET /identity/v3/users/33781cd02a6e417a9a09ee0ca6390d4d => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:01.098827 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff0251-3397-4bc4-b57f-4ec9c0840005 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:01.099114 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff0251-3397-4bc4-b57f-4ec9c0840005 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:01.099478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff0251-3397-4bc4-b57f-4ec9c0840005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:01.114399 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7cff0251-3397-4bc4-b57f-4ec9c0840005 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:01.115600 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7cff0251-3397-4bc4-b57f-4ec9c0840005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:01.146484 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 38/75] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:01.147239 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b7332-7d35-4059-afbf-aab060d59af4 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:01.179927 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 38/76] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:01.180691 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff0251-3397-4bc4-b57f-4ec9c0840005 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:01.244340 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b7332-7d35-4059-afbf-aab060d59af4 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:01.273978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff0251-3397-4bc4-b57f-4ec9c0840005 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:01.276013 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089ce01-b513-46f5-91fa-68f7576ed96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:01.276805 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089ce01-b513-46f5-91fa-68f7576ed96a None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:01.277087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089ce01-b513-46f5-91fa-68f7576ed96a None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:01.277383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089ce01-b513-46f5-91fa-68f7576ed96a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:01.279086 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089ce01-b513-46f5-91fa-68f7576ed96a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:01.280524 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089ce01-b513-46f5-91fa-68f7576ed96a None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:01.282104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 39/77] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:01.282883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089ce01-b513-46f5-91fa-68f7576ed96a None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:01.307541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b456da8-79f3-4a1f-a74c-eb54f0528f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:01.308422 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b456da8-79f3-4a1f-a74c-eb54f0528f5f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:01.309255 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b456da8-79f3-4a1f-a74c-eb54f0528f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:01.309542 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b456da8-79f3-4a1f-a74c-eb54f0528f5f None admin] PATH_INFO: `/v3/users/33781cd02a6e417a9a09ee0ca6390d4d` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:01.310770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b456da8-79f3-4a1f-a74c-eb54f0528f5f None admin] RBAC: Authorizing `identity:get_user(user_id=33781cd02a6e417a9a09ee0ca6390d4d)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:01.312210 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b456da8-79f3-4a1f-a74c-eb54f0528f5f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:01.313968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 39/78] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:01 2022] GET /identity/v3/users/33781cd02a6e417a9a09ee0ca6390d4d => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:01.314675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b456da8-79f3-4a1f-a74c-eb54f0528f5f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:01.381174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089ce01-b513-46f5-91fa-68f7576ed96a None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:01.407478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b456da8-79f3-4a1f-a74c-eb54f0528f5f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:01.412834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1572db3-1c2e-4321-a9f6-857a5f3a1937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:01.413481 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1572db3-1c2e-4321-a9f6-857a5f3a1937 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:01.413762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1572db3-1c2e-4321-a9f6-857a5f3a1937 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:01.414036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1572db3-1c2e-4321-a9f6-857a5f3a1937 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:01.440452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610bc12-299f-4618-aec6-e8a87b9818ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:01.441174 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610bc12-299f-4618-aec6-e8a87b9818ad None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:01.441463 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610bc12-299f-4618-aec6-e8a87b9818ad None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:01.441739 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610bc12-299f-4618-aec6-e8a87b9818ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:01.452200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610bc12-299f-4618-aec6-e8a87b9818ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:01.459741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-9610bc12-299f-4618-aec6-e8a87b9818ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:01:01.459741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:01.459741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:01.459741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:01.459741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:01.459741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:01.459741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:01.459741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:01.459741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:01.459741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:01.459741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:01.459741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:01.459741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:01.459741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:01.459741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:01.459741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:01.460656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:01.460656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:01.460656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:01.460656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:01.460656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:01.460656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:01.460656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:01.460656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:01.460656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:01.460656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:01.460656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:01.460656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:01.460656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:01.460656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:01.460656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:01.460656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:01.461610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:01.461610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:01.461610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:01.461610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:01.461610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:01.461610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:01.461610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:01.461610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:01.461610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:01.461610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:01.461610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:01:01.461610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:01.461610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 40/79] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:01:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:01.462554 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610bc12-299f-4618-aec6-e8a87b9818ad None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:01.481997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1572db3-1c2e-4321-a9f6-857a5f3a1937 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:01.483479 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1572db3-1c2e-4321-a9f6-857a5f3a1937 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:01.555629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610bc12-299f-4618-aec6-e8a87b9818ad None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:01.575651 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 40/80] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:01.576452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1572db3-1c2e-4321-a9f6-857a5f3a1937 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:01.592366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25698c4-d36e-4540-a7da-95a2a60c09af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:01.593169 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25698c4-d36e-4540-a7da-95a2a60c09af None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:01.593461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25698c4-d36e-4540-a7da-95a2a60c09af None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:01.593743 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25698c4-d36e-4540-a7da-95a2a60c09af None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:01.603553 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25698c4-d36e-4540-a7da-95a2a60c09af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:01.611578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-d25698c4-d36e-4540-a7da-95a2a60c09af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:01.611578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:01.611578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:01.611578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:01.611578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:01.611578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:01.611578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:01.611578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:01.611578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:01.611578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:01.611578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:01.611578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:01.611578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:01.611578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:01.611578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:01.611578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:01.612434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:01.612434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:01.612434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:01.612434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:01.612434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:01.612434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:01.612434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:01.612434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:01.612434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:01.612434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:01.612434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:01.612434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:01.612434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:01.612434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:01.612434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:01.612434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:01.613198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:01.613198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:01.613198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:01.613198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:01.613198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:01.613198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:01.613198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:01.613198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:01.613198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:01.613198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:01.613198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:01.613198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:01.613198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 41/81] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:01.614310 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25698c4-d36e-4540-a7da-95a2a60c09af None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:01.674053 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1572db3-1c2e-4321-a9f6-857a5f3a1937 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:01.706395 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b86ef2-b022-471a-b7ba-7c3b8ec14c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:01.707023 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b86ef2-b022-471a-b7ba-7c3b8ec14c8d None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:01.707312 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b86ef2-b022-471a-b7ba-7c3b8ec14c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:01.707592 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b86ef2-b022-471a-b7ba-7c3b8ec14c8d None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:01.708297 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b86ef2-b022-471a-b7ba-7c3b8ec14c8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:01.709345 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25698c4-d36e-4540-a7da-95a2a60c09af None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:01.709720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b86ef2-b022-471a-b7ba-7c3b8ec14c8d None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:01.741147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670836b-ef9f-40fa-b5ed-da6d407a417b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:01.741790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670836b-ef9f-40fa-b5ed-da6d407a417b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:01.742076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670836b-ef9f-40fa-b5ed-da6d407a417b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:01.742350 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670836b-ef9f-40fa-b5ed-da6d407a417b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:01.761728 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 41/82] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 10 21:01:01 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:01:01.762584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b86ef2-b022-471a-b7ba-7c3b8ec14c8d None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:01.814127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670836b-ef9f-40fa-b5ed-da6d407a417b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:01.815654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670836b-ef9f-40fa-b5ed-da6d407a417b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:01.875676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b86ef2-b022-471a-b7ba-7c3b8ec14c8d None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:01.911976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aecfde-13dc-4b77-a6bf-9459c142b248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:01.913006 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aecfde-13dc-4b77-a6bf-9459c142b248 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:01.913470 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aecfde-13dc-4b77-a6bf-9459c142b248 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:01.913921 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aecfde-13dc-4b77-a6bf-9459c142b248 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:01.914920 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aecfde-13dc-4b77-a6bf-9459c142b248 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:01.915439 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aecfde-13dc-4b77-a6bf-9459c142b248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:01.916949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aecfde-13dc-4b77-a6bf-9459c142b248 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:01.927097 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 42/83] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:01.927765 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aecfde-13dc-4b77-a6bf-9459c142b248 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:01.939732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 42/84] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:01.939732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670836b-ef9f-40fa-b5ed-da6d407a417b None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:02.039578 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aecfde-13dc-4b77-a6bf-9459c142b248 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:02.061636 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670836b-ef9f-40fa-b5ed-da6d407a417b None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:02.086665 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ba72c-6f74-480b-8f06-7d5e89bfd149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:02.087547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ba72c-6f74-480b-8f06-7d5e89bfd149 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:02.087833 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ba72c-6f74-480b-8f06-7d5e89bfd149 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:02.088113 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ba72c-6f74-480b-8f06-7d5e89bfd149 None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:02.089326 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ba72c-6f74-480b-8f06-7d5e89bfd149 None admin] RBAC: Authorizing `identity:get_project(project_id=f157df588b834944b8799b6d43e8319a)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:02.091977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ba72c-6f74-480b-8f06-7d5e89bfd149 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:02.093123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 43/85] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:01 2022] GET /identity/v3/projects/f157df588b834944b8799b6d43e8319a => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:02.093889 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ba72c-6f74-480b-8f06-7d5e89bfd149 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:02.111530 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7bd8e-d762-4999-bca0-a353a5ebc3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:02.112206 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7bd8e-d762-4999-bca0-a353a5ebc3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:02.112492 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7bd8e-d762-4999-bca0-a353a5ebc3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:02.112773 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7bd8e-d762-4999-bca0-a353a5ebc3a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:02.113531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7bd8e-d762-4999-bca0-a353a5ebc3a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:02.113841 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7bd8e-d762-4999-bca0-a353a5ebc3a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:02.115260 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7bd8e-d762-4999-bca0-a353a5ebc3a0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:02.126734 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 43/86] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:02.128059 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7bd8e-d762-4999-bca0-a353a5ebc3a0 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:02.217797 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ba72c-6f74-480b-8f06-7d5e89bfd149 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:02.232356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7bd8e-d762-4999-bca0-a353a5ebc3a0 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:02.261350 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be3669-b8fb-4003-b542-ffeb11f6ce89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:02.262281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be3669-b8fb-4003-b542-ffeb11f6ce89 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:02.262607 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be3669-b8fb-4003-b542-ffeb11f6ce89 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:02.262890 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be3669-b8fb-4003-b542-ffeb11f6ce89 None admin] PATH_INFO: `/v3/users/94be445c202a4e67aef3505af25af405` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:02.264325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be3669-b8fb-4003-b542-ffeb11f6ce89 None admin] RBAC: Authorizing `identity:get_user(user_id=94be445c202a4e67aef3505af25af405)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:02.266265 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be3669-b8fb-4003-b542-ffeb11f6ce89 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:02.268212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 44/87] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:02 2022] GET /identity/v3/users/94be445c202a4e67aef3505af25af405 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:02.269059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be3669-b8fb-4003-b542-ffeb11f6ce89 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:02.271058 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a8a85-5338-43fe-a9b6-99356ff948c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:02.272301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a8a85-5338-43fe-a9b6-99356ff948c6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:02.273552 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a8a85-5338-43fe-a9b6-99356ff948c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:02.273998 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a8a85-5338-43fe-a9b6-99356ff948c6 None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:02.275408 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a8a85-5338-43fe-a9b6-99356ff948c6 None admin] RBAC: Authorizing `identity:get_project(project_id=f157df588b834944b8799b6d43e8319a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:02.276989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a8a85-5338-43fe-a9b6-99356ff948c6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:02.280147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 44/88] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:02 2022] GET /identity/v3/projects/f157df588b834944b8799b6d43e8319a => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:02.281078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a8a85-5338-43fe-a9b6-99356ff948c6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:02.391483 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a8a85-5338-43fe-a9b6-99356ff948c6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:02.394678 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be3669-b8fb-4003-b542-ffeb11f6ce89 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:02.426808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84e68c-6941-4991-88b5-1038c7f417b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:02.428510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84e68c-6941-4991-88b5-1038c7f417b4 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:02.429040 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84e68c-6941-4991-88b5-1038c7f417b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:02.429563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84e68c-6941-4991-88b5-1038c7f417b4 None admin] PATH_INFO: `/v3/users/33781cd02a6e417a9a09ee0ca6390d4d` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:02.430148 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bdd37-1fbf-47f8-bbad-9057c0405e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:02.430995 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bdd37-1fbf-47f8-bbad-9057c0405e93 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:02.431381 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bdd37-1fbf-47f8-bbad-9057c0405e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:02.431762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bdd37-1fbf-47f8-bbad-9057c0405e93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:02.432002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84e68c-6941-4991-88b5-1038c7f417b4 None admin] RBAC: Authorizing `identity:get_user(user_id=33781cd02a6e417a9a09ee0ca6390d4d)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:02.432912 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bdd37-1fbf-47f8-bbad-9057c0405e93 None admin] RBAC: Adding query filter params (role.id=390d715fbb0f4d029b222894fa3ac65b, scope.project.id=f157df588b834944b8799b6d43e8319a, user.id=33781cd02a6e417a9a09ee0ca6390d4d) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:02.433368 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bdd37-1fbf-47f8-bbad-9057c0405e93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:02.434684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84e68c-6941-4991-88b5-1038c7f417b4 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:02.435862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bdd37-1fbf-47f8-bbad-9057c0405e93 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:02.436625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 45/89] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:02 2022] GET /identity/v3/users/33781cd02a6e417a9a09ee0ca6390d4d => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:02.438098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84e68c-6941-4991-88b5-1038c7f417b4 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:02.446493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 45/90] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:01:02 2022] GET /identity/v3/role_assignments?user.id=33781cd02a6e417a9a09ee0ca6390d4d&scope.project.id=f157df588b834944b8799b6d43e8319a&role.id=390d715fbb0f4d029b222894fa3ac65b => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:02.447754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bdd37-1fbf-47f8-bbad-9057c0405e93 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:02.541699 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84e68c-6941-4991-88b5-1038c7f417b4 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:02.555518 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bdd37-1fbf-47f8-bbad-9057c0405e93 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:02.578111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7481a6d-8570-4571-a46a-8d4ded62ca0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:02.579140 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7481a6d-8570-4571-a46a-8d4ded62ca0b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:02.579628 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7481a6d-8570-4571-a46a-8d4ded62ca0b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:02.580099 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7481a6d-8570-4571-a46a-8d4ded62ca0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:02.591719 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a6432-1022-4d6b-8977-7eb25887eda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:02.592402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a6432-1022-4d6b-8977-7eb25887eda3 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:02.592691 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a6432-1022-4d6b-8977-7eb25887eda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:02.592974 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a6432-1022-4d6b-8977-7eb25887eda3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:02.593838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a6432-1022-4d6b-8977-7eb25887eda3 None admin] RBAC: Adding query filter params (role.id=c1ddef32606649809bb218b686f472c5, scope.project.id=f157df588b834944b8799b6d43e8319a, user.id=33781cd02a6e417a9a09ee0ca6390d4d) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:02.594202 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a6432-1022-4d6b-8977-7eb25887eda3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:02.602058 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a6432-1022-4d6b-8977-7eb25887eda3 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:02.602236 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 46/91] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:01:02 2022] GET /identity/v3/role_assignments?user.id=33781cd02a6e417a9a09ee0ca6390d4d&scope.project.id=f157df588b834944b8799b6d43e8319a&role.id=c1ddef32606649809bb218b686f472c5 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:02.603113 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a6432-1022-4d6b-8977-7eb25887eda3 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:02.717885 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a6432-1022-4d6b-8977-7eb25887eda3 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:02.740176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7481a6d-8570-4571-a46a-8d4ded62ca0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:02.741656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7481a6d-8570-4571-a46a-8d4ded62ca0b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:02.755329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598848c1-ba46-43d2-a788-10ac9b7cd741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:02.756015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598848c1-ba46-43d2-a788-10ac9b7cd741 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:02.756303 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598848c1-ba46-43d2-a788-10ac9b7cd741 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:02.756656 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598848c1-ba46-43d2-a788-10ac9b7cd741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:02.831379 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598848c1-ba46-43d2-a788-10ac9b7cd741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:02.832900 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598848c1-ba46-43d2-a788-10ac9b7cd741 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:02.938619 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 47/92] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:02.944271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598848c1-ba46-43d2-a788-10ac9b7cd741 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:02.965543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 46/93] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:02.971394 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7481a6d-8570-4571-a46a-8d4ded62ca0b None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:03.082088 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598848c1-ba46-43d2-a788-10ac9b7cd741 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:03.140212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7481a6d-8570-4571-a46a-8d4ded62ca0b None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:03.163152 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4b8c2-3f39-425a-9f74-580ab742a85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:03.164090 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4b8c2-3f39-425a-9f74-580ab742a85b None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:03.164384 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4b8c2-3f39-425a-9f74-580ab742a85b None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:03.164665 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4b8c2-3f39-425a-9f74-580ab742a85b None admin] PATH_INFO: `/v3/projects/cb009ef43b0245cc8813d685294ae36e` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:03.165898 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4b8c2-3f39-425a-9f74-580ab742a85b None admin] RBAC: Authorizing `identity:get_project(project_id=cb009ef43b0245cc8813d685294ae36e)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:03.167370 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4b8c2-3f39-425a-9f74-580ab742a85b None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:03.169133 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 48/94] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:02 2022] GET /identity/v3/projects/cb009ef43b0245cc8813d685294ae36e => generated 312 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:03.175289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4b8c2-3f39-425a-9f74-580ab742a85b None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:03.208747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e9910-0a19-48ce-ab5a-6d0ee5bbcaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:03.209643 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9910-0a19-48ce-ab5a-6d0ee5bbcaac None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:03.209938 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9910-0a19-48ce-ab5a-6d0ee5bbcaac None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:03.210225 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9910-0a19-48ce-ab5a-6d0ee5bbcaac None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:03.215992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e9910-0a19-48ce-ab5a-6d0ee5bbcaac None admin] RBAC: Authorizing `identity:get_project(project_id=f157df588b834944b8799b6d43e8319a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:03.217456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e9910-0a19-48ce-ab5a-6d0ee5bbcaac None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:03.219391 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 47/95] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:02 2022] GET /identity/v3/projects/f157df588b834944b8799b6d43e8319a => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:03.224939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e9910-0a19-48ce-ab5a-6d0ee5bbcaac None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:03.364908 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4b8c2-3f39-425a-9f74-580ab742a85b None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:03.416353 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e9910-0a19-48ce-ab5a-6d0ee5bbcaac None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:03.428831 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dd03a-ef10-4835-809f-b2174bb7d727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:03.429509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dd03a-ef10-4835-809f-b2174bb7d727 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:03.429831 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dd03a-ef10-4835-809f-b2174bb7d727 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:03.430115 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dd03a-ef10-4835-809f-b2174bb7d727 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:03.431027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dd03a-ef10-4835-809f-b2174bb7d727 None admin] RBAC: Adding query filter params (role.id=390d715fbb0f4d029b222894fa3ac65b, scope.project.id=cb009ef43b0245cc8813d685294ae36e, user.id=33781cd02a6e417a9a09ee0ca6390d4d) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:03.431546 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dd03a-ef10-4835-809f-b2174bb7d727 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:03.432798 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dd03a-ef10-4835-809f-b2174bb7d727 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:03.444397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 49/96] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:01:03 2022] GET /identity/v3/role_assignments?user.id=33781cd02a6e417a9a09ee0ca6390d4d&scope.project.id=cb009ef43b0245cc8813d685294ae36e&role.id=390d715fbb0f4d029b222894fa3ac65b => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:03.468725 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92626ae3-b3af-44b3-9510-15b53fc996fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:03.469397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92626ae3-b3af-44b3-9510-15b53fc996fe None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:03.469689 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92626ae3-b3af-44b3-9510-15b53fc996fe None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:03.469971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92626ae3-b3af-44b3-9510-15b53fc996fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:03.470855 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92626ae3-b3af-44b3-9510-15b53fc996fe None admin] RBAC: Adding query filter params (role.id=5cd001edc58744738aa57180c0be68a9, scope.project.id=f157df588b834944b8799b6d43e8319a, user.id=94be445c202a4e67aef3505af25af405) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:03.471173 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92626ae3-b3af-44b3-9510-15b53fc996fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:03.472630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92626ae3-b3af-44b3-9510-15b53fc996fe None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:03.478910 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 48/97] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:01:03 2022] GET /identity/v3/role_assignments?user.id=94be445c202a4e67aef3505af25af405&scope.project.id=f157df588b834944b8799b6d43e8319a&role.id=5cd001edc58744738aa57180c0be68a9 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:04.811620 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443e4e2-ed34-4145-be9b-0324ee783405 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:04.812127 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443e4e2-ed34-4145-be9b-0324ee783405 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:04.812200 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443e4e2-ed34-4145-be9b-0324ee783405 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:04.813542 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 50/98] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:04.818908 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f528a9-ceca-4877-a3ac-cedcda3ec3ba None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:04.819740 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f528a9-ceca-4877-a3ac-cedcda3ec3ba None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:04.820222 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f528a9-ceca-4877-a3ac-cedcda3ec3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:04.843586 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-46f528a9-ceca-4877-a3ac-cedcda3ec3ba None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:04.844793 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-46f528a9-ceca-4877-a3ac-cedcda3ec3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:04.927813 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 49/99] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:04.961146 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443e4e2-ed34-4145-be9b-0324ee783405 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:05.091849 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443e4e2-ed34-4145-be9b-0324ee783405 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:05.127044 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631a817-23a6-411c-87fc-12d6a209715d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:05.127858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631a817-23a6-411c-87fc-12d6a209715d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:05.128151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631a817-23a6-411c-87fc-12d6a209715d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:05.128431 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631a817-23a6-411c-87fc-12d6a209715d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:05.129629 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631a817-23a6-411c-87fc-12d6a209715d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:05.131110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631a817-23a6-411c-87fc-12d6a209715d None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:05.132905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 51/100] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:05.139033 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f528a9-ceca-4877-a3ac-cedcda3ec3ba None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:05.242237 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f528a9-ceca-4877-a3ac-cedcda3ec3ba None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:05.275178 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e898898-0a39-421a-b929-5a96aaa5e8af None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:05.275475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e898898-0a39-421a-b929-5a96aaa5e8af None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:05.275749 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e898898-0a39-421a-b929-5a96aaa5e8af None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:05.277307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 52/101] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:05.282385 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e9dc3-7ca3-41d0-a1c5-6789582d88b1 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:05.282711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e9dc3-7ca3-41d0-a1c5-6789582d88b1 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:05.282997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e9dc3-7ca3-41d0-a1c5-6789582d88b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:05.298448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39542807-e378-4cff-8c3f-cc06ee0097a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:05.299136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39542807-e378-4cff-8c3f-cc06ee0097a4 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:05.299689 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39542807-e378-4cff-8c3f-cc06ee0097a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:05.300083 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39542807-e378-4cff-8c3f-cc06ee0097a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:05.300818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39542807-e378-4cff-8c3f-cc06ee0097a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:05.302284 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39542807-e378-4cff-8c3f-cc06ee0097a4 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:05.311729 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-3c1e9dc3-7ca3-41d0-a1c5-6789582d88b1 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:05.312945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-3c1e9dc3-7ca3-41d0-a1c5-6789582d88b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:05.400584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 53/102] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:01:05.426412 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e9dc3-7ca3-41d0-a1c5-6789582d88b1 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:05.455596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 50/103] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 10 21:01:05 2022] POST /identity/v3/projects => generated 302 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:01:05.543615 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e9dc3-7ca3-41d0-a1c5-6789582d88b1 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:05.579758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f5306-04f7-48c8-bb26-b27e34bb1943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:05.580590 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f5306-04f7-48c8-bb26-b27e34bb1943 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:05.580939 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f5306-04f7-48c8-bb26-b27e34bb1943 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:05.581232 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f5306-04f7-48c8-bb26-b27e34bb1943 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:05.593210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f5306-04f7-48c8-bb26-b27e34bb1943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:05.601149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-023f5306-04f7-48c8-bb26-b27e34bb1943 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 21:01:05.601149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:05.601149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:05.601149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:05.601149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:05.601149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:05.601149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:05.601149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:05.601149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:05.601149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:05.601149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:05.601149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:05.601149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:05.601149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:05.601149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:05.601149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:05.602151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:05.602151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:05.602151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:05.602151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:05.602151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:05.602151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:05.602151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:05.602151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:05.602151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:05.602151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:05.602151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:05.602151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:05.602151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:05.602151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:05.602151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:05.602151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:05.602984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:05.602984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:05.602984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:05.602984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:05.602984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:05.602984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:05.602984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:05.602984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:05.602984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:05.602984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:05.602984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 21:01:05.602984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:05.602984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 54/104] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:05.610834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39542807-e378-4cff-8c3f-cc06ee0097a4 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:05.749361 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39542807-e378-4cff-8c3f-cc06ee0097a4 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:05.752744 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d919c-fe56-4940-afb6-72062608c54a None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:05.753044 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d919c-fe56-4940-afb6-72062608c54a None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:05.753335 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d919c-fe56-4940-afb6-72062608c54a None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:05.754872 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 55/105] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:05.771877 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf800ea-d2ab-4d2a-be56-5a579a0d4ca7 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:05.772158 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf800ea-d2ab-4d2a-be56-5a579a0d4ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:05.772442 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf800ea-d2ab-4d2a-be56-5a579a0d4ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:05.783023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36670df-ee76-48b3-8a51-796397585277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:05.783777 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36670df-ee76-48b3-8a51-796397585277 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:05.783990 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36670df-ee76-48b3-8a51-796397585277 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:05.784268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36670df-ee76-48b3-8a51-796397585277 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:05.785029 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36670df-ee76-48b3-8a51-796397585277 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:05.785336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36670df-ee76-48b3-8a51-796397585277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:05.786725 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36670df-ee76-48b3-8a51-796397585277 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:05.796809 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 51/106] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:05.802399 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36670df-ee76-48b3-8a51-796397585277 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:05.815678 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-ccf800ea-d2ab-4d2a-be56-5a579a0d4ca7 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:05.816935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-ccf800ea-d2ab-4d2a-be56-5a579a0d4ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:05.908802 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36670df-ee76-48b3-8a51-796397585277 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:05.944462 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 56/107] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:05.944997 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb897408-cfc1-4f99-8674-aa07ca52fe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:05.945933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb897408-cfc1-4f99-8674-aa07ca52fe94 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:05.946237 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb897408-cfc1-4f99-8674-aa07ca52fe94 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:05.946543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb897408-cfc1-4f99-8674-aa07ca52fe94 None admin] PATH_INFO: `/v3/users/b1627d165b1f44de8c1843fb87bbaf7f` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:05.960448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb897408-cfc1-4f99-8674-aa07ca52fe94 None admin] RBAC: Authorizing `identity:get_user(user_id=b1627d165b1f44de8c1843fb87bbaf7f)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:05.961904 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb897408-cfc1-4f99-8674-aa07ca52fe94 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:05.963650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 52/108] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:05 2022] GET /identity/v3/users/b1627d165b1f44de8c1843fb87bbaf7f => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:05.969801 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf800ea-d2ab-4d2a-be56-5a579a0d4ca7 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:05.983126 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb897408-cfc1-4f99-8674-aa07ca52fe94 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:06.109576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf800ea-d2ab-4d2a-be56-5a579a0d4ca7 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:06.146170 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257c89b-159b-4507-af5b-4f87b0a8fc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:06.146941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257c89b-159b-4507-af5b-4f87b0a8fc45 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:06.147296 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257c89b-159b-4507-af5b-4f87b0a8fc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:06.147645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257c89b-159b-4507-af5b-4f87b0a8fc45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:06.168366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb897408-cfc1-4f99-8674-aa07ca52fe94 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:06.235988 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45f676-95e3-47e2-be0d-793f50b5904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:06.236800 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45f676-95e3-47e2-be0d-793f50b5904f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:06.237089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45f676-95e3-47e2-be0d-793f50b5904f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:06.237371 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45f676-95e3-47e2-be0d-793f50b5904f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:06.256203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45f676-95e3-47e2-be0d-793f50b5904f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:06.267578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-de45f676-95e3-47e2-be0d-793f50b5904f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:06.267578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:06.267578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:06.267578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:06.267578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:06.267578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:06.267578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:06.267578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:06.267578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:06.267578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:06.267578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:06.267578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:06.267578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:06.267578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:06.267578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:06.267578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:06.268473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:06.268473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:06.268473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:06.268473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:06.268473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:06.268473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:06.268473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:06.268473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:06.268473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:06.268473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:06.268473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:06.268473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:06.268473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:06.268473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:06.268473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:06.268473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:06.269234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:06.269234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:06.269234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:06.269234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:06.269234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:06.269234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:06.269234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:06.269234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:06.269234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:06.269234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:06.269234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:06.269234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:06.269234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 53/109] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:01:06.276770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257c89b-159b-4507-af5b-4f87b0a8fc45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:06.278884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257c89b-159b-4507-af5b-4f87b0a8fc45 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:06.281327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27ceeb-43ad-4f8b-9c31-364e969b85b7 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:06.281618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27ceeb-43ad-4f8b-9c31-364e969b85b7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:06.281903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27ceeb-43ad-4f8b-9c31-364e969b85b7 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:06.284685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 54/110] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:06 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:06.293344 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27ceeb-43ad-4f8b-9c31-364e969b85b7 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:06.457331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27ceeb-43ad-4f8b-9c31-364e969b85b7 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:06.485505 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 57/111] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:06.486803 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb7de3-cdf4-4080-bf02-b5ca382077aa None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:06.487108 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb7de3-cdf4-4080-bf02-b5ca382077aa None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:06.487388 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb7de3-cdf4-4080-bf02-b5ca382077aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:06.503851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-7cbb7de3-cdf4-4080-bf02-b5ca382077aa None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:06.504745 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0454f0a-f756-4214-8faf-664e662623cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:06.505034 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-7cbb7de3-cdf4-4080-bf02-b5ca382077aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:06.505419 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0454f0a-f756-4214-8faf-664e662623cb None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:06.505708 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0454f0a-f756-4214-8faf-664e662623cb None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:06.505988 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0454f0a-f756-4214-8faf-664e662623cb None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:06.506770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0454f0a-f756-4214-8faf-664e662623cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:06.507248 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0454f0a-f756-4214-8faf-664e662623cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:06.509377 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0454f0a-f756-4214-8faf-664e662623cb None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:06.522519 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 55/112] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:06.523907 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993724ef-390e-438f-9611-0c690f487f19 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:06.524201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993724ef-390e-438f-9611-0c690f487f19 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:06.524483 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993724ef-390e-438f-9611-0c690f487f19 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:06.525957 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 56/113] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:06.529470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993724ef-390e-438f-9611-0c690f487f19 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:06.588825 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 58/114] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:06.589908 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb7de3-cdf4-4080-bf02-b5ca382077aa None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:06.638261 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993724ef-390e-438f-9611-0c690f487f19 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:06.673163 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5e99b-2836-4222-8a1d-c33232a11f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:06.674041 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5e99b-2836-4222-8a1d-c33232a11f38 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:06.674597 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5e99b-2836-4222-8a1d-c33232a11f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:06.674894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5e99b-2836-4222-8a1d-c33232a11f38 None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:06.676115 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5e99b-2836-4222-8a1d-c33232a11f38 None admin] RBAC: Authorizing `identity:get_project(project_id=f157df588b834944b8799b6d43e8319a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:06.677552 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5e99b-2836-4222-8a1d-c33232a11f38 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:06.679659 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 57/115] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:06 2022] GET /identity/v3/projects/f157df588b834944b8799b6d43e8319a => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:06.680891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd594ec-c78f-433a-863b-ed0622588737 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:06.681185 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd594ec-c78f-433a-863b-ed0622588737 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:06.681465 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd594ec-c78f-433a-863b-ed0622588737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:06.698851 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-3fd594ec-c78f-433a-863b-ed0622588737 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:06.700619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3fd594ec-c78f-433a-863b-ed0622588737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:06.701092 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb7de3-cdf4-4080-bf02-b5ca382077aa None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:06.735490 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cb862-17e7-4549-8649-152879ab4e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:06.736306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cb862-17e7-4549-8649-152879ab4e3f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:06.736590 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cb862-17e7-4549-8649-152879ab4e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:06.736864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cb862-17e7-4549-8649-152879ab4e3f None admin] PATH_INFO: `/v3/users/33781cd02a6e417a9a09ee0ca6390d4d` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:06.738072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cb862-17e7-4549-8649-152879ab4e3f None admin] RBAC: Authorizing `identity:get_user(user_id=33781cd02a6e417a9a09ee0ca6390d4d)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:06.739608 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cb862-17e7-4549-8649-152879ab4e3f None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:06.741297 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 59/116] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:06 2022] GET /identity/v3/users/33781cd02a6e417a9a09ee0ca6390d4d => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:06.747051 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cb862-17e7-4549-8649-152879ab4e3f None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:06.768332 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 58/117] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:06.769288 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd594ec-c78f-433a-863b-ed0622588737 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:06.867773 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd594ec-c78f-433a-863b-ed0622588737 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:06.872810 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cb862-17e7-4549-8649-152879ab4e3f None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:06.902561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bdd1c-c63c-4c46-8595-5063884cf367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:06.903227 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bdd1c-c63c-4c46-8595-5063884cf367 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:06.903522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bdd1c-c63c-4c46-8595-5063884cf367 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:06.903800 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bdd1c-c63c-4c46-8595-5063884cf367 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:06.904643 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821bdd1c-c63c-4c46-8595-5063884cf367 None admin] RBAC: Adding query filter params (role.id=09fc23a294c748939513cefa3e91b27f, scope.project.id=f157df588b834944b8799b6d43e8319a, user.id=b1627d165b1f44de8c1843fb87bbaf7f) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:06.904961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821bdd1c-c63c-4c46-8595-5063884cf367 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:06.906393 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821bdd1c-c63c-4c46-8595-5063884cf367 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:06.907564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef514d2-ff14-4149-8eba-611f08a70f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:06.908542 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef514d2-ff14-4149-8eba-611f08a70f6f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:06.908966 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef514d2-ff14-4149-8eba-611f08a70f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:06.909381 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef514d2-ff14-4149-8eba-611f08a70f6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:06.912118 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 59/118] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:01:06 2022] GET /identity/v3/role_assignments?user.id=b1627d165b1f44de8c1843fb87bbaf7f&scope.project.id=f157df588b834944b8799b6d43e8319a&role.id=09fc23a294c748939513cefa3e91b27f => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:06.912979 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bdd1c-c63c-4c46-8595-5063884cf367 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:06.923033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef514d2-ff14-4149-8eba-611f08a70f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:06.932027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-8ef514d2-ff14-4149-8eba-611f08a70f6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:06.932027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:06.932027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:06.932027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:06.932027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:06.932027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:06.932027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:06.932027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:06.932027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:06.932027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:06.932027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:06.932027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:06.932027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:06.932027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:06.932027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:06.932027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:06.932960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:06.932960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:06.932960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:06.932960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:06.932960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:06.932960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:06.932960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:06.932960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:06.932960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:06.932960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:06.932960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:06.932960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:06.932960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:06.932960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:06.932960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:06.932960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:06.934416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:06.934416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:06.934416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:06.934416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:06.934416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:06.934416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:06.934416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:06.934416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:06.934416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:06.934416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:06.934416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:06.934416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:06.936760 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 60/119] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:01:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:06.937715 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef514d2-ff14-4149-8eba-611f08a70f6f None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:07.031195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bdd1c-c63c-4c46-8595-5063884cf367 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:07.060737 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67382ab7-5d29-4162-a33c-8b78133e3f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:07.061711 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67382ab7-5d29-4162-a33c-8b78133e3f18 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:07.062458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67382ab7-5d29-4162-a33c-8b78133e3f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:07.062458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67382ab7-5d29-4162-a33c-8b78133e3f18 None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:07.063674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67382ab7-5d29-4162-a33c-8b78133e3f18 None admin] RBAC: Authorizing `identity:get_project(project_id=f157df588b834944b8799b6d43e8319a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:07.065206 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67382ab7-5d29-4162-a33c-8b78133e3f18 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:07.071703 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 60/120] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:06 2022] GET /identity/v3/projects/f157df588b834944b8799b6d43e8319a => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:07.071703 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67382ab7-5d29-4162-a33c-8b78133e3f18 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:07.081425 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef514d2-ff14-4149-8eba-611f08a70f6f None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:07.119178 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b3415-09bf-46bb-a7b8-eafad074e9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:07.120375 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b3415-09bf-46bb-a7b8-eafad074e9ff None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:07.121149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b3415-09bf-46bb-a7b8-eafad074e9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:07.121641 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b3415-09bf-46bb-a7b8-eafad074e9ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:07.142862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b3415-09bf-46bb-a7b8-eafad074e9ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:07.159772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-ff7b3415-09bf-46bb-a7b8-eafad074e9ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:01:07.159772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:07.159772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:07.159772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:07.159772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:07.159772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:07.159772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:07.159772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:07.159772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:07.159772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:07.159772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:07.159772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:07.159772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:07.159772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:07.159772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:07.159772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:07.160722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:07.160722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:07.160722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:07.160722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:07.160722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:07.160722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:07.160722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:07.160722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:07.160722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:07.160722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:07.160722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:07.160722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:07.160722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:07.160722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:07.160722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:07.160722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:07.161488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:07.161488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:07.161488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:07.161488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:07.161488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:07.161488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:07.161488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:07.161488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:07.161488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:07.161488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:07.161488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:01:07.161488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:07.161488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 61/121] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:01:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:07.162140 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b3415-09bf-46bb-a7b8-eafad074e9ff None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:07.207688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67382ab7-5d29-4162-a33c-8b78133e3f18 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:07.244587 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91871f3-a151-44af-925b-2d80aad9dcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:07.245270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91871f3-a151-44af-925b-2d80aad9dcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:07.245567 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91871f3-a151-44af-925b-2d80aad9dcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:07.245891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91871f3-a151-44af-925b-2d80aad9dcc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:07.246684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91871f3-a151-44af-925b-2d80aad9dcc0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:07.246997 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91871f3-a151-44af-925b-2d80aad9dcc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:07.248396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91871f3-a151-44af-925b-2d80aad9dcc0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:07.257519 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 61/122] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:01:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:07.258252 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91871f3-a151-44af-925b-2d80aad9dcc0 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:07.326978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b3415-09bf-46bb-a7b8-eafad074e9ff None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:07.360688 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1b952-a467-43c9-8d6c-6cf1f859cc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:07.361681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1b952-a467-43c9-8d6c-6cf1f859cc68 None admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:07.361940 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1b952-a467-43c9-8d6c-6cf1f859cc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:07.362271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1b952-a467-43c9-8d6c-6cf1f859cc68 None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a/users/33781cd02a6e417a9a09ee0ca6390d4d/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:07.364320 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1b952-a467-43c9-8d6c-6cf1f859cc68 None admin] RBAC: Authorizing `identity:create_grant(project_id=f157df588b834944b8799b6d43e8319a, user_id=33781cd02a6e417a9a09ee0ca6390d4d, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:07.366055 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1b952-a467-43c9-8d6c-6cf1f859cc68 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:07.373198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91871f3-a151-44af-925b-2d80aad9dcc0 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:07.405858 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c669b-de28-419e-b20c-c52d06b8e89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:07.406574 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c669b-de28-419e-b20c-c52d06b8e89b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:07.406861 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c669b-de28-419e-b20c-c52d06b8e89b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:07.407144 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c669b-de28-419e-b20c-c52d06b8e89b None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:07.407899 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c669b-de28-419e-b20c-c52d06b8e89b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:07.408216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c669b-de28-419e-b20c-c52d06b8e89b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:07.409582 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c669b-de28-419e-b20c-c52d06b8e89b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:07.418060 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 62/123] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:07.422957 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12569826-8b18-40de-b03f-f29a6933ad7d None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:07.422957 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12569826-8b18-40de-b03f-f29a6933ad7d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:07.422957 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12569826-8b18-40de-b03f-f29a6933ad7d None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:07.422957 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 63/124] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:07.422957 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12569826-8b18-40de-b03f-f29a6933ad7d None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:07.477895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 62/125] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:01:07 2022] PUT /identity/v3/projects/f157df588b834944b8799b6d43e8319a/users/33781cd02a6e417a9a09ee0ca6390d4d/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:01:07.479207 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1b952-a467-43c9-8d6c-6cf1f859cc68 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:07.555474 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12569826-8b18-40de-b03f-f29a6933ad7d None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:07.593447 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fd2d7-4919-43be-88f0-aa3ed46c95c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:07.594749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fd2d7-4919-43be-88f0-aa3ed46c95c4 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:07.595240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fd2d7-4919-43be-88f0-aa3ed46c95c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:07.595714 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fd2d7-4919-43be-88f0-aa3ed46c95c4 None admin] PATH_INFO: `/v3/users/33781cd02a6e417a9a09ee0ca6390d4d` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:07.597346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fd2d7-4919-43be-88f0-aa3ed46c95c4 None admin] RBAC: Authorizing `identity:get_user(user_id=33781cd02a6e417a9a09ee0ca6390d4d)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:07.599076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fd2d7-4919-43be-88f0-aa3ed46c95c4 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:07.601082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 64/126] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:07 2022] GET /identity/v3/users/33781cd02a6e417a9a09ee0ca6390d4d => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:07.602525 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9111317-9cc9-4f06-9e39-28197a3cd0b3 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:07.603021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9111317-9cc9-4f06-9e39-28197a3cd0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:07.603506 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9111317-9cc9-4f06-9e39-28197a3cd0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:07.621620 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a9111317-9cc9-4f06-9e39-28197a3cd0b3 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:07.623236 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a9111317-9cc9-4f06-9e39-28197a3cd0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:07.694107 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1b952-a467-43c9-8d6c-6cf1f859cc68 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:07.700294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 65/127] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:07.701233 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9111317-9cc9-4f06-9e39-28197a3cd0b3 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:07.740581 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1890135-cdee-4d61-9fea-099c8abe3b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:07.741984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1890135-cdee-4d61-9fea-099c8abe3b23 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:07.742276 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1890135-cdee-4d61-9fea-099c8abe3b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:07.743945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1890135-cdee-4d61-9fea-099c8abe3b23 None admin] PATH_INFO: `/v3/users/94be445c202a4e67aef3505af25af405` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:07.747348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1890135-cdee-4d61-9fea-099c8abe3b23 None admin] RBAC: Authorizing `identity:get_user(user_id=94be445c202a4e67aef3505af25af405)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:07.749083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1890135-cdee-4d61-9fea-099c8abe3b23 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:07.751936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 63/128] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:07 2022] GET /identity/v3/users/94be445c202a4e67aef3505af25af405 => generated 247 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:07.752930 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1890135-cdee-4d61-9fea-099c8abe3b23 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:07.829808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9111317-9cc9-4f06-9e39-28197a3cd0b3 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:07.865108 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49280b6-07c2-4055-93b5-f4e745c57ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:07.866007 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49280b6-07c2-4055-93b5-f4e745c57ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:07.866296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49280b6-07c2-4055-93b5-f4e745c57ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:07.866606 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49280b6-07c2-4055-93b5-f4e745c57ea8 None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:07.867849 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49280b6-07c2-4055-93b5-f4e745c57ea8 None admin] RBAC: Authorizing `identity:get_project(project_id=f157df588b834944b8799b6d43e8319a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:07.869282 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49280b6-07c2-4055-93b5-f4e745c57ea8 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:07.871584 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 66/129] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:07 2022] GET /identity/v3/projects/f157df588b834944b8799b6d43e8319a => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:07.872351 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49280b6-07c2-4055-93b5-f4e745c57ea8 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:07.912547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1890135-cdee-4d61-9fea-099c8abe3b23 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:07.964139 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419eb8c-ccd3-49aa-b9f6-86f2c791597a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:07.965252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419eb8c-ccd3-49aa-b9f6-86f2c791597a None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:07.965547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419eb8c-ccd3-49aa-b9f6-86f2c791597a None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:07.965813 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419eb8c-ccd3-49aa-b9f6-86f2c791597a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:07.972990 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49280b6-07c2-4055-93b5-f4e745c57ea8 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:07.987869 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419eb8c-ccd3-49aa-b9f6-86f2c791597a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:07.995668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-d419eb8c-ccd3-49aa-b9f6-86f2c791597a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:07.995668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:07.995668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:07.995668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:07.995668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:07.995668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:07.995668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:07.995668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:07.995668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:07.995668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:07.995668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:07.995668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:07.995668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:07.995668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:07.995668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:07.995668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:07.997111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:07.997111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:07.997111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:07.997111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:07.997111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:07.997111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:07.997111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:07.997111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:07.997111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:07.997111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:07.997111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:07.997111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:07.997111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:07.997111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:07.997111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:07.997111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:07.997933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:07.997933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:07.997933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:07.997933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:07.997933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:07.997933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:07.997933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:07.997933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:07.997933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:07.997933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:07.997933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:07.997933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:07.997933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 64/130] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:07.999434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419eb8c-ccd3-49aa-b9f6-86f2c791597a None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:08.009675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb4654-51c8-434c-8d79-c605c710e522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:08.010585 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb4654-51c8-434c-8d79-c605c710e522 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:08.010873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb4654-51c8-434c-8d79-c605c710e522 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:08.011155 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb4654-51c8-434c-8d79-c605c710e522 None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:08.012393 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb4654-51c8-434c-8d79-c605c710e522 None admin] RBAC: Authorizing `identity:get_project(project_id=f157df588b834944b8799b6d43e8319a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:08.013879 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb4654-51c8-434c-8d79-c605c710e522 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:08.015652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 67/131] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:07 2022] GET /identity/v3/projects/f157df588b834944b8799b6d43e8319a => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:08.016407 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb4654-51c8-434c-8d79-c605c710e522 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:08.120819 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419eb8c-ccd3-49aa-b9f6-86f2c791597a None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:08.173706 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb4654-51c8-434c-8d79-c605c710e522 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:08.179159 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7406d0-9a2c-4578-8969-b279daf696f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:08.180080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7406d0-9a2c-4578-8969-b279daf696f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:08.180371 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7406d0-9a2c-4578-8969-b279daf696f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:08.180656 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7406d0-9a2c-4578-8969-b279daf696f4 None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a/users/33781cd02a6e417a9a09ee0ca6390d4d/roles/c1ddef32606649809bb218b686f472c5` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:08.187788 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7406d0-9a2c-4578-8969-b279daf696f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f157df588b834944b8799b6d43e8319a, user_id=33781cd02a6e417a9a09ee0ca6390d4d, role_id=c1ddef32606649809bb218b686f472c5)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:08.189267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7406d0-9a2c-4578-8969-b279daf696f4 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:08.207204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245db7d8-ca19-40af-b8c0-f64d2ddb760f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:08.218619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db7d8-ca19-40af-b8c0-f64d2ddb760f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:08.218619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db7d8-ca19-40af-b8c0-f64d2ddb760f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:08.218619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db7d8-ca19-40af-b8c0-f64d2ddb760f None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:08.218619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245db7d8-ca19-40af-b8c0-f64d2ddb760f None admin] RBAC: Adding query filter params (name=member) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:08.218619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245db7d8-ca19-40af-b8c0-f64d2ddb760f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:08.218619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245db7d8-ca19-40af-b8c0-f64d2ddb760f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:08.220180 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 68/132] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:08.220781 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245db7d8-ca19-40af-b8c0-f64d2ddb760f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:08.330984 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245db7d8-ca19-40af-b8c0-f64d2ddb760f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:08.341461 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 65/133] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:01:07 2022] PUT /identity/v3/projects/f157df588b834944b8799b6d43e8319a/users/33781cd02a6e417a9a09ee0ca6390d4d/roles/c1ddef32606649809bb218b686f472c5 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:01:08.342390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7406d0-9a2c-4578-8969-b279daf696f4 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:08.367156 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6479b52-2bf9-47e0-8386-aa986181017e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:08.368108 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6479b52-2bf9-47e0-8386-aa986181017e None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:08.368446 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6479b52-2bf9-47e0-8386-aa986181017e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:08.368723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6479b52-2bf9-47e0-8386-aa986181017e None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a/users/94be445c202a4e67aef3505af25af405/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:08.371506 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6479b52-2bf9-47e0-8386-aa986181017e None admin] RBAC: Authorizing `identity:create_grant(project_id=f157df588b834944b8799b6d43e8319a, user_id=94be445c202a4e67aef3505af25af405, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:08.373022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6479b52-2bf9-47e0-8386-aa986181017e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:08.476439 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 69/134] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:01:08 2022] PUT /identity/v3/projects/f157df588b834944b8799b6d43e8319a/users/94be445c202a4e67aef3505af25af405/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:01:08.500648 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7406d0-9a2c-4578-8969-b279daf696f4 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:08.530263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffab84c-8dcd-4d48-a59b-90c56606c97d None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:08.530589 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffab84c-8dcd-4d48-a59b-90c56606c97d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:08.530851 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffab84c-8dcd-4d48-a59b-90c56606c97d None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:08.532334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 70/135] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:01:08.540658 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c490-3ba3-4c95-9da7-bc29e57d1c0a None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:08.540981 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c490-3ba3-4c95-9da7-bc29e57d1c0a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:08.541263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c490-3ba3-4c95-9da7-bc29e57d1c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:08.567405 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-aab5c490-3ba3-4c95-9da7-bc29e57d1c0a None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:08.569098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-aab5c490-3ba3-4c95-9da7-bc29e57d1c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:08.576558 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1a5cc-a8a3-4973-bdea-c8c9dbf85101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:08.577553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a5cc-a8a3-4973-bdea-c8c9dbf85101 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:08.577838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a5cc-a8a3-4973-bdea-c8c9dbf85101 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:08.578126 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a5cc-a8a3-4973-bdea-c8c9dbf85101 None admin] PATH_INFO: `/v3/users/33781cd02a6e417a9a09ee0ca6390d4d` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:08.580287 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1a5cc-a8a3-4973-bdea-c8c9dbf85101 None admin] RBAC: Authorizing `identity:get_user(user_id=33781cd02a6e417a9a09ee0ca6390d4d)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:08.581755 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1a5cc-a8a3-4973-bdea-c8c9dbf85101 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:08.583649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 66/136] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:08 2022] GET /identity/v3/users/33781cd02a6e417a9a09ee0ca6390d4d => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:08.588806 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1a5cc-a8a3-4973-bdea-c8c9dbf85101 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:08.650066 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 71/137] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:01:08.681154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5c490-3ba3-4c95-9da7-bc29e57d1c0a None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:08.761745 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1a5cc-a8a3-4973-bdea-c8c9dbf85101 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:08.798689 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279b61a-0a00-40af-9be7-3c1af54d96be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:08.800319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279b61a-0a00-40af-9be7-3c1af54d96be None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:08.800810 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279b61a-0a00-40af-9be7-3c1af54d96be None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:08.801287 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279b61a-0a00-40af-9be7-3c1af54d96be None admin] PATH_INFO: `/v3/projects/cb009ef43b0245cc8813d685294ae36e` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:08.802868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279b61a-0a00-40af-9be7-3c1af54d96be None admin] RBAC: Authorizing `identity:get_project(project_id=cb009ef43b0245cc8813d685294ae36e)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:08.804563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279b61a-0a00-40af-9be7-3c1af54d96be None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:08.806866 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 67/138] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:08 2022] GET /identity/v3/projects/cb009ef43b0245cc8813d685294ae36e => generated 312 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:08.812177 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279b61a-0a00-40af-9be7-3c1af54d96be None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:08.829293 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5c490-3ba3-4c95-9da7-bc29e57d1c0a None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:08.895754 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2edfb8-4456-45de-aa93-0c5748663222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:08.896965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2edfb8-4456-45de-aa93-0c5748663222 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:08.897455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2edfb8-4456-45de-aa93-0c5748663222 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:08.897934 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2edfb8-4456-45de-aa93-0c5748663222 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:08.899363 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2edfb8-4456-45de-aa93-0c5748663222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:08.901073 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2edfb8-4456-45de-aa93-0c5748663222 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:08.903971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 72/139] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:08.930472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2edfb8-4456-45de-aa93-0c5748663222 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:08.965709 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279b61a-0a00-40af-9be7-3c1af54d96be None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:09.002558 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e30658-9e2f-4b56-bd13-b806058e6984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:09.003472 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e30658-9e2f-4b56-bd13-b806058e6984 None admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:09.003795 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e30658-9e2f-4b56-bd13-b806058e6984 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:09.004078 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e30658-9e2f-4b56-bd13-b806058e6984 None admin] PATH_INFO: `/v3/projects/cb009ef43b0245cc8813d685294ae36e/users/33781cd02a6e417a9a09ee0ca6390d4d/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:09.006098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e30658-9e2f-4b56-bd13-b806058e6984 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb009ef43b0245cc8813d685294ae36e, user_id=33781cd02a6e417a9a09ee0ca6390d4d, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:09.007629 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e30658-9e2f-4b56-bd13-b806058e6984 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:09.050999 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2edfb8-4456-45de-aa93-0c5748663222 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:09.087326 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567b7d5-a341-47c9-a340-7db9a37c1943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:09.088385 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567b7d5-a341-47c9-a340-7db9a37c1943 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:09.088876 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567b7d5-a341-47c9-a340-7db9a37c1943 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:09.089356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567b7d5-a341-47c9-a340-7db9a37c1943 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:09.090314 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567b7d5-a341-47c9-a340-7db9a37c1943 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:09.092002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567b7d5-a341-47c9-a340-7db9a37c1943 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:09.108805 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 68/140] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:01:08 2022] PUT /identity/v3/projects/cb009ef43b0245cc8813d685294ae36e/users/33781cd02a6e417a9a09ee0ca6390d4d/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:01:09.208733 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 73/141] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 10 21:01:08 2022] POST /identity/v3/users => generated 283 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:01:09.889744 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e42ea8-46bf-4e40-842d-da418fae2107 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:09.890074 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e42ea8-46bf-4e40-842d-da418fae2107 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:09.890316 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e42ea8-46bf-4e40-842d-da418fae2107 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:09.891856 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 69/142] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:09.897421 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96b7b2-4e0d-447d-9c94-1bab9d4f5a24 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:09.897973 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96b7b2-4e0d-447d-9c94-1bab9d4f5a24 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:09.898484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96b7b2-4e0d-447d-9c94-1bab9d4f5a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:09.916272 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6f96b7b2-4e0d-447d-9c94-1bab9d4f5a24 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:09.918326 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6f96b7b2-4e0d-447d-9c94-1bab9d4f5a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:09.992676 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 74/143] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:10.028402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e42ea8-46bf-4e40-842d-da418fae2107 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:10.149057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e42ea8-46bf-4e40-842d-da418fae2107 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:10.184159 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318490c-ac32-4aea-8677-1ca6d7661f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:10.184973 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318490c-ac32-4aea-8677-1ca6d7661f1f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:10.185258 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318490c-ac32-4aea-8677-1ca6d7661f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:10.185535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318490c-ac32-4aea-8677-1ca6d7661f1f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:10.196302 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318490c-ac32-4aea-8677-1ca6d7661f1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:10.204065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-a318490c-ac32-4aea-8677-1ca6d7661f1f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 21:01:10.204065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:10.204065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:10.204065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:10.204065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:10.204065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:10.204065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:10.204065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:10.204065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:10.204065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:10.204065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:10.204065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:10.204065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:10.204065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:10.204065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:10.204065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:10.204938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:10.204938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:10.204938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:10.204938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:10.204938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:10.204938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:10.204938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:10.204938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:10.204938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:10.204938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:10.204938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:10.204938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:10.204938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:10.204938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:10.204938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:10.204938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:10.205712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:10.205712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:10.205712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:10.205712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:10.205712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:10.205712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:10.205712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:10.205712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:10.205712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:10.205712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:10.205712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 21:01:10.205712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:10.205712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 70/144] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:10.212972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96b7b2-4e0d-447d-9c94-1bab9d4f5a24 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:10.318789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a4851-8dfd-4317-8360-b71468620c27 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:10.318789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a4851-8dfd-4317-8360-b71468620c27 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:10.318789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a4851-8dfd-4317-8360-b71468620c27 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:10.320112 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 71/145] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:10.325496 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84a204-8110-441c-a756-a9a72cb63fcd None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:10.325789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84a204-8110-441c-a756-a9a72cb63fcd None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:10.326088 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84a204-8110-441c-a756-a9a72cb63fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:10.330760 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96b7b2-4e0d-447d-9c94-1bab9d4f5a24 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:10.359514 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-9c84a204-8110-441c-a756-a9a72cb63fcd None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:10.360701 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-9c84a204-8110-441c-a756-a9a72cb63fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:10.375599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833caef3-ce0e-4f31-9429-b1f5ba9fddb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:10.376287 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833caef3-ce0e-4f31-9429-b1f5ba9fddb7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:10.376578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833caef3-ce0e-4f31-9429-b1f5ba9fddb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:10.376857 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833caef3-ce0e-4f31-9429-b1f5ba9fddb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:10.377627 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833caef3-ce0e-4f31-9429-b1f5ba9fddb7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:10.377937 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833caef3-ce0e-4f31-9429-b1f5ba9fddb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:10.379374 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833caef3-ce0e-4f31-9429-b1f5ba9fddb7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:10.398312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 75/146] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:10.410177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833caef3-ce0e-4f31-9429-b1f5ba9fddb7 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:10.516931 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 72/147] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:01:10.558652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833caef3-ce0e-4f31-9429-b1f5ba9fddb7 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:10.568634 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84a204-8110-441c-a756-a9a72cb63fcd None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:10.600532 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d0e57-9670-4bf6-a172-eda1147361fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:10.601720 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d0e57-9670-4bf6-a172-eda1147361fe None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:10.602188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d0e57-9670-4bf6-a172-eda1147361fe None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:10.602672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d0e57-9670-4bf6-a172-eda1147361fe None admin] PATH_INFO: `/v3/users/b1627d165b1f44de8c1843fb87bbaf7f` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:10.604604 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d0e57-9670-4bf6-a172-eda1147361fe None admin] RBAC: Authorizing `identity:get_user(user_id=b1627d165b1f44de8c1843fb87bbaf7f)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:10.607625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d0e57-9670-4bf6-a172-eda1147361fe None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:10.610359 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 76/148] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:10 2022] GET /identity/v3/users/b1627d165b1f44de8c1843fb87bbaf7f => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:10.618366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d0e57-9670-4bf6-a172-eda1147361fe None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:10.760038 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84a204-8110-441c-a756-a9a72cb63fcd None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:10.806119 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d0e57-9670-4bf6-a172-eda1147361fe None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:10.825286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa116ba3-1c1f-4c21-a9fc-dc3a4feab32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:10.826110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa116ba3-1c1f-4c21-a9fc-dc3a4feab32c None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:10.826398 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa116ba3-1c1f-4c21-a9fc-dc3a4feab32c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:10.826706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa116ba3-1c1f-4c21-a9fc-dc3a4feab32c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:10.850162 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa116ba3-1c1f-4c21-a9fc-dc3a4feab32c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:10.860864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-fa116ba3-1c1f-4c21-a9fc-dc3a4feab32c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:10.860864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:10.860864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:10.860864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:10.860864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:10.860864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:10.860864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:10.860864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:10.860864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:10.860864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:10.860864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:10.860864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:10.860864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:10.860864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:10.860864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:10.860864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:10.861776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:10.861776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:10.861776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:10.861776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:10.861776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:10.861776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:10.861776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:10.861776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:10.861776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:10.861776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:10.861776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:10.861776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:10.861776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:10.861776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:10.861776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:10.861776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:10.862585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:10.862585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:10.862585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:10.862585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:10.862585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:10.862585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:10.862585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:10.862585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:10.862585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:10.862585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:10.862585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:10.862585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:10.866072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 73/149] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:01:10.871691 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa116ba3-1c1f-4c21-a9fc-dc3a4feab32c None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:10.872617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de66377-1279-42b2-b7db-a4eb7613956a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:10.873608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de66377-1279-42b2-b7db-a4eb7613956a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:10.873939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de66377-1279-42b2-b7db-a4eb7613956a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:10.874297 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de66377-1279-42b2-b7db-a4eb7613956a None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:10.879240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de66377-1279-42b2-b7db-a4eb7613956a None admin] RBAC: Authorizing `identity:get_project(project_id=f157df588b834944b8799b6d43e8319a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:10.881646 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de66377-1279-42b2-b7db-a4eb7613956a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:10.889805 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 77/150] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:10 2022] GET /identity/v3/projects/f157df588b834944b8799b6d43e8319a => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:10.895243 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de66377-1279-42b2-b7db-a4eb7613956a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:11.026764 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa116ba3-1c1f-4c21-a9fc-dc3a4feab32c None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:11.056850 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de66377-1279-42b2-b7db-a4eb7613956a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:11.063307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bbb77-6a9a-4fa7-b23c-814d0ac2f308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:11.064585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bbb77-6a9a-4fa7-b23c-814d0ac2f308 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:11.065069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bbb77-6a9a-4fa7-b23c-814d0ac2f308 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:11.065541 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bbb77-6a9a-4fa7-b23c-814d0ac2f308 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:11.066517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bbb77-6a9a-4fa7-b23c-814d0ac2f308 None admin] RBAC: Adding query filter params (name=member) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:11.067148 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bbb77-6a9a-4fa7-b23c-814d0ac2f308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:11.068738 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bbb77-6a9a-4fa7-b23c-814d0ac2f308 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:11.077941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 74/151] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:11.084485 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bbb77-6a9a-4fa7-b23c-814d0ac2f308 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:11.117742 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae504f3-266b-4596-840a-673125458694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:11.118944 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae504f3-266b-4596-840a-673125458694 None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:11.119384 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae504f3-266b-4596-840a-673125458694 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:11.119802 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae504f3-266b-4596-840a-673125458694 None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a/users/b1627d165b1f44de8c1843fb87bbaf7f/roles/09fc23a294c748939513cefa3e91b27f` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:11.127837 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae504f3-266b-4596-840a-673125458694 None admin] RBAC: Authorizing `identity:create_grant(project_id=f157df588b834944b8799b6d43e8319a, user_id=b1627d165b1f44de8c1843fb87bbaf7f, role_id=09fc23a294c748939513cefa3e91b27f)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:11.129566 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae504f3-266b-4596-840a-673125458694 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:11.196401 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bbb77-6a9a-4fa7-b23c-814d0ac2f308 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:11.230402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b8101-21d4-4601-931d-c3bc31163006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:11.231323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b8101-21d4-4601-931d-c3bc31163006 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:11.231610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b8101-21d4-4601-931d-c3bc31163006 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:11.231888 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b8101-21d4-4601-931d-c3bc31163006 None admin] PATH_INFO: `/v3/users/33781cd02a6e417a9a09ee0ca6390d4d` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:11.233127 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b8101-21d4-4601-931d-c3bc31163006 None admin] RBAC: Authorizing `identity:get_user(user_id=33781cd02a6e417a9a09ee0ca6390d4d)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:11.234597 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b8101-21d4-4601-931d-c3bc31163006 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:11.236397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 75/152] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:11 2022] GET /identity/v3/users/33781cd02a6e417a9a09ee0ca6390d4d => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:11.242794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b8101-21d4-4601-931d-c3bc31163006 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:11.251383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 78/153] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:01:10 2022] PUT /identity/v3/projects/f157df588b834944b8799b6d43e8319a/users/b1627d165b1f44de8c1843fb87bbaf7f/roles/09fc23a294c748939513cefa3e91b27f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:01:11.353452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b8101-21d4-4601-931d-c3bc31163006 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:11.393694 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44766e-0902-4d70-8c6b-78602a6fa1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:11.394375 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44766e-0902-4d70-8c6b-78602a6fa1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:11.394687 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44766e-0902-4d70-8c6b-78602a6fa1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:11.394972 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44766e-0902-4d70-8c6b-78602a6fa1a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:11.479481 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44766e-0902-4d70-8c6b-78602a6fa1a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:11.481874 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44766e-0902-4d70-8c6b-78602a6fa1a7 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:11.602097 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 76/154] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 21:01:11.608263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae504f3-266b-4596-840a-673125458694 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:11.720365 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae504f3-266b-4596-840a-673125458694 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:11.755403 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82028867-86d0-44bd-8738-7d7494e457ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:11.756303 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82028867-86d0-44bd-8738-7d7494e457ad None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:11.756588 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82028867-86d0-44bd-8738-7d7494e457ad None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:11.756867 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82028867-86d0-44bd-8738-7d7494e457ad None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:11.758206 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82028867-86d0-44bd-8738-7d7494e457ad None admin] RBAC: Authorizing `identity:get_project(project_id=f157df588b834944b8799b6d43e8319a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:11.759755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82028867-86d0-44bd-8738-7d7494e457ad None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:11.762520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 79/155] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:11 2022] GET /identity/v3/projects/f157df588b834944b8799b6d43e8319a => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:11.771640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44766e-0902-4d70-8c6b-78602a6fa1a7 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:11.892201 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44766e-0902-4d70-8c6b-78602a6fa1a7 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:11.926910 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fbec5-a7eb-4654-9efc-5389515de39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:11.927576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fbec5-a7eb-4654-9efc-5389515de39a None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:11.927865 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fbec5-a7eb-4654-9efc-5389515de39a None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:11.928146 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fbec5-a7eb-4654-9efc-5389515de39a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:11.928990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fbec5-a7eb-4654-9efc-5389515de39a None admin] RBAC: Adding query filter params (role.id=390d715fbb0f4d029b222894fa3ac65b, scope.project.id=f157df588b834944b8799b6d43e8319a, user.id=33781cd02a6e417a9a09ee0ca6390d4d) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:11.929304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fbec5-a7eb-4654-9efc-5389515de39a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:11.930773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fbec5-a7eb-4654-9efc-5389515de39a None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:11.937598 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 77/156] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:01:11 2022] GET /identity/v3/role_assignments?user.id=33781cd02a6e417a9a09ee0ca6390d4d&scope.project.id=f157df588b834944b8799b6d43e8319a&role.id=390d715fbb0f4d029b222894fa3ac65b => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:12.208567 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87db045-f845-42d5-9021-b280837ca37a None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:12.208922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87db045-f845-42d5-9021-b280837ca37a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:12.209093 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87db045-f845-42d5-9021-b280837ca37a None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:12.210483 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 80/157] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:12.216282 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fc47c-83ba-4290-9dbf-dad894ce7707 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:12.216769 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fc47c-83ba-4290-9dbf-dad894ce7707 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:12.216874 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fc47c-83ba-4290-9dbf-dad894ce7707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:12.239508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-934fc47c-83ba-4290-9dbf-dad894ce7707 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:12.240712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-934fc47c-83ba-4290-9dbf-dad894ce7707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:12.319764 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 78/158] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:12.343694 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87db045-f845-42d5-9021-b280837ca37a None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:12.460504 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87db045-f845-42d5-9021-b280837ca37a None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:12.497953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00caa428-cf12-4aa6-9107-d90ccbf4393e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:12.498801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caa428-cf12-4aa6-9107-d90ccbf4393e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:12.499087 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caa428-cf12-4aa6-9107-d90ccbf4393e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:12.499358 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caa428-cf12-4aa6-9107-d90ccbf4393e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:12.510164 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00caa428-cf12-4aa6-9107-d90ccbf4393e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:12.518702 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-00caa428-cf12-4aa6-9107-d90ccbf4393e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:12.518702 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:12.518702 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:12.518702 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:12.518702 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:12.518702 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:12.518702 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:12.518702 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:12.518702 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:12.518702 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:12.518702 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:12.518702 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:12.518702 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:12.518702 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:12.518702 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:12.518702 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:12.521134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:12.521134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:12.521134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:12.521134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:12.521134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:12.521134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:12.521134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:12.521134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:12.521134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:12.521134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:12.521134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:12.521134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:12.521134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:12.521134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:12.521134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:12.521134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:12.523129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:12.523129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:12.523129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:12.523129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:12.523129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:12.523129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:12.523129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:12.523129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:12.523129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:12.523129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:12.523129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:12.523129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:12.523129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 81/159] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:01:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:12.530075 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fc47c-83ba-4290-9dbf-dad894ce7707 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:12.670546 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fc47c-83ba-4290-9dbf-dad894ce7707 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:12.718735 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e6538-e767-4b54-8013-1f074006ec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:12.719341 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e6538-e767-4b54-8013-1f074006ec9b None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:12.719630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e6538-e767-4b54-8013-1f074006ec9b None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:12.719910 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e6538-e767-4b54-8013-1f074006ec9b None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:12.720732 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e6538-e767-4b54-8013-1f074006ec9b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:12.721051 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e6538-e767-4b54-8013-1f074006ec9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:12.722502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e6538-e767-4b54-8013-1f074006ec9b None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:12.735256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 79/160] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:01:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:12.740988 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00caa428-cf12-4aa6-9107-d90ccbf4393e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:12.854311 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacf715-c2f1-4fd9-9684-8f0615121915 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:12.854632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacf715-c2f1-4fd9-9684-8f0615121915 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:12.855098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacf715-c2f1-4fd9-9684-8f0615121915 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:12.858471 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 80/161] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:12.868269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d13b2-17ed-4678-9365-d42eb5465d67 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:12.868561 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d13b2-17ed-4678-9365-d42eb5465d67 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:12.868840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d13b2-17ed-4678-9365-d42eb5465d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:12.873218 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00caa428-cf12-4aa6-9107-d90ccbf4393e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:12.906918 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-425d13b2-17ed-4678-9365-d42eb5465d67 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:12.908109 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-425d13b2-17ed-4678-9365-d42eb5465d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:12.916923 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eba979-53ee-4bc2-9dbf-a4000f359a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:12.918400 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eba979-53ee-4bc2-9dbf-a4000f359a7d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:12.918770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eba979-53ee-4bc2-9dbf-a4000f359a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:12.919012 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eba979-53ee-4bc2-9dbf-a4000f359a7d None admin] PATH_INFO: `/v3/users/33781cd02a6e417a9a09ee0ca6390d4d` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:12.920235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eba979-53ee-4bc2-9dbf-a4000f359a7d None admin] RBAC: Authorizing `identity:get_user(user_id=33781cd02a6e417a9a09ee0ca6390d4d)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:12.922115 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eba979-53ee-4bc2-9dbf-a4000f359a7d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:12.923970 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 82/162] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:12 2022] GET /identity/v3/users/33781cd02a6e417a9a09ee0ca6390d4d => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:12.930406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eba979-53ee-4bc2-9dbf-a4000f359a7d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:13.043922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eba979-53ee-4bc2-9dbf-a4000f359a7d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:13.068662 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 81/163] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:13.088047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509f811-956a-4ed6-ab07-c4954f3fbf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:13.088715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509f811-956a-4ed6-ab07-c4954f3fbf71 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:13.089004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509f811-956a-4ed6-ab07-c4954f3fbf71 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:13.089853 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509f811-956a-4ed6-ab07-c4954f3fbf71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:13.107003 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d13b2-17ed-4678-9365-d42eb5465d67 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:13.177837 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509f811-956a-4ed6-ab07-c4954f3fbf71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:13.179484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509f811-956a-4ed6-ab07-c4954f3fbf71 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:13.290071 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 83/164] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 21:01:13.316020 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509f811-956a-4ed6-ab07-c4954f3fbf71 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:13.349091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d13b2-17ed-4678-9365-d42eb5465d67 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:13.421573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155457fb-fbc0-4a80-8717-f4d33ff119bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:13.423111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155457fb-fbc0-4a80-8717-f4d33ff119bd None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:13.423399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155457fb-fbc0-4a80-8717-f4d33ff119bd None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:13.423893 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155457fb-fbc0-4a80-8717-f4d33ff119bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:13.437400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155457fb-fbc0-4a80-8717-f4d33ff119bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:13.446226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-155457fb-fbc0-4a80-8717-f4d33ff119bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:01:13.446226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:13.446226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:13.446226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:13.446226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:13.446226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:13.446226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:13.446226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:13.446226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:13.446226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:13.446226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:13.446226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:13.446226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:13.446226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:13.446226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:13.446226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:13.447205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:13.447205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:13.447205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:13.447205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:13.447205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:13.447205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:13.447205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:13.447205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:13.447205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:13.447205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:13.447205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:13.447205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:13.447205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:13.447205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:13.447205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:13.447205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:13.447999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:13.447999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:13.447999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:13.447999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:13.447999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:13.447999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:13.447999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:13.447999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:13.447999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:13.447999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:13.447999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:01:13.447999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:13.447999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 82/165] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:01:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:13.455870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155457fb-fbc0-4a80-8717-f4d33ff119bd None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:13.554053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509f811-956a-4ed6-ab07-c4954f3fbf71 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:13.567591 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155457fb-fbc0-4a80-8717-f4d33ff119bd None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:13.610011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92603d1-0410-4cf7-88ec-55b99d1d0fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:13.610710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92603d1-0410-4cf7-88ec-55b99d1d0fea None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:13.610991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92603d1-0410-4cf7-88ec-55b99d1d0fea None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:13.611266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92603d1-0410-4cf7-88ec-55b99d1d0fea None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:13.612018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92603d1-0410-4cf7-88ec-55b99d1d0fea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:13.612323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92603d1-0410-4cf7-88ec-55b99d1d0fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:13.613710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92603d1-0410-4cf7-88ec-55b99d1d0fea None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:13.639376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f000b0-c615-4eee-8402-e45cf3d2342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:13.640254 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f000b0-c615-4eee-8402-e45cf3d2342f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:13.640537 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f000b0-c615-4eee-8402-e45cf3d2342f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:13.640813 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f000b0-c615-4eee-8402-e45cf3d2342f None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:13.642234 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 83/166] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:13.642927 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f000b0-c615-4eee-8402-e45cf3d2342f None admin] RBAC: Authorizing `identity:get_project(project_id=f157df588b834944b8799b6d43e8319a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:13.644370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f000b0-c615-4eee-8402-e45cf3d2342f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:13.646313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 84/167] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:13 2022] GET /identity/v3/projects/f157df588b834944b8799b6d43e8319a => generated 298 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:13.651706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92603d1-0410-4cf7-88ec-55b99d1d0fea None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:13.652945 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f000b0-c615-4eee-8402-e45cf3d2342f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:13.873281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92603d1-0410-4cf7-88ec-55b99d1d0fea None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:13.890203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f000b0-c615-4eee-8402-e45cf3d2342f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:13.948356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e7fdc-4312-4aa4-a811-adfc575ce058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:13.949539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e7fdc-4312-4aa4-a811-adfc575ce058 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:13.950054 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e7fdc-4312-4aa4-a811-adfc575ce058 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:13.950551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e7fdc-4312-4aa4-a811-adfc575ce058 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:13.951622 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e7fdc-4312-4aa4-a811-adfc575ce058 None admin] RBAC: Adding query filter params (role.id=c1ddef32606649809bb218b686f472c5, scope.project.id=f157df588b834944b8799b6d43e8319a, user.id=33781cd02a6e417a9a09ee0ca6390d4d) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:13.952132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e7fdc-4312-4aa4-a811-adfc575ce058 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:13.953791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e7fdc-4312-4aa4-a811-adfc575ce058 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:13.972551 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54872f-fa8c-4821-8ffb-d89c228c1845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:13.973047 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 84/168] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:01:13 2022] GET /identity/v3/role_assignments?user.id=33781cd02a6e417a9a09ee0ca6390d4d&scope.project.id=f157df588b834944b8799b6d43e8319a&role.id=c1ddef32606649809bb218b686f472c5 => generated 608 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:13.973508 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54872f-fa8c-4821-8ffb-d89c228c1845 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:13.973797 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54872f-fa8c-4821-8ffb-d89c228c1845 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:13.974127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54872f-fa8c-4821-8ffb-d89c228c1845 None admin] PATH_INFO: `/v3/users/94be445c202a4e67aef3505af25af405` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:13.975250 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb45645-cdac-4873-8a50-46b6b2704049 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:13.975738 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb45645-cdac-4873-8a50-46b6b2704049 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:13.976215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb45645-cdac-4873-8a50-46b6b2704049 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:13.977694 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 85/169] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:13.982498 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54872f-fa8c-4821-8ffb-d89c228c1845 None admin] RBAC: Authorizing `identity:get_user(user_id=94be445c202a4e67aef3505af25af405)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:13.982498 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54872f-fa8c-4821-8ffb-d89c228c1845 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:13.982498 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 85/170] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:13 2022] GET /identity/v3/users/94be445c202a4e67aef3505af25af405 => generated 247 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:13.985280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c45d10-fdf0-40a0-9bcc-d9e748e63d68 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:13.985776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c45d10-fdf0-40a0-9bcc-d9e748e63d68 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:13.986253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c45d10-fdf0-40a0-9bcc-d9e748e63d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:13.990464 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54872f-fa8c-4821-8ffb-d89c228c1845 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:14.028185 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-32c45d10-fdf0-40a0-9bcc-d9e748e63d68 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:14.029915 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-32c45d10-fdf0-40a0-9bcc-d9e748e63d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:14.180758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 86/171] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:14.195429 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54872f-fa8c-4821-8ffb-d89c228c1845 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:14.223675 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c45d10-fdf0-40a0-9bcc-d9e748e63d68 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:14.246931 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0b888-eaf0-445c-8967-8b5471cf2082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:14.247612 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0b888-eaf0-445c-8967-8b5471cf2082 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:14.247903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0b888-eaf0-445c-8967-8b5471cf2082 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:14.248188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0b888-eaf0-445c-8967-8b5471cf2082 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:14.358749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0b888-eaf0-445c-8967-8b5471cf2082 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:14.360855 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0b888-eaf0-445c-8967-8b5471cf2082 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:14.406257 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c45d10-fdf0-40a0-9bcc-d9e748e63d68 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:14.447552 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e079357-9597-41ca-a235-4f078d87f5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:14.448760 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e079357-9597-41ca-a235-4f078d87f5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:14.449261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e079357-9597-41ca-a235-4f078d87f5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:14.449829 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e079357-9597-41ca-a235-4f078d87f5f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:14.462603 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e079357-9597-41ca-a235-4f078d87f5f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:14.472348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-5e079357-9597-41ca-a235-4f078d87f5f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:14.472348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:14.472348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:14.472348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:14.472348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:14.472348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:14.472348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:14.472348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:14.472348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:14.472348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:14.472348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:14.472348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:14.472348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:14.472348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:14.472348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:14.472348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:14.473483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:14.473483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:14.473483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:14.473483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:14.473483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:14.473483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:14.473483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:14.473483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:14.473483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:14.473483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:14.473483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:14.473483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:14.473483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:14.473483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:14.473483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:14.473483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:14.474794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:14.474794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:14.474794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:14.474794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:14.474794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:14.474794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:14.474794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:14.474794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:14.474794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:14.474794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:14.474794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:14.474794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:14.477598 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 87/172] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:01:14.480627 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522c04f-86e0-41f5-9d1e-98a8faccf95f None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:14.481113 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522c04f-86e0-41f5-9d1e-98a8faccf95f None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:14.481608 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522c04f-86e0-41f5-9d1e-98a8faccf95f None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:14.483313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 88/173] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:14.484309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522c04f-86e0-41f5-9d1e-98a8faccf95f None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:14.486597 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 86/174] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 21:01:14.490689 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0b888-eaf0-445c-8967-8b5471cf2082 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:14.610739 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0b888-eaf0-445c-8967-8b5471cf2082 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:14.624854 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522c04f-86e0-41f5-9d1e-98a8faccf95f None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:14.646752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c3e30-36b1-4e38-a0d5-5fa8793e75b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:14.647926 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c3e30-36b1-4e38-a0d5-5fa8793e75b6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:14.648408 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c3e30-36b1-4e38-a0d5-5fa8793e75b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:14.648877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c3e30-36b1-4e38-a0d5-5fa8793e75b6 None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:14.650335 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c3e30-36b1-4e38-a0d5-5fa8793e75b6 None admin] RBAC: Authorizing `identity:get_project(project_id=f157df588b834944b8799b6d43e8319a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:14.652246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c3e30-36b1-4e38-a0d5-5fa8793e75b6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:14.654564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 87/175] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:14 2022] GET /identity/v3/projects/f157df588b834944b8799b6d43e8319a => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:14.655907 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1455cc-0b9f-445f-8962-10189caa8ce1 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:14.656396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1455cc-0b9f-445f-8962-10189caa8ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:14.656886 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1455cc-0b9f-445f-8962-10189caa8ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:14.665660 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784e10f-81a7-466d-8d22-c5a31db41de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:14.666349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784e10f-81a7-466d-8d22-c5a31db41de0 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:14.666667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784e10f-81a7-466d-8d22-c5a31db41de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:14.666950 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784e10f-81a7-466d-8d22-c5a31db41de0 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:14.668731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784e10f-81a7-466d-8d22-c5a31db41de0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:14.668856 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784e10f-81a7-466d-8d22-c5a31db41de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:14.670188 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784e10f-81a7-466d-8d22-c5a31db41de0 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:14.679474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 89/176] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:14.680311 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784e10f-81a7-466d-8d22-c5a31db41de0 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:14.680813 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-4d1455cc-0b9f-445f-8962-10189caa8ce1 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:14.682366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4d1455cc-0b9f-445f-8962-10189caa8ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:14.752902 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 88/177] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:14.754145 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1455cc-0b9f-445f-8962-10189caa8ce1 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:14.796314 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784e10f-81a7-466d-8d22-c5a31db41de0 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:14.829885 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67352662-036b-4c61-a887-2cd2c6cd645f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:14.830580 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67352662-036b-4c61-a887-2cd2c6cd645f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:14.830870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67352662-036b-4c61-a887-2cd2c6cd645f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:14.831151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67352662-036b-4c61-a887-2cd2c6cd645f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:14.831984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67352662-036b-4c61-a887-2cd2c6cd645f None admin] RBAC: Adding query filter params (role.id=5cd001edc58744738aa57180c0be68a9, scope.project.id=f157df588b834944b8799b6d43e8319a, user.id=94be445c202a4e67aef3505af25af405) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:14.832303 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67352662-036b-4c61-a887-2cd2c6cd645f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:14.833733 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67352662-036b-4c61-a887-2cd2c6cd645f None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:14.841361 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 90/178] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:01:14 2022] GET /identity/v3/role_assignments?user.id=94be445c202a4e67aef3505af25af405&scope.project.id=f157df588b834944b8799b6d43e8319a&role.id=5cd001edc58744738aa57180c0be68a9 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:14.841499 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe399312-d214-4a9b-8978-ff933fa64945 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:14.841735 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe399312-d214-4a9b-8978-ff933fa64945 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:14.842016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe399312-d214-4a9b-8978-ff933fa64945 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:14.847513 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 91/179] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:14.848531 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe399312-d214-4a9b-8978-ff933fa64945 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:14.869712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1455cc-0b9f-445f-8962-10189caa8ce1 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:14.920506 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d25e4-86c8-4c9d-9d71-fba11adc36e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:14.921872 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d25e4-86c8-4c9d-9d71-fba11adc36e7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:14.922727 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d25e4-86c8-4c9d-9d71-fba11adc36e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:14.923157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d25e4-86c8-4c9d-9d71-fba11adc36e7 None admin] PATH_INFO: `/v3/users/33781cd02a6e417a9a09ee0ca6390d4d` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:14.925365 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d25e4-86c8-4c9d-9d71-fba11adc36e7 None admin] RBAC: Authorizing `identity:get_user(user_id=33781cd02a6e417a9a09ee0ca6390d4d)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:14.927786 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d25e4-86c8-4c9d-9d71-fba11adc36e7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:14.929907 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 89/180] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:14 2022] GET /identity/v3/users/33781cd02a6e417a9a09ee0ca6390d4d => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:14.932073 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2808e-5a98-4734-998f-7ebd150f5508 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:14.932539 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2808e-5a98-4734-998f-7ebd150f5508 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:14.933056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2808e-5a98-4734-998f-7ebd150f5508 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:14.939115 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 90/181] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:14.941226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef368a4-5554-4a60-9924-9fa08513ac36 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:14.941356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef368a4-5554-4a60-9924-9fa08513ac36 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:14.941563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef368a4-5554-4a60-9924-9fa08513ac36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:14.959393 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-cef368a4-5554-4a60-9924-9fa08513ac36 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:14.960631 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-cef368a4-5554-4a60-9924-9fa08513ac36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:14.983094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe399312-d214-4a9b-8978-ff933fa64945 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:15.028941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74c928-2bbf-4b2e-b23a-c63aa78cee88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:15.030335 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74c928-2bbf-4b2e-b23a-c63aa78cee88 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:15.031096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74c928-2bbf-4b2e-b23a-c63aa78cee88 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:15.031867 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74c928-2bbf-4b2e-b23a-c63aa78cee88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:15.039056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 91/182] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:15.040098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef368a4-5554-4a60-9924-9fa08513ac36 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:15.047041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74c928-2bbf-4b2e-b23a-c63aa78cee88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:15.056520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-2b74c928-2bbf-4b2e-b23a-c63aa78cee88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:01:15.056520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:15.056520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:15.056520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:15.056520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:15.056520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:15.056520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:15.056520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:15.056520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:15.056520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:15.056520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:15.056520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:15.056520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:15.056520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:15.056520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:15.056520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:15.057423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:15.057423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:15.057423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:15.057423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:15.057423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:15.057423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:15.057423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:15.057423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:15.057423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:15.057423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:15.057423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:15.057423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:15.057423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:15.057423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:15.057423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:15.057423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:15.058302 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:15.058302 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:15.058302 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:15.058302 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:15.058302 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:15.058302 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:15.058302 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:15.058302 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:15.058302 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:15.058302 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:15.058302 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:01:15.058302 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:15.060118 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 92/183] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:01:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:15.061196 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b59bd4-f5e6-43b9-b1ac-2fb1d52d14bc None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:15.061510 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b59bd4-f5e6-43b9-b1ac-2fb1d52d14bc None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:15.061784 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b59bd4-f5e6-43b9-b1ac-2fb1d52d14bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:15.079523 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-46b59bd4-f5e6-43b9-b1ac-2fb1d52d14bc None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:15.080709 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-46b59bd4-f5e6-43b9-b1ac-2fb1d52d14bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:15.164304 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef368a4-5554-4a60-9924-9fa08513ac36 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:15.169181 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 93/184] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:15.169890 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b59bd4-f5e6-43b9-b1ac-2fb1d52d14bc None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:15.205271 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a297e9b-7c3c-4346-b772-9dbf227a35c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:15.207109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a297e9b-7c3c-4346-b772-9dbf227a35c3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:15.207551 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a297e9b-7c3c-4346-b772-9dbf227a35c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:15.207973 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a297e9b-7c3c-4346-b772-9dbf227a35c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:15.271419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b59bd4-f5e6-43b9-b1ac-2fb1d52d14bc None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:15.278253 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a297e9b-7c3c-4346-b772-9dbf227a35c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:15.279816 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a297e9b-7c3c-4346-b772-9dbf227a35c3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:15.305656 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b9e88-6330-4fed-8006-56c1a90a1446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:15.306332 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9e88-6330-4fed-8006-56c1a90a1446 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:15.306646 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9e88-6330-4fed-8006-56c1a90a1446 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:15.306931 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9e88-6330-4fed-8006-56c1a90a1446 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:15.307686 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b9e88-6330-4fed-8006-56c1a90a1446 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:15.308026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b9e88-6330-4fed-8006-56c1a90a1446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:15.309496 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b9e88-6330-4fed-8006-56c1a90a1446 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:15.321724 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 94/185] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:15.321724 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b9e88-6330-4fed-8006-56c1a90a1446 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:15.375555 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 92/186] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:15.380847 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a297e9b-7c3c-4346-b772-9dbf227a35c3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:15.420357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b9e88-6330-4fed-8006-56c1a90a1446 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:15.455564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c5c76-43c3-4f4f-a5bb-1f0e44fcb5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:15.456389 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c5c76-43c3-4f4f-a5bb-1f0e44fcb5bb None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:15.456677 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c5c76-43c3-4f4f-a5bb-1f0e44fcb5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:15.456959 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c5c76-43c3-4f4f-a5bb-1f0e44fcb5bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:15.458259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c5c76-43c3-4f4f-a5bb-1f0e44fcb5bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:15.459783 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c5c76-43c3-4f4f-a5bb-1f0e44fcb5bb None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:15.461499 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 95/187] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:15.461499 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c5c76-43c3-4f4f-a5bb-1f0e44fcb5bb None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:15.489034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a297e9b-7c3c-4346-b772-9dbf227a35c3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:15.522465 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9daabd-d00f-4dae-ae00-43ebb51cca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:15.523280 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9daabd-d00f-4dae-ae00-43ebb51cca02 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:15.523566 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9daabd-d00f-4dae-ae00-43ebb51cca02 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:15.523847 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9daabd-d00f-4dae-ae00-43ebb51cca02 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:15.534384 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9daabd-d00f-4dae-ae00-43ebb51cca02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:15.542715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-5a9daabd-d00f-4dae-ae00-43ebb51cca02 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:15.542715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:15.542715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:15.542715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:15.542715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:15.542715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:15.542715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:15.542715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:15.542715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:15.542715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:15.542715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:15.542715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:15.542715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:15.542715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:15.542715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:15.542715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:15.543633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:15.543633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:15.543633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:15.543633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:15.543633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:15.543633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:15.543633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:15.543633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:15.543633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:15.543633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:15.543633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:15.543633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:15.543633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:15.543633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:15.543633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:15.543633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:15.544455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:15.544455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:15.544455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:15.544455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:15.544455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:15.544455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:15.544455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:15.544455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:15.544455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:15.544455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:15.544455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:15.544455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:15.544455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 93/188] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:01:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:15.545107 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9daabd-d00f-4dae-ae00-43ebb51cca02 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:15.566262 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c5c76-43c3-4f4f-a5bb-1f0e44fcb5bb None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:15.599508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40b949-e310-4fbd-b048-c3edf770f167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:15.600449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40b949-e310-4fbd-b048-c3edf770f167 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:15.600737 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40b949-e310-4fbd-b048-c3edf770f167 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:15.601010 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40b949-e310-4fbd-b048-c3edf770f167 None admin] PATH_INFO: `/v3/users/f2b12f24b2f14af8baff832a876310ba` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:15.617747 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40b949-e310-4fbd-b048-c3edf770f167 None admin] RBAC: Authorizing `identity:get_user(user_id=f2b12f24b2f14af8baff832a876310ba)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:15.619237 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40b949-e310-4fbd-b048-c3edf770f167 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:15.621735 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 96/189] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:15 2022] GET /identity/v3/users/f2b12f24b2f14af8baff832a876310ba => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:15.623282 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40b949-e310-4fbd-b048-c3edf770f167 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:15.657698 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9daabd-d00f-4dae-ae00-43ebb51cca02 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:15.689706 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a199fc-bbdb-4020-b1ee-4051df1f33ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:15.690611 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a199fc-bbdb-4020-b1ee-4051df1f33ee None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:15.690898 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a199fc-bbdb-4020-b1ee-4051df1f33ee None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:15.691175 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a199fc-bbdb-4020-b1ee-4051df1f33ee None admin] PATH_INFO: `/v3/projects/cb009ef43b0245cc8813d685294ae36e` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:15.692377 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a199fc-bbdb-4020-b1ee-4051df1f33ee None admin] RBAC: Authorizing `identity:get_project(project_id=cb009ef43b0245cc8813d685294ae36e)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:15.693814 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a199fc-bbdb-4020-b1ee-4051df1f33ee None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:15.695525 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 94/190] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:15 2022] GET /identity/v3/projects/cb009ef43b0245cc8813d685294ae36e => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:15.696280 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a199fc-bbdb-4020-b1ee-4051df1f33ee None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:15.721434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40b949-e310-4fbd-b048-c3edf770f167 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:15.754229 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f39cb-7ed2-48fa-81f9-0cf09b038fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:15.754927 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f39cb-7ed2-48fa-81f9-0cf09b038fa1 None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:15.755213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f39cb-7ed2-48fa-81f9-0cf09b038fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:15.755491 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f39cb-7ed2-48fa-81f9-0cf09b038fa1 None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:15.756196 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f39cb-7ed2-48fa-81f9-0cf09b038fa1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:15.757625 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f39cb-7ed2-48fa-81f9-0cf09b038fa1 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:15.789677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a199fc-bbdb-4020-b1ee-4051df1f33ee None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:15.823190 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0a078-b5c4-4134-a03a-3f118f94a270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:15.824947 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0a078-b5c4-4134-a03a-3f118f94a270 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:15.825237 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0a078-b5c4-4134-a03a-3f118f94a270 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:15.825515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0a078-b5c4-4134-a03a-3f118f94a270 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:15.826264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0a078-b5c4-4134-a03a-3f118f94a270 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:15.828173 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0a078-b5c4-4134-a03a-3f118f94a270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:15.828173 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0a078-b5c4-4134-a03a-3f118f94a270 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:15.835420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 95/191] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:01:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:15.836269 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0a078-b5c4-4134-a03a-3f118f94a270 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:15.881595 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 97/192] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 10 21:01:15 2022] POST /identity/v3/users => generated 297 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:01:15.882945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbd20e-eda6-4c8d-ac33-8575ca3181e6 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:15.883244 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbd20e-eda6-4c8d-ac33-8575ca3181e6 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:15.883527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbd20e-eda6-4c8d-ac33-8575ca3181e6 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:15.885001 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 98/193] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:15.885759 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbd20e-eda6-4c8d-ac33-8575ca3181e6 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:15.947684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0a078-b5c4-4134-a03a-3f118f94a270 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:15.983411 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e9d65-d2a6-4cbf-b09e-82aecc3b2983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:15.984082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e9d65-d2a6-4cbf-b09e-82aecc3b2983 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:15.984376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e9d65-d2a6-4cbf-b09e-82aecc3b2983 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:15.984654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e9d65-d2a6-4cbf-b09e-82aecc3b2983 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:16.003966 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbd20e-eda6-4c8d-ac33-8575ca3181e6 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:16.040834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa04ca-25d6-4801-ba69-adf1e011154b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:16.041469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa04ca-25d6-4801-ba69-adf1e011154b None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:16.041754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa04ca-25d6-4801-ba69-adf1e011154b None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:16.042027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa04ca-25d6-4801-ba69-adf1e011154b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:16.043640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa04ca-25d6-4801-ba69-adf1e011154b None admin] RBAC: Adding query filter params (role.id=390d715fbb0f4d029b222894fa3ac65b, scope.project.id=cb009ef43b0245cc8813d685294ae36e, user.id=33781cd02a6e417a9a09ee0ca6390d4d) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:16.043950 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa04ca-25d6-4801-ba69-adf1e011154b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:16.045420 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa04ca-25d6-4801-ba69-adf1e011154b None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:16.062466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 99/194] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:01:15 2022] GET /identity/v3/role_assignments?user.id=33781cd02a6e417a9a09ee0ca6390d4d&scope.project.id=cb009ef43b0245cc8813d685294ae36e&role.id=390d715fbb0f4d029b222894fa3ac65b => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:16.062466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa04ca-25d6-4801-ba69-adf1e011154b None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:16.066579 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e9d65-d2a6-4cbf-b09e-82aecc3b2983 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:16.068091 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e9d65-d2a6-4cbf-b09e-82aecc3b2983 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:16.177663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa04ca-25d6-4801-ba69-adf1e011154b None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:16.192544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 96/195] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:16.193888 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1120c-bc3b-4b84-96e9-c7b201b07927 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:16.194174 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1120c-bc3b-4b84-96e9-c7b201b07927 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:16.194461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1120c-bc3b-4b84-96e9-c7b201b07927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:16.211931 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-abb1120c-bc3b-4b84-96e9-c7b201b07927 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:16.213180 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-abb1120c-bc3b-4b84-96e9-c7b201b07927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:16.214979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d9543-f0a4-421b-8fbf-a213bcdc6c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:16.215902 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d9543-f0a4-421b-8fbf-a213bcdc6c1e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:16.216186 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d9543-f0a4-421b-8fbf-a213bcdc6c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:16.216460 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d9543-f0a4-421b-8fbf-a213bcdc6c1e None admin] PATH_INFO: `/v3/users/f2b12f24b2f14af8baff832a876310ba` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:16.217825 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d9543-f0a4-421b-8fbf-a213bcdc6c1e None admin] RBAC: Authorizing `identity:get_user(user_id=f2b12f24b2f14af8baff832a876310ba)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:16.219323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d9543-f0a4-421b-8fbf-a213bcdc6c1e None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:16.221258 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 100/196] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:16 2022] GET /identity/v3/users/f2b12f24b2f14af8baff832a876310ba => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:16.221866 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d9543-f0a4-421b-8fbf-a213bcdc6c1e None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:16.288181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 97/197] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:16.295433 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1120c-bc3b-4b84-96e9-c7b201b07927 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:16.338086 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d9543-f0a4-421b-8fbf-a213bcdc6c1e None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:16.377649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939cf1c-7e74-44a8-9e56-780d782c9c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:16.378616 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939cf1c-7e74-44a8-9e56-780d782c9c78 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:16.378908 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939cf1c-7e74-44a8-9e56-780d782c9c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:16.379188 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939cf1c-7e74-44a8-9e56-780d782c9c78 None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:16.380481 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939cf1c-7e74-44a8-9e56-780d782c9c78 None admin] RBAC: Authorizing `identity:get_project(project_id=5149a355272344e6928de24fc5261d16)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:16.381938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939cf1c-7e74-44a8-9e56-780d782c9c78 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:16.384056 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 101/198] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:16 2022] GET /identity/v3/projects/5149a355272344e6928de24fc5261d16 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:16.384890 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939cf1c-7e74-44a8-9e56-780d782c9c78 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:16.396826 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1120c-bc3b-4b84-96e9-c7b201b07927 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:16.432311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb18fe3-fdf4-4ed8-8f8a-d0f6ee134145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:16.433030 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb18fe3-fdf4-4ed8-8f8a-d0f6ee134145 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:16.433312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb18fe3-fdf4-4ed8-8f8a-d0f6ee134145 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:16.433588 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb18fe3-fdf4-4ed8-8f8a-d0f6ee134145 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:16.500927 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939cf1c-7e74-44a8-9e56-780d782c9c78 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:16.501750 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb18fe3-fdf4-4ed8-8f8a-d0f6ee134145 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:16.503249 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb18fe3-fdf4-4ed8-8f8a-d0f6ee134145 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:16.536170 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68ba1a-fdd7-4eb6-a905-1db847951972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:16.537269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68ba1a-fdd7-4eb6-a905-1db847951972 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:16.537759 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68ba1a-fdd7-4eb6-a905-1db847951972 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:16.538211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68ba1a-fdd7-4eb6-a905-1db847951972 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:16.549658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68ba1a-fdd7-4eb6-a905-1db847951972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:16.557998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-af68ba1a-fdd7-4eb6-a905-1db847951972 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 21:01:16.557998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:16.557998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:16.557998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:16.557998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:16.557998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:16.557998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:16.557998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:16.557998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:16.557998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:16.557998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:16.557998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:16.557998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:16.557998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:16.557998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:16.557998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:16.558949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:16.558949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:16.558949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:16.558949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:16.558949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:16.558949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:16.558949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:16.558949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:16.558949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:16.558949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:16.558949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:16.558949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:16.558949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:16.558949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:16.558949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:16.558949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:16.559758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:16.559758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:16.559758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:16.559758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:16.559758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:16.559758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:16.559758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:16.559758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:16.559758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:16.559758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:16.559758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 21:01:16.559758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:16.562134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 102/199] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:16.563283 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68ba1a-fdd7-4eb6-a905-1db847951972 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:16.607917 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 98/200] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:16.608843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb18fe3-fdf4-4ed8-8f8a-d0f6ee134145 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:16.667638 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68ba1a-fdd7-4eb6-a905-1db847951972 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:16.701481 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf64d1c-e813-4cd2-b209-3e1aa999c8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:16.702143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf64d1c-e813-4cd2-b209-3e1aa999c8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:16.702422 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf64d1c-e813-4cd2-b209-3e1aa999c8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:16.702724 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf64d1c-e813-4cd2-b209-3e1aa999c8f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:16.703562 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf64d1c-e813-4cd2-b209-3e1aa999c8f3 None admin] RBAC: Adding query filter params (role.id=5cd001edc58744738aa57180c0be68a9, scope.project.id=5149a355272344e6928de24fc5261d16, user.id=f2b12f24b2f14af8baff832a876310ba) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:16.703874 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf64d1c-e813-4cd2-b209-3e1aa999c8f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:16.705326 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf64d1c-e813-4cd2-b209-3e1aa999c8f3 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:16.711139 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 103/201] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:01:16 2022] GET /identity/v3/role_assignments?user.id=f2b12f24b2f14af8baff832a876310ba&scope.project.id=5149a355272344e6928de24fc5261d16&role.id=5cd001edc58744738aa57180c0be68a9 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:16.711925 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf64d1c-e813-4cd2-b209-3e1aa999c8f3 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:16.716759 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb18fe3-fdf4-4ed8-8f8a-d0f6ee134145 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:16.762713 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fe27c-8acc-43bd-bfbc-97dda4664446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:16.763398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fe27c-8acc-43bd-bfbc-97dda4664446 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:16.763682 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fe27c-8acc-43bd-bfbc-97dda4664446 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:16.763959 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fe27c-8acc-43bd-bfbc-97dda4664446 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:16.764716 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fe27c-8acc-43bd-bfbc-97dda4664446 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:16.765021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fe27c-8acc-43bd-bfbc-97dda4664446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:16.766403 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fe27c-8acc-43bd-bfbc-97dda4664446 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:16.782467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 99/202] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:16.790790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fe27c-8acc-43bd-bfbc-97dda4664446 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:16.815245 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf64d1c-e813-4cd2-b209-3e1aa999c8f3 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:16.857561 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc2b89-1703-4f6b-b3ef-9b8e6b6925de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:16.858474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc2b89-1703-4f6b-b3ef-9b8e6b6925de None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:16.858752 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc2b89-1703-4f6b-b3ef-9b8e6b6925de None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:16.859023 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc2b89-1703-4f6b-b3ef-9b8e6b6925de None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:16.860350 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc2b89-1703-4f6b-b3ef-9b8e6b6925de None admin] RBAC: Authorizing `identity:get_project(project_id=5149a355272344e6928de24fc5261d16)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:16.861822 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc2b89-1703-4f6b-b3ef-9b8e6b6925de None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:16.863685 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 104/203] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:16 2022] GET /identity/v3/projects/5149a355272344e6928de24fc5261d16 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:16.869441 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc2b89-1703-4f6b-b3ef-9b8e6b6925de None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:16.950826 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fe27c-8acc-43bd-bfbc-97dda4664446 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:16.989952 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc2b89-1703-4f6b-b3ef-9b8e6b6925de None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:17.031972 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7f306-df81-4762-9714-07e76974bf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:17.032868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7f306-df81-4762-9714-07e76974bf44 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:17.033154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7f306-df81-4762-9714-07e76974bf44 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:17.033427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7f306-df81-4762-9714-07e76974bf44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:17.034277 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7f306-df81-4762-9714-07e76974bf44 None admin] RBAC: Adding query filter params (role.id=c1ddef32606649809bb218b686f472c5, scope.project.id=5149a355272344e6928de24fc5261d16, user.id=f2b12f24b2f14af8baff832a876310ba) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:17.034620 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7f306-df81-4762-9714-07e76974bf44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:17.036193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7f306-df81-4762-9714-07e76974bf44 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:17.041485 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478f750-f84d-4733-8c41-aa64f0e59425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:17.043010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478f750-f84d-4733-8c41-aa64f0e59425 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:17.043181 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 105/204] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:01:16 2022] GET /identity/v3/role_assignments?user.id=f2b12f24b2f14af8baff832a876310ba&scope.project.id=5149a355272344e6928de24fc5261d16&role.id=c1ddef32606649809bb218b686f472c5 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:17.043348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478f750-f84d-4733-8c41-aa64f0e59425 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:17.043635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478f750-f84d-4733-8c41-aa64f0e59425 None admin] PATH_INFO: `/v3/users/b1627d165b1f44de8c1843fb87bbaf7f` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:17.044994 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478f750-f84d-4733-8c41-aa64f0e59425 None admin] RBAC: Authorizing `identity:get_user(user_id=b1627d165b1f44de8c1843fb87bbaf7f)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:17.046471 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478f750-f84d-4733-8c41-aa64f0e59425 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:17.048350 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 100/205] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:16 2022] GET /identity/v3/users/b1627d165b1f44de8c1843fb87bbaf7f => generated 289 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:17.054490 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7f306-df81-4762-9714-07e76974bf44 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:17.161464 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7f306-df81-4762-9714-07e76974bf44 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:17.198218 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452eff8-2286-4c68-944d-6fbeae74cb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:17.199496 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452eff8-2286-4c68-944d-6fbeae74cb9f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:17.199941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452eff8-2286-4c68-944d-6fbeae74cb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:17.200220 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452eff8-2286-4c68-944d-6fbeae74cb9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:17.274359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452eff8-2286-4c68-944d-6fbeae74cb9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:17.275871 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452eff8-2286-4c68-944d-6fbeae74cb9f None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:17.375077 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 106/206] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:17.384032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478f750-f84d-4733-8c41-aa64f0e59425 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:17.484390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478f750-f84d-4733-8c41-aa64f0e59425 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:17.521951 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a103c0-a3ee-49e1-99d5-c88e7046b68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:17.523206 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a103c0-a3ee-49e1-99d5-c88e7046b68b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:17.523742 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a103c0-a3ee-49e1-99d5-c88e7046b68b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:17.524232 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a103c0-a3ee-49e1-99d5-c88e7046b68b None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:17.525646 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a103c0-a3ee-49e1-99d5-c88e7046b68b None admin] RBAC: Authorizing `identity:get_project(project_id=f157df588b834944b8799b6d43e8319a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:17.527356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a103c0-a3ee-49e1-99d5-c88e7046b68b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:17.529561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 101/207] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:17 2022] GET /identity/v3/projects/f157df588b834944b8799b6d43e8319a => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:17.535567 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452eff8-2286-4c68-944d-6fbeae74cb9f None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:17.635669 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452eff8-2286-4c68-944d-6fbeae74cb9f None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:17.674217 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041b601-be4c-4db6-808b-9a3e581d654d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:17.674911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041b601-be4c-4db6-808b-9a3e581d654d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:17.675191 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041b601-be4c-4db6-808b-9a3e581d654d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:17.675463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041b601-be4c-4db6-808b-9a3e581d654d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:17.676299 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041b601-be4c-4db6-808b-9a3e581d654d None admin] RBAC: Adding query filter params (role.id=09fc23a294c748939513cefa3e91b27f, scope.project.id=f157df588b834944b8799b6d43e8319a, user.id=b1627d165b1f44de8c1843fb87bbaf7f) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:17.676605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041b601-be4c-4db6-808b-9a3e581d654d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:17.678096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041b601-be4c-4db6-808b-9a3e581d654d None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:17.685357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 107/208] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:01:17 2022] GET /identity/v3/role_assignments?user.id=b1627d165b1f44de8c1843fb87bbaf7f&scope.project.id=f157df588b834944b8799b6d43e8319a&role.id=09fc23a294c748939513cefa3e91b27f => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:18.637272 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a4adb-b396-4954-a38b-afa7eb5c65b9 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:18.637785 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a4adb-b396-4954-a38b-afa7eb5c65b9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:18.637861 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a4adb-b396-4954-a38b-afa7eb5c65b9 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:18.639549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 102/209] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:18.645126 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc7325-b02e-45e7-b740-fa30db81766e None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:18.645545 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc7325-b02e-45e7-b740-fa30db81766e None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:18.645737 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc7325-b02e-45e7-b740-fa30db81766e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:18.662762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-1bbc7325-b02e-45e7-b740-fa30db81766e None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:18.663951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-1bbc7325-b02e-45e7-b740-fa30db81766e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:18.716258 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e743cd-00c5-4edd-9378-37cfb5f9cbfc None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:18.716548 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e743cd-00c5-4edd-9378-37cfb5f9cbfc None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:18.716997 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e743cd-00c5-4edd-9378-37cfb5f9cbfc None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:18.718756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 103/210] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:18.724057 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52838003-de19-47fc-9892-c1318fca904e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:18.724589 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52838003-de19-47fc-9892-c1318fca904e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:18.725110 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52838003-de19-47fc-9892-c1318fca904e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:18.732827 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 108/211] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:18.742276 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-52838003-de19-47fc-9892-c1318fca904e None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:18.743752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-52838003-de19-47fc-9892-c1318fca904e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:18.757890 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc7325-b02e-45e7-b740-fa30db81766e None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:18.813207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 104/212] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:01:18.841040 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52838003-de19-47fc-9892-c1318fca904e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:18.868011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc7325-b02e-45e7-b740-fa30db81766e None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:18.906612 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae98b1-3b91-4a5e-8d19-4158531bb542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:18.907720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae98b1-3b91-4a5e-8d19-4158531bb542 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:18.908144 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae98b1-3b91-4a5e-8d19-4158531bb542 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:18.908557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae98b1-3b91-4a5e-8d19-4158531bb542 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:18.919668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae98b1-3b91-4a5e-8d19-4158531bb542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:18.927844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-8dae98b1-3b91-4a5e-8d19-4158531bb542 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:18.927844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:18.927844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:18.927844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:18.927844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:18.927844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:18.927844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:18.927844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:18.927844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:18.927844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:18.927844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:18.927844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:18.927844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:18.927844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:18.927844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:18.927844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:18.928884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:18.928884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:18.928884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:18.928884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:18.928884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:18.928884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:18.928884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:18.928884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:18.928884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:18.928884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:18.928884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:18.928884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:18.928884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:18.928884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:18.928884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:18.928884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:18.929711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:18.929711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:18.929711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:18.929711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:18.929711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:18.929711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:18.929711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:18.929711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:18.929711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:18.929711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:18.929711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:18.929711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:18.932080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 109/213] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:01:18.938512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae98b1-3b91-4a5e-8d19-4158531bb542 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:18.955451 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52838003-de19-47fc-9892-c1318fca904e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:18.989322 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ecec8-963a-4d72-bcc2-34ce0eb4eb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:18.990580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ecec8-963a-4d72-bcc2-34ce0eb4eb85 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:18.991063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ecec8-963a-4d72-bcc2-34ce0eb4eb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:18.991531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ecec8-963a-4d72-bcc2-34ce0eb4eb85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:18.992886 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ecec8-963a-4d72-bcc2-34ce0eb4eb85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:18.994532 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ecec8-963a-4d72-bcc2-34ce0eb4eb85 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:18.997025 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 105/214] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:19.002429 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ecec8-963a-4d72-bcc2-34ce0eb4eb85 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:19.045071 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae98b1-3b91-4a5e-8d19-4158531bb542 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:19.079139 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1244af3-bc45-4807-ad90-1e9e086d579e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:19.079817 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1244af3-bc45-4807-ad90-1e9e086d579e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:19.080105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1244af3-bc45-4807-ad90-1e9e086d579e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:19.080385 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1244af3-bc45-4807-ad90-1e9e086d579e None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:19.081280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1244af3-bc45-4807-ad90-1e9e086d579e None admin] RBAC: Adding query filter params (name=member) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:19.081453 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1244af3-bc45-4807-ad90-1e9e086d579e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:19.082953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1244af3-bc45-4807-ad90-1e9e086d579e None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:19.091198 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 110/215] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:19.096805 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1244af3-bc45-4807-ad90-1e9e086d579e None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:19.105970 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ecec8-963a-4d72-bcc2-34ce0eb4eb85 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:19.143296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a7a04-85a3-4729-97b4-2773cf8b582c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:19.144370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a7a04-85a3-4729-97b4-2773cf8b582c None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:19.144881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a7a04-85a3-4729-97b4-2773cf8b582c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:19.145356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a7a04-85a3-4729-97b4-2773cf8b582c None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:19.146309 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a7a04-85a3-4729-97b4-2773cf8b582c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:19.148098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a7a04-85a3-4729-97b4-2773cf8b582c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:19.201367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1244af3-bc45-4807-ad90-1e9e086d579e None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:19.234694 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e235d-e770-4103-a058-706c50a89c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:19.235648 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e235d-e770-4103-a058-706c50a89c80 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:19.235936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e235d-e770-4103-a058-706c50a89c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:19.236215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e235d-e770-4103-a058-706c50a89c80 None admin] PATH_INFO: `/v3/users/e49982f144764b61b0e794b9a89ecd61` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:19.250421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e235d-e770-4103-a058-706c50a89c80 None admin] RBAC: Authorizing `identity:get_user(user_id=e49982f144764b61b0e794b9a89ecd61)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:19.251904 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e235d-e770-4103-a058-706c50a89c80 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:19.253606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 111/216] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:19 2022] GET /identity/v3/users/e49982f144764b61b0e794b9a89ecd61 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:19.259013 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e235d-e770-4103-a058-706c50a89c80 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:19.265033 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 106/217] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 10 21:01:19 2022] POST /identity/v3/users => generated 297 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:01:19.324470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fceaeb-3a7d-4c4e-bdcf-213ad8c279fe None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:19.324761 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fceaeb-3a7d-4c4e-bdcf-213ad8c279fe None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:19.325045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fceaeb-3a7d-4c4e-bdcf-213ad8c279fe None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:19.330327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 107/218] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:01:19.332557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fc421-40cc-40c9-8813-d572480cf7ca None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:19.333070 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fc421-40cc-40c9-8813-d572480cf7ca None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:19.333572 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fc421-40cc-40c9-8813-d572480cf7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:19.356319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-5f1fc421-40cc-40c9-8813-d572480cf7ca None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:19.358806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5f1fc421-40cc-40c9-8813-d572480cf7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:19.377013 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e235d-e770-4103-a058-706c50a89c80 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:19.413552 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e2390-8de5-419b-ae4a-19240b30228f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:19.414240 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e2390-8de5-419b-ae4a-19240b30228f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:19.414567 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e2390-8de5-419b-ae4a-19240b30228f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:19.414846 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e2390-8de5-419b-ae4a-19240b30228f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:19.462552 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 108/219] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:01:19.483704 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fc421-40cc-40c9-8813-d572480cf7ca None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:19.498075 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e2390-8de5-419b-ae4a-19240b30228f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:19.499626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e2390-8de5-419b-ae4a-19240b30228f None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:19.614145 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fc421-40cc-40c9-8813-d572480cf7ca None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:19.636438 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 112/220] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 21:01:19.641813 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e2390-8de5-419b-ae4a-19240b30228f None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:19.655857 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b0df0-ee89-4899-a6cd-ae881213d4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:19.656663 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b0df0-ee89-4899-a6cd-ae881213d4fe None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:19.656948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b0df0-ee89-4899-a6cd-ae881213d4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:19.657375 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b0df0-ee89-4899-a6cd-ae881213d4fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:19.671274 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b0df0-ee89-4899-a6cd-ae881213d4fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:19.680435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-108b0df0-ee89-4899-a6cd-ae881213d4fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:01:19.680435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:19.680435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:19.680435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:19.680435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:19.680435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:19.680435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:19.680435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:19.680435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:19.680435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:19.680435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:19.680435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:19.680435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:19.680435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:19.680435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:19.680435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:19.681333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:19.681333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:19.681333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:19.681333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:19.681333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:19.681333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:19.681333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:19.681333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:19.681333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:19.681333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:19.681333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:19.681333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:19.681333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:19.681333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:19.681333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:19.681333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:19.682147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:19.682147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:19.682147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:19.682147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:19.682147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:19.682147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:19.682147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:19.682147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:19.682147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:19.682147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:19.682147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:01:19.682147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:19.682147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 109/221] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:01:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:01:19.687504 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b0df0-ee89-4899-a6cd-ae881213d4fe None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:19.754075 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e2390-8de5-419b-ae4a-19240b30228f None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:19.792495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d8d07-f4eb-44fd-8f82-2dd2bf8c38f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:19.793151 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b0df0-ee89-4899-a6cd-ae881213d4fe None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:19.793372 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d8d07-f4eb-44fd-8f82-2dd2bf8c38f6 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:19.793652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d8d07-f4eb-44fd-8f82-2dd2bf8c38f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:19.793927 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d8d07-f4eb-44fd-8f82-2dd2bf8c38f6 None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:19.796096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d8d07-f4eb-44fd-8f82-2dd2bf8c38f6 None admin] RBAC: Authorizing `identity:get_project(project_id=5149a355272344e6928de24fc5261d16)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:19.797595 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d8d07-f4eb-44fd-8f82-2dd2bf8c38f6 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:19.799941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 113/222] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:19 2022] GET /identity/v3/projects/5149a355272344e6928de24fc5261d16 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:19.801659 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c1f50-9417-4193-96d2-3139a67ae556 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:19.801947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c1f50-9417-4193-96d2-3139a67ae556 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:19.802596 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c1f50-9417-4193-96d2-3139a67ae556 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:19.804407 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 114/223] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:19.809404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c1f50-9417-4193-96d2-3139a67ae556 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:19.835157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb8501-62d6-48f0-a5d1-9b10f23a5f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:19.835844 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb8501-62d6-48f0-a5d1-9b10f23a5f04 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:19.836332 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb8501-62d6-48f0-a5d1-9b10f23a5f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:19.836618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb8501-62d6-48f0-a5d1-9b10f23a5f04 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:19.838117 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb8501-62d6-48f0-a5d1-9b10f23a5f04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:19.838456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb8501-62d6-48f0-a5d1-9b10f23a5f04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:19.842424 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb8501-62d6-48f0-a5d1-9b10f23a5f04 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:19.853777 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 110/224] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:19.854922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cfbce-8d95-49af-8575-7d1bfe1ece94 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:19.855207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cfbce-8d95-49af-8575-7d1bfe1ece94 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:19.855487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cfbce-8d95-49af-8575-7d1bfe1ece94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:19.874367 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-068cfbce-8d95-49af-8575-7d1bfe1ece94 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:19.875568 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-068cfbce-8d95-49af-8575-7d1bfe1ece94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:19.933715 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c1f50-9417-4193-96d2-3139a67ae556 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:19.943888 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 111/225] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:19.945306 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cfbce-8d95-49af-8575-7d1bfe1ece94 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:19.993244 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24775c35-1802-413f-bf50-389e94800b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:19.993899 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24775c35-1802-413f-bf50-389e94800b61 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:19.994179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24775c35-1802-413f-bf50-389e94800b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:19.994463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24775c35-1802-413f-bf50-389e94800b61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:19.996094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24775c35-1802-413f-bf50-389e94800b61 None admin] RBAC: Adding query filter params (role.id=390d715fbb0f4d029b222894fa3ac65b, scope.project.id=5149a355272344e6928de24fc5261d16, user.id=e49982f144764b61b0e794b9a89ecd61) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:19.996407 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24775c35-1802-413f-bf50-389e94800b61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:19.997839 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24775c35-1802-413f-bf50-389e94800b61 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:20.003852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 115/226] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:01:19 2022] GET /identity/v3/role_assignments?user.id=e49982f144764b61b0e794b9a89ecd61&scope.project.id=5149a355272344e6928de24fc5261d16&role.id=390d715fbb0f4d029b222894fa3ac65b => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:20.004577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24775c35-1802-413f-bf50-389e94800b61 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:20.074693 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cfbce-8d95-49af-8575-7d1bfe1ece94 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:20.135157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70021a-e8a0-4ce2-938d-bc4072a0e674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:20.136286 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70021a-e8a0-4ce2-938d-bc4072a0e674 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:20.136569 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70021a-e8a0-4ce2-938d-bc4072a0e674 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:20.136843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70021a-e8a0-4ce2-938d-bc4072a0e674 None admin] PATH_INFO: `/v3/users/f2b12f24b2f14af8baff832a876310ba` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:20.138928 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70021a-e8a0-4ce2-938d-bc4072a0e674 None admin] RBAC: Authorizing `identity:get_user(user_id=f2b12f24b2f14af8baff832a876310ba)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:20.140462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70021a-e8a0-4ce2-938d-bc4072a0e674 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:20.143548 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 112/227] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:19 2022] GET /identity/v3/users/f2b12f24b2f14af8baff832a876310ba => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:20.147487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70021a-e8a0-4ce2-938d-bc4072a0e674 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:20.149660 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24775c35-1802-413f-bf50-389e94800b61 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:20.217850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b5c6c-3932-4191-806b-ef4d0fa3f9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:20.218761 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b5c6c-3932-4191-806b-ef4d0fa3f9db None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:20.219046 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b5c6c-3932-4191-806b-ef4d0fa3f9db None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:20.219323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b5c6c-3932-4191-806b-ef4d0fa3f9db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:20.232736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b5c6c-3932-4191-806b-ef4d0fa3f9db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:20.242110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-0a2b5c6c-3932-4191-806b-ef4d0fa3f9db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:20.242110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:20.242110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:20.242110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:20.242110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:20.242110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:20.242110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:20.242110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:20.242110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:20.242110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:20.242110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:20.242110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:20.242110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:20.242110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:20.242110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:20.242110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:20.243087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:20.243087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:20.243087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:20.243087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:20.243087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:20.243087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:20.243087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:20.243087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:20.243087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:20.243087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:20.243087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:20.243087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:20.243087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:20.243087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:20.243087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:20.243087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:20.243883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:20.243883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:20.243883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:20.243883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:20.243883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:20.243883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:20.243883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:20.243883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:20.243883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:20.243883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:20.243883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:20.243883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:20.243883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 116/228] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:01:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:20.252798 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b5c6c-3932-4191-806b-ef4d0fa3f9db None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:20.321489 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70021a-e8a0-4ce2-938d-bc4072a0e674 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:20.366378 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7784fe-d67e-4efd-946d-7fb175bd5e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:20.369810 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7784fe-d67e-4efd-946d-7fb175bd5e21 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:20.369810 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7784fe-d67e-4efd-946d-7fb175bd5e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:20.369810 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7784fe-d67e-4efd-946d-7fb175bd5e21 None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:20.370669 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7784fe-d67e-4efd-946d-7fb175bd5e21 None admin] RBAC: Authorizing `identity:get_project(project_id=5149a355272344e6928de24fc5261d16)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:20.372083 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7784fe-d67e-4efd-946d-7fb175bd5e21 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:20.373817 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 113/229] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:20 2022] GET /identity/v3/projects/5149a355272344e6928de24fc5261d16 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:20.380570 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7784fe-d67e-4efd-946d-7fb175bd5e21 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:20.399588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b5c6c-3932-4191-806b-ef4d0fa3f9db None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:20.497535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10bc13-9a8e-48bf-98f0-081c8bd7951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:20.498209 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10bc13-9a8e-48bf-98f0-081c8bd7951e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:20.498514 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10bc13-9a8e-48bf-98f0-081c8bd7951e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:20.498794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10bc13-9a8e-48bf-98f0-081c8bd7951e None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:20.499544 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10bc13-9a8e-48bf-98f0-081c8bd7951e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:20.499848 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10bc13-9a8e-48bf-98f0-081c8bd7951e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:20.501218 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10bc13-9a8e-48bf-98f0-081c8bd7951e None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:20.526462 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 117/230] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:01:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:20.527338 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10bc13-9a8e-48bf-98f0-081c8bd7951e None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:20.579258 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7784fe-d67e-4efd-946d-7fb175bd5e21 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:20.622123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0cbba-ea4e-48bc-b0d8-bd4ba68a2663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:20.623041 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0cbba-ea4e-48bc-b0d8-bd4ba68a2663 None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:20.623320 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0cbba-ea4e-48bc-b0d8-bd4ba68a2663 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:20.623593 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0cbba-ea4e-48bc-b0d8-bd4ba68a2663 None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16/users/f2b12f24b2f14af8baff832a876310ba/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:20.629418 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0cbba-ea4e-48bc-b0d8-bd4ba68a2663 None admin] RBAC: Authorizing `identity:create_grant(project_id=5149a355272344e6928de24fc5261d16, user_id=f2b12f24b2f14af8baff832a876310ba, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:20.630985 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0cbba-ea4e-48bc-b0d8-bd4ba68a2663 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:20.683981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10bc13-9a8e-48bf-98f0-081c8bd7951e None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:20.718416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195a6b9-f19e-4756-a427-ecd8aaed314a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:20.719390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195a6b9-f19e-4756-a427-ecd8aaed314a None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:20.719681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195a6b9-f19e-4756-a427-ecd8aaed314a None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:20.719969 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195a6b9-f19e-4756-a427-ecd8aaed314a None admin] PATH_INFO: `/v3/users/f2b12f24b2f14af8baff832a876310ba` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:20.721401 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195a6b9-f19e-4756-a427-ecd8aaed314a None admin] RBAC: Authorizing `identity:get_user(user_id=f2b12f24b2f14af8baff832a876310ba)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:20.723062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195a6b9-f19e-4756-a427-ecd8aaed314a None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:20.725289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 118/231] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:20 2022] GET /identity/v3/users/f2b12f24b2f14af8baff832a876310ba => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:20.730276 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 114/232] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:01:20 2022] PUT /identity/v3/projects/5149a355272344e6928de24fc5261d16/users/f2b12f24b2f14af8baff832a876310ba/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:01:20.731509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195a6b9-f19e-4756-a427-ecd8aaed314a None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:20.849156 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195a6b9-f19e-4756-a427-ecd8aaed314a None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:20.909338 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96227c9f-75e4-48dd-a19c-06d6198af99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:20.910496 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96227c9f-75e4-48dd-a19c-06d6198af99d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:20.910936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96227c9f-75e4-48dd-a19c-06d6198af99d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:20.911390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96227c9f-75e4-48dd-a19c-06d6198af99d None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:20.912855 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96227c9f-75e4-48dd-a19c-06d6198af99d None admin] RBAC: Authorizing `identity:get_project(project_id=5149a355272344e6928de24fc5261d16)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:20.914543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96227c9f-75e4-48dd-a19c-06d6198af99d None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:20.916478 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 119/233] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:20 2022] GET /identity/v3/projects/5149a355272344e6928de24fc5261d16 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:20.922564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0cbba-ea4e-48bc-b0d8-bd4ba68a2663 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:21.051588 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0cbba-ea4e-48bc-b0d8-bd4ba68a2663 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:21.086228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa77dd-b21b-4cf3-9d86-df882335d66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:21.087150 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa77dd-b21b-4cf3-9d86-df882335d66d None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:21.087430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa77dd-b21b-4cf3-9d86-df882335d66d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:21.087705 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa77dd-b21b-4cf3-9d86-df882335d66d None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16/users/f2b12f24b2f14af8baff832a876310ba/roles/c1ddef32606649809bb218b686f472c5` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:21.089995 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa77dd-b21b-4cf3-9d86-df882335d66d None admin] RBAC: Authorizing `identity:create_grant(project_id=5149a355272344e6928de24fc5261d16, user_id=f2b12f24b2f14af8baff832a876310ba, role_id=c1ddef32606649809bb218b686f472c5)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:21.091574 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa77dd-b21b-4cf3-9d86-df882335d66d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:21.202471 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 115/234] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:01:20 2022] PUT /identity/v3/projects/5149a355272344e6928de24fc5261d16/users/f2b12f24b2f14af8baff832a876310ba/roles/c1ddef32606649809bb218b686f472c5 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:01:22.240097 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843101cf-25ec-44e9-a505-2df7e07dc750 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:22.241513 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843101cf-25ec-44e9-a505-2df7e07dc750 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:22.242291 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843101cf-25ec-44e9-a505-2df7e07dc750 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:22.245070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 120/235] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:22.250385 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b21da9-b85a-4b99-a3d9-4f34a89464db None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:22.250842 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b21da9-b85a-4b99-a3d9-4f34a89464db None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:22.250954 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b21da9-b85a-4b99-a3d9-4f34a89464db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:22.274682 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-77b21da9-b85a-4b99-a3d9-4f34a89464db None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:22.275892 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-77b21da9-b85a-4b99-a3d9-4f34a89464db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:22.329915 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322cd61-d4fc-4bbb-a3f1-f1f7d2f83e71 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:22.334464 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322cd61-d4fc-4bbb-a3f1-f1f7d2f83e71 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:22.334464 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322cd61-d4fc-4bbb-a3f1-f1f7d2f83e71 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:22.334464 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 121/236] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:22.336958 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898845c-ef0b-4821-b188-518e13aef193 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:22.337329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898845c-ef0b-4821-b188-518e13aef193 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:22.337686 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898845c-ef0b-4821-b188-518e13aef193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:22.366127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 116/237] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:22.367174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-3898845c-ef0b-4821-b188-518e13aef193 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:22.368366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-3898845c-ef0b-4821-b188-518e13aef193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:22.389749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b21da9-b85a-4b99-a3d9-4f34a89464db None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:22.495817 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b21da9-b85a-4b99-a3d9-4f34a89464db None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:22.502659 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 122/238] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:22.509511 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81971d42-a018-4af5-9220-3ff752975951 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:22.509813 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81971d42-a018-4af5-9220-3ff752975951 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:22.510095 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81971d42-a018-4af5-9220-3ff752975951 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:22.511718 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 123/239] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:22.516665 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c8802-c457-4097-81d0-4faacccbebc2 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:22.516955 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c8802-c457-4097-81d0-4faacccbebc2 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:22.517238 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c8802-c457-4097-81d0-4faacccbebc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:22.536501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15705d7-8a45-4949-bff6-a96c3cc1a83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:22.537617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15705d7-8a45-4949-bff6-a96c3cc1a83f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:22.537910 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15705d7-8a45-4949-bff6-a96c3cc1a83f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:22.538193 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15705d7-8a45-4949-bff6-a96c3cc1a83f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:22.539445 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15705d7-8a45-4949-bff6-a96c3cc1a83f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:22.541003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15705d7-8a45-4949-bff6-a96c3cc1a83f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:22.541200 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-199c8802-c457-4097-81d0-4faacccbebc2 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:22.542980 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-199c8802-c457-4097-81d0-4faacccbebc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:22.543237 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 117/240] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:22.543992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15705d7-8a45-4949-bff6-a96c3cc1a83f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:22.612004 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 124/241] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:01:22.612689 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c8802-c457-4097-81d0-4faacccbebc2 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:22.643363 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15705d7-8a45-4949-bff6-a96c3cc1a83f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:22.676863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4de6d-8761-4f70-a4f8-24523daaf30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:22.677658 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4de6d-8761-4f70-a4f8-24523daaf30c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:22.677938 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4de6d-8761-4f70-a4f8-24523daaf30c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:22.678205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4de6d-8761-4f70-a4f8-24523daaf30c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:22.690868 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4de6d-8761-4f70-a4f8-24523daaf30c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:22.700700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-cdb4de6d-8761-4f70-a4f8-24523daaf30c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 21:01:22.700700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:22.700700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:22.700700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:22.700700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:22.700700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:22.700700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:22.700700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:22.700700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:22.700700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:22.700700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:22.700700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:22.700700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:22.700700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:22.700700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:22.700700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:22.703234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:22.703234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:22.703234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:22.703234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:22.703234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:22.703234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:22.703234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:22.703234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:22.703234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:22.703234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:22.703234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:22.703234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:22.703234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:22.703234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:22.703234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:22.703234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:22.704111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:22.704111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:22.704111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:22.704111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:22.704111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:22.704111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:22.704111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:22.704111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:22.704111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:22.704111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:22.704111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 21:01:22.704111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:22.704111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 118/242] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:22.704111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4de6d-8761-4f70-a4f8-24523daaf30c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:22.718185 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c8802-c457-4097-81d0-4faacccbebc2 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:22.753700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dca2b-6b26-4c9d-94d2-193ce6fbfd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:22.754332 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dca2b-6b26-4c9d-94d2-193ce6fbfd6c None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:22.754646 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dca2b-6b26-4c9d-94d2-193ce6fbfd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:22.754922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dca2b-6b26-4c9d-94d2-193ce6fbfd6c None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:22.755640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12dca2b-6b26-4c9d-94d2-193ce6fbfd6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:22.757154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12dca2b-6b26-4c9d-94d2-193ce6fbfd6c None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:22.819869 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4de6d-8761-4f70-a4f8-24523daaf30c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:22.858846 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 125/243] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 10 21:01:22 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:01:22.858846 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dca2b-6b26-4c9d-94d2-193ce6fbfd6c None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:22.878714 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38820ed1-cbf0-476f-9317-4aff15d52897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:22.879857 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38820ed1-cbf0-476f-9317-4aff15d52897 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:22.880292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38820ed1-cbf0-476f-9317-4aff15d52897 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:22.880719 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38820ed1-cbf0-476f-9317-4aff15d52897 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:22.904346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38820ed1-cbf0-476f-9317-4aff15d52897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:22.927312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-38820ed1-cbf0-476f-9317-4aff15d52897 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:22.927312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:22.927312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:22.927312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:22.927312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:22.927312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:22.927312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:22.927312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:22.927312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:22.927312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:22.927312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:22.927312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:22.927312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:22.927312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:22.927312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:22.927312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:22.928327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:22.928327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:22.928327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:22.928327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:22.928327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:22.928327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:22.928327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:22.928327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:22.928327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:22.928327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:22.928327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:22.928327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:22.928327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:22.928327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:22.928327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:22.928327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:22.929197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:22.929197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:22.929197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:22.929197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:22.929197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:22.929197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:22.929197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:22.929197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:22.929197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:22.929197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:22.929197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:22.929197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:22.929197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 119/244] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:22.936311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38820ed1-cbf0-476f-9317-4aff15d52897 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:23.011654 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dca2b-6b26-4c9d-94d2-193ce6fbfd6c None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:23.050198 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78b7c9-4b8e-46e6-8ef4-4cfebb468e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:23.051258 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78b7c9-4b8e-46e6-8ef4-4cfebb468e9a None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:23.051716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78b7c9-4b8e-46e6-8ef4-4cfebb468e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:23.052137 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78b7c9-4b8e-46e6-8ef4-4cfebb468e9a None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:23.053065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78b7c9-4b8e-46e6-8ef4-4cfebb468e9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:23.053518 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78b7c9-4b8e-46e6-8ef4-4cfebb468e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:23.055086 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78b7c9-4b8e-46e6-8ef4-4cfebb468e9a None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:23.065296 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 126/245] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:23.071551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78b7c9-4b8e-46e6-8ef4-4cfebb468e9a None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:23.153914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38820ed1-cbf0-476f-9317-4aff15d52897 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:23.187357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78b7c9-4b8e-46e6-8ef4-4cfebb468e9a None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:23.199676 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35152b23-3eb6-4299-8b3b-801de71d5b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:23.200693 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35152b23-3eb6-4299-8b3b-801de71d5b7b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:23.201302 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35152b23-3eb6-4299-8b3b-801de71d5b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:23.202177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35152b23-3eb6-4299-8b3b-801de71d5b7b None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:23.203482 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35152b23-3eb6-4299-8b3b-801de71d5b7b None admin] RBAC: Adding query filter params (name=member) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:23.203977 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35152b23-3eb6-4299-8b3b-801de71d5b7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:23.205732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35152b23-3eb6-4299-8b3b-801de71d5b7b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:23.217534 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 120/246] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:23.223691 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35152b23-3eb6-4299-8b3b-801de71d5b7b None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:23.224832 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbb4b3-a40a-4461-b809-266335b15eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:23.225848 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbb4b3-a40a-4461-b809-266335b15eeb None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:23.226208 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbb4b3-a40a-4461-b809-266335b15eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:23.226587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbb4b3-a40a-4461-b809-266335b15eeb None admin] PATH_INFO: `/v3/users/a36cffa213414288b2d86b9badee16ed` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:23.240865 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbb4b3-a40a-4461-b809-266335b15eeb None admin] RBAC: Authorizing `identity:get_user(user_id=a36cffa213414288b2d86b9badee16ed)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:23.242530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbb4b3-a40a-4461-b809-266335b15eeb None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:23.245338 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 127/247] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:23 2022] GET /identity/v3/users/a36cffa213414288b2d86b9badee16ed => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:23.253102 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbb4b3-a40a-4461-b809-266335b15eeb None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:23.367054 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35152b23-3eb6-4299-8b3b-801de71d5b7b None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:23.397884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbb4b3-a40a-4461-b809-266335b15eeb None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:23.422663 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa52070-c1b1-421b-a574-3eb719ffeabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:23.424475 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa52070-c1b1-421b-a574-3eb719ffeabf None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:23.424871 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa52070-c1b1-421b-a574-3eb719ffeabf None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:23.425277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa52070-c1b1-421b-a574-3eb719ffeabf None admin] PATH_INFO: `/v3/users/e49982f144764b61b0e794b9a89ecd61` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:23.426950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa52070-c1b1-421b-a574-3eb719ffeabf None admin] RBAC: Authorizing `identity:get_user(user_id=e49982f144764b61b0e794b9a89ecd61)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:23.429392 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa52070-c1b1-421b-a574-3eb719ffeabf None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:23.431699 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 121/248] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:23 2022] GET /identity/v3/users/e49982f144764b61b0e794b9a89ecd61 => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:23.438734 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa52070-c1b1-421b-a574-3eb719ffeabf None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:23.459834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e1e21-873c-442b-b812-b6c23c1b9c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:23.460500 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e1e21-873c-442b-b812-b6c23c1b9c0a None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:23.460782 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e1e21-873c-442b-b812-b6c23c1b9c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:23.461057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e1e21-873c-442b-b812-b6c23c1b9c0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:23.565955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa52070-c1b1-421b-a574-3eb719ffeabf None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:23.567694 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e1e21-873c-442b-b812-b6c23c1b9c0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:23.570277 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e1e21-873c-442b-b812-b6c23c1b9c0a None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:23.609485 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4981ce-9ce4-4863-a0b1-43c0f7d57f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:23.610877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4981ce-9ce4-4863-a0b1-43c0f7d57f49 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:23.611312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4981ce-9ce4-4863-a0b1-43c0f7d57f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:23.611759 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4981ce-9ce4-4863-a0b1-43c0f7d57f49 None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:23.614162 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4981ce-9ce4-4863-a0b1-43c0f7d57f49 None admin] RBAC: Authorizing `identity:get_project(project_id=5149a355272344e6928de24fc5261d16)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:23.615787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4981ce-9ce4-4863-a0b1-43c0f7d57f49 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:23.618058 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 122/249] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:23 2022] GET /identity/v3/projects/5149a355272344e6928de24fc5261d16 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:23.619564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5477f-be93-4bcf-8f84-ae5858d1ee6f None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:23.620942 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5477f-be93-4bcf-8f84-ae5858d1ee6f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:23.621398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5477f-be93-4bcf-8f84-ae5858d1ee6f None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:23.626875 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 123/250] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:23.627303 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5477f-be93-4bcf-8f84-ae5858d1ee6f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:23.695919 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 128/251] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:23.695919 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4199d-a9b6-471b-b1c8-d53aca6bf578 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:23.695919 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4199d-a9b6-471b-b1c8-d53aca6bf578 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:23.695919 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4199d-a9b6-471b-b1c8-d53aca6bf578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:23.711781 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-80e4199d-a9b6-471b-b1c8-d53aca6bf578 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:23.712953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-80e4199d-a9b6-471b-b1c8-d53aca6bf578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:23.770485 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5477f-be93-4bcf-8f84-ae5858d1ee6f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:23.803076 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 129/252] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:23.805431 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4199d-a9b6-471b-b1c8-d53aca6bf578 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:23.850467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654be80-53e8-4ce3-bac3-bb46e76951fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:23.850467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654be80-53e8-4ce3-bac3-bb46e76951fc None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:23.850467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654be80-53e8-4ce3-bac3-bb46e76951fc None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:23.850467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654be80-53e8-4ce3-bac3-bb46e76951fc None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16/users/e49982f144764b61b0e794b9a89ecd61/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:23.853840 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654be80-53e8-4ce3-bac3-bb46e76951fc None admin] RBAC: Authorizing `identity:create_grant(project_id=5149a355272344e6928de24fc5261d16, user_id=e49982f144764b61b0e794b9a89ecd61, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:23.866462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654be80-53e8-4ce3-bac3-bb46e76951fc None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:23.934063 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4199d-a9b6-471b-b1c8-d53aca6bf578 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:23.969128 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1be6b-fa9d-457b-9193-56d3ab37de62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:23.969998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1be6b-fa9d-457b-9193-56d3ab37de62 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:23.970281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1be6b-fa9d-457b-9193-56d3ab37de62 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:23.970660 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1be6b-fa9d-457b-9193-56d3ab37de62 None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:23.980082 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1be6b-fa9d-457b-9193-56d3ab37de62 None admin] RBAC: Authorizing `identity:get_project(project_id=5149a355272344e6928de24fc5261d16)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:23.980082 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1be6b-fa9d-457b-9193-56d3ab37de62 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:23.980274 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 124/253] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:01:23 2022] PUT /identity/v3/projects/5149a355272344e6928de24fc5261d16/users/e49982f144764b61b0e794b9a89ecd61/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:01:23.980348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 130/254] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:23 2022] GET /identity/v3/projects/5149a355272344e6928de24fc5261d16 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:23.980427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654be80-53e8-4ce3-bac3-bb46e76951fc None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:23.987579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1be6b-fa9d-457b-9193-56d3ab37de62 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:24.122201 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1be6b-fa9d-457b-9193-56d3ab37de62 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:24.148941 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654be80-53e8-4ce3-bac3-bb46e76951fc None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:24.160563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c31444-1ebb-49c4-a24d-ecfc6d4f28ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:24.161269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c31444-1ebb-49c4-a24d-ecfc6d4f28ce None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:24.161556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c31444-1ebb-49c4-a24d-ecfc6d4f28ce None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:24.162156 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c31444-1ebb-49c4-a24d-ecfc6d4f28ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:24.162703 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c31444-1ebb-49c4-a24d-ecfc6d4f28ce None admin] RBAC: Adding query filter params (role.id=09fc23a294c748939513cefa3e91b27f, scope.project.id=5149a355272344e6928de24fc5261d16, user.id=a36cffa213414288b2d86b9badee16ed) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:24.163016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c31444-1ebb-49c4-a24d-ecfc6d4f28ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:24.164543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c31444-1ebb-49c4-a24d-ecfc6d4f28ce None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:24.171022 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 131/255] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:01:23 2022] GET /identity/v3/role_assignments?user.id=a36cffa213414288b2d86b9badee16ed&scope.project.id=5149a355272344e6928de24fc5261d16&role.id=09fc23a294c748939513cefa3e91b27f => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:24.174933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f127808-bc42-4e8d-835d-563da645b0cc None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:24.174933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f127808-bc42-4e8d-835d-563da645b0cc None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:24.174933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f127808-bc42-4e8d-835d-563da645b0cc None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:24.174933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 132/256] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:24.188392 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fc2d7-cfca-49ac-8952-a6df6fbdff4c None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:24.188565 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fc2d7-cfca-49ac-8952-a6df6fbdff4c None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:24.188769 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fc2d7-cfca-49ac-8952-a6df6fbdff4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:24.207189 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c0e7c-5261-43be-9a05-50bdc07315fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:24.208362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c0e7c-5261-43be-9a05-50bdc07315fc None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:24.208872 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c0e7c-5261-43be-9a05-50bdc07315fc None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:24.209361 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c0e7c-5261-43be-9a05-50bdc07315fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:24.232897 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c0e7c-5261-43be-9a05-50bdc07315fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:24.235515 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-695fc2d7-cfca-49ac-8952-a6df6fbdff4c None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:24.236707 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-695fc2d7-cfca-49ac-8952-a6df6fbdff4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:24.246450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-1c6c0e7c-5261-43be-9a05-50bdc07315fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:01:24.246450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:24.246450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:24.246450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:24.246450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:24.246450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:24.246450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:24.246450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:24.246450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:24.246450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:24.246450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:24.246450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:24.246450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:24.246450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:24.246450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:24.246450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:24.247397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:24.247397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:24.247397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:24.247397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:24.247397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:24.247397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:24.247397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:24.247397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:24.247397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:24.247397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:24.247397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:24.247397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:24.247397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:24.247397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:24.247397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:24.247397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:24.248277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:24.248277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:24.248277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:24.248277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:24.248277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:24.248277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:24.248277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:24.248277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:24.248277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:24.248277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:24.248277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:01:24.248277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:24.250727 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 125/257] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:01:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:24.256733 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c0e7c-5261-43be-9a05-50bdc07315fc None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:24.351906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 133/258] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:01:24.395679 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fc2d7-cfca-49ac-8952-a6df6fbdff4c None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:24.460493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c0e7c-5261-43be-9a05-50bdc07315fc None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:24.509443 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542cbfd-933f-41c1-876a-b2a45487aaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:24.511158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542cbfd-933f-41c1-876a-b2a45487aaa2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:24.511747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542cbfd-933f-41c1-876a-b2a45487aaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:24.512242 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542cbfd-933f-41c1-876a-b2a45487aaa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:24.513194 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542cbfd-933f-41c1-876a-b2a45487aaa2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:24.513693 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542cbfd-933f-41c1-876a-b2a45487aaa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:24.515275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542cbfd-933f-41c1-876a-b2a45487aaa2 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:24.526890 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fc2d7-cfca-49ac-8952-a6df6fbdff4c None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:24.530201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 126/259] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:24.535893 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542cbfd-933f-41c1-876a-b2a45487aaa2 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:24.569025 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b34b7-685f-4fd8-826a-fb3889eb2b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:24.569929 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b34b7-685f-4fd8-826a-fb3889eb2b8e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:24.570122 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b34b7-685f-4fd8-826a-fb3889eb2b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:24.570394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b34b7-685f-4fd8-826a-fb3889eb2b8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:24.589427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b34b7-685f-4fd8-826a-fb3889eb2b8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:24.605851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-770b34b7-685f-4fd8-826a-fb3889eb2b8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:24.605851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:24.605851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:24.605851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:24.605851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:24.605851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:24.605851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:24.605851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:24.605851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:24.605851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:24.605851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:24.605851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:24.605851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:24.605851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:24.605851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:24.605851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:24.606840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:24.606840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:24.606840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:24.606840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:24.606840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:24.606840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:24.606840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:24.606840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:24.606840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:24.606840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:24.606840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:24.606840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:24.606840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:24.606840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:24.606840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:24.606840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:24.608241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:24.608241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:24.608241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:24.608241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:24.608241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:24.608241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:24.608241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:24.608241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:24.608241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:24.608241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:24.608241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:24.608241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:24.608241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 134/260] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:01:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:24.612573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b34b7-685f-4fd8-826a-fb3889eb2b8e None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:24.647474 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542cbfd-933f-41c1-876a-b2a45487aaa2 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:24.686632 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2c3aa-c8bd-4c98-973c-a8158d5e8618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:24.687868 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2c3aa-c8bd-4c98-973c-a8158d5e8618 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:24.688350 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2c3aa-c8bd-4c98-973c-a8158d5e8618 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:24.688845 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2c3aa-c8bd-4c98-973c-a8158d5e8618 None admin] PATH_INFO: `/v3/users/f2b12f24b2f14af8baff832a876310ba` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:24.695282 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2c3aa-c8bd-4c98-973c-a8158d5e8618 None admin] RBAC: Authorizing `identity:get_user(user_id=f2b12f24b2f14af8baff832a876310ba)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:24.697027 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2c3aa-c8bd-4c98-973c-a8158d5e8618 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:24.699535 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 127/261] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:24 2022] GET /identity/v3/users/f2b12f24b2f14af8baff832a876310ba => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:24.705006 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2c3aa-c8bd-4c98-973c-a8158d5e8618 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:24.725437 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b34b7-685f-4fd8-826a-fb3889eb2b8e None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:24.772079 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8719703-6f57-4288-bd1c-0d47d51a54e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:24.772764 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8719703-6f57-4288-bd1c-0d47d51a54e3 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:24.773049 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8719703-6f57-4288-bd1c-0d47d51a54e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:24.773327 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8719703-6f57-4288-bd1c-0d47d51a54e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:24.774083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8719703-6f57-4288-bd1c-0d47d51a54e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:24.774387 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8719703-6f57-4288-bd1c-0d47d51a54e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:24.775799 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8719703-6f57-4288-bd1c-0d47d51a54e3 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:24.784733 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 135/262] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:01:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:24.791393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8719703-6f57-4288-bd1c-0d47d51a54e3 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:24.826464 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2c3aa-c8bd-4c98-973c-a8158d5e8618 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:24.879174 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295be61-6387-43dd-9dea-b6524106bc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:24.880082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295be61-6387-43dd-9dea-b6524106bc4e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:24.880513 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295be61-6387-43dd-9dea-b6524106bc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:24.880964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295be61-6387-43dd-9dea-b6524106bc4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:24.915910 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8719703-6f57-4288-bd1c-0d47d51a54e3 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:24.954101 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295be61-6387-43dd-9dea-b6524106bc4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:24.956251 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295be61-6387-43dd-9dea-b6524106bc4e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:24.961438 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f11e9-e8fe-4fc9-8bea-7d7a721042e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:24.962328 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f11e9-e8fe-4fc9-8bea-7d7a721042e4 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:24.962631 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f11e9-e8fe-4fc9-8bea-7d7a721042e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:24.962906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f11e9-e8fe-4fc9-8bea-7d7a721042e4 None admin] PATH_INFO: `/v3/users/f2b12f24b2f14af8baff832a876310ba` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:24.967165 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f11e9-e8fe-4fc9-8bea-7d7a721042e4 None admin] RBAC: Authorizing `identity:get_user(user_id=f2b12f24b2f14af8baff832a876310ba)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:24.968782 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f11e9-e8fe-4fc9-8bea-7d7a721042e4 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:24.970618 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 136/263] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:24 2022] GET /identity/v3/users/f2b12f24b2f14af8baff832a876310ba => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:24.975976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f11e9-e8fe-4fc9-8bea-7d7a721042e4 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:25.056707 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 128/264] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:25.063388 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295be61-6387-43dd-9dea-b6524106bc4e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:25.174654 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f11e9-e8fe-4fc9-8bea-7d7a721042e4 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:25.242834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9af32-0e5a-4067-92f4-4ea6ff4353be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:25.243818 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9af32-0e5a-4067-92f4-4ea6ff4353be None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:25.244296 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9af32-0e5a-4067-92f4-4ea6ff4353be None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:25.245461 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9af32-0e5a-4067-92f4-4ea6ff4353be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:25.269080 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295be61-6387-43dd-9dea-b6524106bc4e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:25.306002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98100ed1-4150-4dbe-91ea-a949bb6cf0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:25.307914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98100ed1-4150-4dbe-91ea-a949bb6cf0de None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:25.309543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98100ed1-4150-4dbe-91ea-a949bb6cf0de None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:25.310670 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98100ed1-4150-4dbe-91ea-a949bb6cf0de None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:25.312779 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98100ed1-4150-4dbe-91ea-a949bb6cf0de None admin] RBAC: Authorizing `identity:get_project(project_id=5149a355272344e6928de24fc5261d16)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:25.315401 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98100ed1-4150-4dbe-91ea-a949bb6cf0de None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:25.317910 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 129/265] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:25 2022] GET /identity/v3/projects/5149a355272344e6928de24fc5261d16 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:25.326037 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98100ed1-4150-4dbe-91ea-a949bb6cf0de None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:25.402789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9af32-0e5a-4067-92f4-4ea6ff4353be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:25.404979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9af32-0e5a-4067-92f4-4ea6ff4353be None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:25.477006 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98100ed1-4150-4dbe-91ea-a949bb6cf0de None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:25.523208 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5cdb9-cef1-46ff-abd0-55a2a9fd57a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:25.524103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5cdb9-cef1-46ff-abd0-55a2a9fd57a7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:25.524534 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5cdb9-cef1-46ff-abd0-55a2a9fd57a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:25.524960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5cdb9-cef1-46ff-abd0-55a2a9fd57a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:25.525964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5cdb9-cef1-46ff-abd0-55a2a9fd57a7 None admin] RBAC: Adding query filter params (role.id=5cd001edc58744738aa57180c0be68a9, scope.project.id=5149a355272344e6928de24fc5261d16, user.id=f2b12f24b2f14af8baff832a876310ba) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:25.526474 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5cdb9-cef1-46ff-abd0-55a2a9fd57a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:25.528048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5cdb9-cef1-46ff-abd0-55a2a9fd57a7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:25.534263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 130/266] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:01:25 2022] GET /identity/v3/role_assignments?user.id=f2b12f24b2f14af8baff832a876310ba&scope.project.id=5149a355272344e6928de24fc5261d16&role.id=5cd001edc58744738aa57180c0be68a9 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:25.535195 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 137/267] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:25.539765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5cdb9-cef1-46ff-abd0-55a2a9fd57a7 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:25.652457 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5cdb9-cef1-46ff-abd0-55a2a9fd57a7 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:25.693637 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7863f74-ec94-4123-a224-d5b9a9664d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:25.694787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7863f74-ec94-4123-a224-d5b9a9664d18 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:25.695233 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7863f74-ec94-4123-a224-d5b9a9664d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:25.695648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7863f74-ec94-4123-a224-d5b9a9664d18 None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:25.696990 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7863f74-ec94-4123-a224-d5b9a9664d18 None admin] RBAC: Authorizing `identity:get_project(project_id=5149a355272344e6928de24fc5261d16)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:25.698622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7863f74-ec94-4123-a224-d5b9a9664d18 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:25.700754 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 131/268] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:25 2022] GET /identity/v3/projects/5149a355272344e6928de24fc5261d16 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:25.711609 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9af32-0e5a-4067-92f4-4ea6ff4353be None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:25.833247 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9af32-0e5a-4067-92f4-4ea6ff4353be None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:25.886137 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d746d2-8638-43ac-ada3-919b3628882e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:25.886955 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d746d2-8638-43ac-ada3-919b3628882e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:25.887245 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d746d2-8638-43ac-ada3-919b3628882e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:25.887523 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d746d2-8638-43ac-ada3-919b3628882e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:25.888362 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d746d2-8638-43ac-ada3-919b3628882e None admin] RBAC: Adding query filter params (role.id=c1ddef32606649809bb218b686f472c5, scope.project.id=5149a355272344e6928de24fc5261d16, user.id=f2b12f24b2f14af8baff832a876310ba) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:25.888670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d746d2-8638-43ac-ada3-919b3628882e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:25.890118 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d746d2-8638-43ac-ada3-919b3628882e None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:25.902606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 138/269] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:01:25 2022] GET /identity/v3/role_assignments?user.id=f2b12f24b2f14af8baff832a876310ba&scope.project.id=5149a355272344e6928de24fc5261d16&role.id=c1ddef32606649809bb218b686f472c5 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:26.216270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab0b7e-b33d-4fb0-896b-9dca337a7948 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:26.216984 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab0b7e-b33d-4fb0-896b-9dca337a7948 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:26.217476 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab0b7e-b33d-4fb0-896b-9dca337a7948 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:26.219147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 132/270] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:26.224866 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6476f2-5fbc-4b0b-9849-aaca6750700d None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:26.225419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6476f2-5fbc-4b0b-9849-aaca6750700d None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:26.225895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6476f2-5fbc-4b0b-9849-aaca6750700d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:26.245423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-db6476f2-5fbc-4b0b-9849-aaca6750700d None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:26.246966 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-db6476f2-5fbc-4b0b-9849-aaca6750700d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:26.324545 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 139/271] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:26.348413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab0b7e-b33d-4fb0-896b-9dca337a7948 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:26.464040 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab0b7e-b33d-4fb0-896b-9dca337a7948 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:26.497446 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1332b-2adc-4257-ac01-df629b25bc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:26.498177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1332b-2adc-4257-ac01-df629b25bc58 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:26.498472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1332b-2adc-4257-ac01-df629b25bc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:26.498750 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1332b-2adc-4257-ac01-df629b25bc58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:26.511131 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1332b-2adc-4257-ac01-df629b25bc58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:26.519315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-10b1332b-2adc-4257-ac01-df629b25bc58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:26.519315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:26.519315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:26.519315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:26.519315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:26.519315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:26.519315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:26.519315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:26.519315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:26.519315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:26.519315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:26.519315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:26.519315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:26.519315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:26.519315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:26.519315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:26.520362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:26.520362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:26.520362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:26.520362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:26.520362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:26.520362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:26.520362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:26.520362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:26.520362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:26.520362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:26.520362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:26.520362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:26.520362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:26.520362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:26.520362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:26.520362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:26.521583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:26.521583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:26.521583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:26.521583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:26.521583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:26.521583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:26.521583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:26.521583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:26.521583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:26.521583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:26.521583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:26.521583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:26.521583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 133/272] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:26.527574 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6476f2-5fbc-4b0b-9849-aaca6750700d None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:26.630975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6476f2-5fbc-4b0b-9849-aaca6750700d None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:26.667980 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2139c65-518d-41b5-a87a-9a40bbdc9cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:26.668678 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2139c65-518d-41b5-a87a-9a40bbdc9cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:26.668956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2139c65-518d-41b5-a87a-9a40bbdc9cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:26.669229 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2139c65-518d-41b5-a87a-9a40bbdc9cc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:26.669985 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2139c65-518d-41b5-a87a-9a40bbdc9cc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:26.670298 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2139c65-518d-41b5-a87a-9a40bbdc9cc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:26.671719 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2139c65-518d-41b5-a87a-9a40bbdc9cc5 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:26.682035 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 140/273] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:26.687472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1332b-2adc-4257-ac01-df629b25bc58 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:26.720907 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210dfcd-0a79-4ff0-b87b-1ad91cf95c1e None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:26.721568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210dfcd-0a79-4ff0-b87b-1ad91cf95c1e None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:26.722045 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210dfcd-0a79-4ff0-b87b-1ad91cf95c1e None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:26.723652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 141/274] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:26.730742 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0e974-a2aa-4b4c-bb9f-a423230fc8dd None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:26.731035 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0e974-a2aa-4b4c-bb9f-a423230fc8dd None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:26.731324 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0e974-a2aa-4b4c-bb9f-a423230fc8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:26.749617 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-efe0e974-a2aa-4b4c-bb9f-a423230fc8dd None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:26.750763 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-efe0e974-a2aa-4b4c-bb9f-a423230fc8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:26.804017 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1332b-2adc-4257-ac01-df629b25bc58 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:26.829460 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 142/275] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:01:26.840355 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead68c25-df72-465b-a0f8-896518cbf428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:26.841582 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead68c25-df72-465b-a0f8-896518cbf428 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:26.842123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead68c25-df72-465b-a0f8-896518cbf428 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:26.846457 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead68c25-df72-465b-a0f8-896518cbf428 None admin] PATH_INFO: `/v3/users/a6e9ee68ee0b49eb8844b80600872523` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:26.858459 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead68c25-df72-465b-a0f8-896518cbf428 None admin] RBAC: Authorizing `identity:get_user(user_id=a6e9ee68ee0b49eb8844b80600872523)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:26.858459 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead68c25-df72-465b-a0f8-896518cbf428 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:26.860253 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 134/276] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:26 2022] GET /identity/v3/users/a6e9ee68ee0b49eb8844b80600872523 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:26.863814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0e974-a2aa-4b4c-bb9f-a423230fc8dd None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:26.865590 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead68c25-df72-465b-a0f8-896518cbf428 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:26.962356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0e974-a2aa-4b4c-bb9f-a423230fc8dd None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:26.965262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead68c25-df72-465b-a0f8-896518cbf428 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:27.001882 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270d48f-ff03-48b1-94d0-cb61d39924d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:27.003011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270d48f-ff03-48b1-94d0-cb61d39924d2 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:27.003442 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270d48f-ff03-48b1-94d0-cb61d39924d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:27.003859 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270d48f-ff03-48b1-94d0-cb61d39924d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:27.005348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270d48f-ff03-48b1-94d0-cb61d39924d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:27.005818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59109e-2f38-4c35-8b7a-f826d2361ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:27.006716 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59109e-2f38-4c35-8b7a-f826d2361ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:27.007110 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59109e-2f38-4c35-8b7a-f826d2361ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:27.007483 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59109e-2f38-4c35-8b7a-f826d2361ee5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:27.007773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270d48f-ff03-48b1-94d0-cb61d39924d2 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:27.008543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59109e-2f38-4c35-8b7a-f826d2361ee5 None admin] RBAC: Adding query filter params (role.id=390d715fbb0f4d029b222894fa3ac65b, user.id=a6e9ee68ee0b49eb8844b80600872523, scope.system=all) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:27.008956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59109e-2f38-4c35-8b7a-f826d2361ee5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:27.011153 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59109e-2f38-4c35-8b7a-f826d2361ee5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:27.015537 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 143/277] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:27.017119 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270d48f-ff03-48b1-94d0-cb61d39924d2 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:27.017797 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 135/278] 10.222.0.25 () {56 vars in 1308 bytes} [Tue May 10 21:01:26 2022] GET /identity/v3/role_assignments?user.id=a6e9ee68ee0b49eb8844b80600872523&scope.system=all&role.id=390d715fbb0f4d029b222894fa3ac65b => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:27.123313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270d48f-ff03-48b1-94d0-cb61d39924d2 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:27.160236 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969eccd5-c6b2-471a-b5b8-05f767f23e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:27.161359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969eccd5-c6b2-471a-b5b8-05f767f23e59 None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:27.161841 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969eccd5-c6b2-471a-b5b8-05f767f23e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:27.162311 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969eccd5-c6b2-471a-b5b8-05f767f23e59 None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:27.163257 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969eccd5-c6b2-471a-b5b8-05f767f23e59 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:27.164952 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969eccd5-c6b2-471a-b5b8-05f767f23e59 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:27.174544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6c4d8-0f12-4634-b614-81880924f06d None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:27.175201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6c4d8-0f12-4634-b614-81880924f06d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:27.175665 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6c4d8-0f12-4634-b614-81880924f06d None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:27.177397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 136/279] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:01:27.183922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7ce04-c4c6-4c18-ae4b-b07e4c21251f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:27.184211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7ce04-c4c6-4c18-ae4b-b07e4c21251f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:27.191269 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7ce04-c4c6-4c18-ae4b-b07e4c21251f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:27.202990 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a7a7ce04-c4c6-4c18-ae4b-b07e4c21251f None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:27.204210 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a7a7ce04-c4c6-4c18-ae4b-b07e4c21251f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:27.250323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 144/280] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 10 21:01:27 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:01:27.251790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cccaa4-6139-440b-8100-57a158b4d2c4 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:27.252200 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cccaa4-6139-440b-8100-57a158b4d2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:27.252760 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cccaa4-6139-440b-8100-57a158b4d2c4 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:27.254349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 145/281] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:27.260028 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f8ab2-8743-4cdd-bf80-96670cf0b062 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:27.261098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f8ab2-8743-4cdd-bf80-96670cf0b062 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:27.261458 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f8ab2-8743-4cdd-bf80-96670cf0b062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:27.279913 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-7c0f8ab2-8743-4cdd-bf80-96670cf0b062 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:27.281208 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-7c0f8ab2-8743-4cdd-bf80-96670cf0b062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:27.290403 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 137/282] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:27.312814 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7ce04-c4c6-4c18-ae4b-b07e4c21251f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:27.373236 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 146/283] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:01:27.396406 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f8ab2-8743-4cdd-bf80-96670cf0b062 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:27.443826 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7ce04-c4c6-4c18-ae4b-b07e4c21251f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:27.497320 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af8dc1-5a24-4149-83a0-a1cd32af5a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:27.499207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af8dc1-5a24-4149-83a0-a1cd32af5a62 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:27.500110 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af8dc1-5a24-4149-83a0-a1cd32af5a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:27.500397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af8dc1-5a24-4149-83a0-a1cd32af5a62 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:27.512977 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af8dc1-5a24-4149-83a0-a1cd32af5a62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:27.518116 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f8ab2-8743-4cdd-bf80-96670cf0b062 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:27.520717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-06af8dc1-5a24-4149-83a0-a1cd32af5a62 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 21:01:27.520717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:27.520717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:27.520717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:27.520717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:27.520717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:27.520717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:27.520717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:27.520717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:27.520717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:27.520717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:27.520717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:27.520717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:27.520717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:27.520717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:27.520717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:27.521623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:27.521623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:27.521623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:27.521623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:27.521623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:27.521623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:27.521623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:27.521623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:27.521623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:27.521623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:27.521623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:27.521623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:27.521623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:27.521623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:27.521623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:27.521623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:27.522430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:27.522430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:27.522430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:27.522430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:27.522430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:27.522430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:27.522430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:27.522430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:27.522430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:27.522430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:27.522430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 21:01:27.522430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:27.522430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 138/284] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:01:27.529328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af8dc1-5a24-4149-83a0-a1cd32af5a62 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:27.572223 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bf27e-3aea-44a1-b6a4-2c7b0a048bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:27.573090 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bf27e-3aea-44a1-b6a4-2c7b0a048bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:27.573568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bf27e-3aea-44a1-b6a4-2c7b0a048bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:27.573848 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bf27e-3aea-44a1-b6a4-2c7b0a048bc7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:27.588281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bf27e-3aea-44a1-b6a4-2c7b0a048bc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:27.599383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-809bf27e-3aea-44a1-b6a4-2c7b0a048bc7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:27.599383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:27.599383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:27.599383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:27.599383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:27.599383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:27.599383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:27.599383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:27.599383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:27.599383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:27.599383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:27.599383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:27.599383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:27.599383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:27.599383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:27.599383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:27.600410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:27.600410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:27.600410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:27.600410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:27.600410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:27.600410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:27.600410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:27.600410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:27.600410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:27.600410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:27.600410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:27.600410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:27.600410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:27.600410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:27.600410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:27.600410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:27.601204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:27.601204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:27.601204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:27.601204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:27.601204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:27.601204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:27.601204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:27.601204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:27.601204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:27.601204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:27.601204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:27.601204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:27.604735 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 147/285] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:01:27.610481 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bf27e-3aea-44a1-b6a4-2c7b0a048bc7 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:27.657378 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af8dc1-5a24-4149-83a0-a1cd32af5a62 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:27.700948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf48bd5-d456-4103-9b5c-e8f5fbae487e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:27.702191 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf48bd5-d456-4103-9b5c-e8f5fbae487e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:27.702783 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf48bd5-d456-4103-9b5c-e8f5fbae487e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:27.703379 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf48bd5-d456-4103-9b5c-e8f5fbae487e None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:27.704691 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf48bd5-d456-4103-9b5c-e8f5fbae487e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:27.705205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf48bd5-d456-4103-9b5c-e8f5fbae487e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:27.707220 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf48bd5-d456-4103-9b5c-e8f5fbae487e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:27.719358 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 139/286] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:27.725113 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf48bd5-d456-4103-9b5c-e8f5fbae487e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:27.726084 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bf27e-3aea-44a1-b6a4-2c7b0a048bc7 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:27.766396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b9cdb-fcb2-4ebe-adde-bbaa546963d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:27.767023 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b9cdb-fcb2-4ebe-adde-bbaa546963d1 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:27.767309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b9cdb-fcb2-4ebe-adde-bbaa546963d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:27.767589 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b9cdb-fcb2-4ebe-adde-bbaa546963d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:27.768385 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b9cdb-fcb2-4ebe-adde-bbaa546963d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:27.768653 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b9cdb-fcb2-4ebe-adde-bbaa546963d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:27.770130 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b9cdb-fcb2-4ebe-adde-bbaa546963d1 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:27.782601 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 148/287] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:27.785936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b9cdb-fcb2-4ebe-adde-bbaa546963d1 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:27.841718 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf48bd5-d456-4103-9b5c-e8f5fbae487e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:27.879379 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba46fb-e404-48cd-a406-6cdf8b296827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:27.881049 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba46fb-e404-48cd-a406-6cdf8b296827 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:27.881630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba46fb-e404-48cd-a406-6cdf8b296827 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:27.882091 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba46fb-e404-48cd-a406-6cdf8b296827 None admin] PATH_INFO: `/v3/users/a36cffa213414288b2d86b9badee16ed` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:27.883519 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba46fb-e404-48cd-a406-6cdf8b296827 None admin] RBAC: Authorizing `identity:get_user(user_id=a36cffa213414288b2d86b9badee16ed)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:27.885775 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba46fb-e404-48cd-a406-6cdf8b296827 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:27.888288 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 140/288] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:27 2022] GET /identity/v3/users/a36cffa213414288b2d86b9badee16ed => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:27.896045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba46fb-e404-48cd-a406-6cdf8b296827 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:27.965258 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b9cdb-fcb2-4ebe-adde-bbaa546963d1 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:28.003616 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace8b33-3685-450b-8d71-98b41560e4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:28.004794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace8b33-3685-450b-8d71-98b41560e4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:28.005281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace8b33-3685-450b-8d71-98b41560e4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:28.005734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace8b33-3685-450b-8d71-98b41560e4d4 None admin] PATH_INFO: `/v3/users/e49982f144764b61b0e794b9a89ecd61` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:28.007149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace8b33-3685-450b-8d71-98b41560e4d4 None admin] RBAC: Authorizing `identity:get_user(user_id=e49982f144764b61b0e794b9a89ecd61)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:28.009045 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace8b33-3685-450b-8d71-98b41560e4d4 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:28.012196 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 149/289] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:27 2022] GET /identity/v3/users/e49982f144764b61b0e794b9a89ecd61 => generated 297 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:28.018255 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace8b33-3685-450b-8d71-98b41560e4d4 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:28.100611 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba46fb-e404-48cd-a406-6cdf8b296827 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:28.150645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b31bc3-e217-48e6-b70d-7693bb410318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:28.152107 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b31bc3-e217-48e6-b70d-7693bb410318 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:28.152549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b31bc3-e217-48e6-b70d-7693bb410318 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:28.152989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b31bc3-e217-48e6-b70d-7693bb410318 None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:28.154324 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b31bc3-e217-48e6-b70d-7693bb410318 None admin] RBAC: Authorizing `identity:get_project(project_id=5149a355272344e6928de24fc5261d16)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:28.154583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace8b33-3685-450b-8d71-98b41560e4d4 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:28.156078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b31bc3-e217-48e6-b70d-7693bb410318 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:28.158264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 141/290] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:27 2022] GET /identity/v3/projects/5149a355272344e6928de24fc5261d16 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:28.167317 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b31bc3-e217-48e6-b70d-7693bb410318 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:28.191473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b359f9-1c63-4063-9708-dd88083b560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:28.192726 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b359f9-1c63-4063-9708-dd88083b560a None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:28.193216 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b359f9-1c63-4063-9708-dd88083b560a None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:28.193715 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b359f9-1c63-4063-9708-dd88083b560a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:28.271604 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b359f9-1c63-4063-9708-dd88083b560a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:28.273858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b359f9-1c63-4063-9708-dd88083b560a None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:28.387852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b31bc3-e217-48e6-b70d-7693bb410318 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:28.428905 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24885c-803c-4cb8-a822-dafe3746f80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:28.430285 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24885c-803c-4cb8-a822-dafe3746f80f None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:28.430838 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24885c-803c-4cb8-a822-dafe3746f80f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:28.431320 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24885c-803c-4cb8-a822-dafe3746f80f None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16/users/a36cffa213414288b2d86b9badee16ed/roles/09fc23a294c748939513cefa3e91b27f` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:28.434586 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24885c-803c-4cb8-a822-dafe3746f80f None admin] RBAC: Authorizing `identity:create_grant(project_id=5149a355272344e6928de24fc5261d16, user_id=a36cffa213414288b2d86b9badee16ed, role_id=09fc23a294c748939513cefa3e91b27f)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:28.436238 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24885c-803c-4cb8-a822-dafe3746f80f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:28.452261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 150/291] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 21:01:28.458125 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b359f9-1c63-4063-9708-dd88083b560a None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:28.514507 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 142/292] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:01:28 2022] PUT /identity/v3/projects/5149a355272344e6928de24fc5261d16/users/a36cffa213414288b2d86b9badee16ed/roles/09fc23a294c748939513cefa3e91b27f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:01:28.583173 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b359f9-1c63-4063-9708-dd88083b560a None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:28.629146 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53631ff-3feb-46d1-b6ca-5f701f79b764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:28.630543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53631ff-3feb-46d1-b6ca-5f701f79b764 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:28.631076 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53631ff-3feb-46d1-b6ca-5f701f79b764 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:28.631609 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53631ff-3feb-46d1-b6ca-5f701f79b764 None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:28.633204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53631ff-3feb-46d1-b6ca-5f701f79b764 None admin] RBAC: Authorizing `identity:get_project(project_id=5149a355272344e6928de24fc5261d16)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:28.634936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53631ff-3feb-46d1-b6ca-5f701f79b764 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:28.637566 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 151/293] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:28 2022] GET /identity/v3/projects/5149a355272344e6928de24fc5261d16 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:28.643833 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24885c-803c-4cb8-a822-dafe3746f80f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:28.781697 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24885c-803c-4cb8-a822-dafe3746f80f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:28.816201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc932d-1fb1-4a8a-a4c3-21f9654c847e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:28.816867 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc932d-1fb1-4a8a-a4c3-21f9654c847e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:28.817154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc932d-1fb1-4a8a-a4c3-21f9654c847e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:28.817427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc932d-1fb1-4a8a-a4c3-21f9654c847e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:28.818272 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc932d-1fb1-4a8a-a4c3-21f9654c847e None admin] RBAC: Adding query filter params (role.id=390d715fbb0f4d029b222894fa3ac65b, scope.project.id=5149a355272344e6928de24fc5261d16, user.id=e49982f144764b61b0e794b9a89ecd61) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:28.818613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc932d-1fb1-4a8a-a4c3-21f9654c847e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:28.820051 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc932d-1fb1-4a8a-a4c3-21f9654c847e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:28.826595 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 143/294] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:01:28 2022] GET /identity/v3/role_assignments?user.id=e49982f144764b61b0e794b9a89ecd61&scope.project.id=5149a355272344e6928de24fc5261d16&role.id=390d715fbb0f4d029b222894fa3ac65b => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:29.595768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddd22a-441e-42a4-8b70-c2f43ef9b725 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:29.596291 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddd22a-441e-42a4-8b70-c2f43ef9b725 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:29.596369 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddd22a-441e-42a4-8b70-c2f43ef9b725 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:29.597950 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 152/295] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:29.603297 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc5714-1d79-49d8-a170-6e1447b55274 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:29.603694 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc5714-1d79-49d8-a170-6e1447b55274 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:29.604400 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc5714-1d79-49d8-a170-6e1447b55274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:29.621991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-5dcc5714-1d79-49d8-a170-6e1447b55274 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:29.623231 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5dcc5714-1d79-49d8-a170-6e1447b55274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:29.696318 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 144/296] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:29.717968 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddd22a-441e-42a4-8b70-c2f43ef9b725 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:29.823069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddd22a-441e-42a4-8b70-c2f43ef9b725 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:29.845389 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1c71a-d039-4693-b6ad-20cf7523ab71 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:29.845691 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1c71a-d039-4693-b6ad-20cf7523ab71 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:29.846027 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1c71a-d039-4693-b6ad-20cf7523ab71 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:29.848030 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 145/297] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:01:29.853549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165109e-7437-4d17-9088-8d9339d6298f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:29.853912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165109e-7437-4d17-9088-8d9339d6298f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:29.855056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165109e-7437-4d17-9088-8d9339d6298f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:29.873012 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-1165109e-7437-4d17-9088-8d9339d6298f None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:29.874197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1165109e-7437-4d17-9088-8d9339d6298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:29.874773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b42dc-21ab-41bb-b3de-4dcd8b41f71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:29.875575 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b42dc-21ab-41bb-b3de-4dcd8b41f71d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:29.875846 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b42dc-21ab-41bb-b3de-4dcd8b41f71d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:29.876295 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b42dc-21ab-41bb-b3de-4dcd8b41f71d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:29.889617 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b42dc-21ab-41bb-b3de-4dcd8b41f71d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:29.899193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-530b42dc-21ab-41bb-b3de-4dcd8b41f71d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:29.899193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:29.899193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:29.899193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:29.899193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:29.899193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:29.899193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:29.899193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:29.899193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:29.899193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:29.899193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:29.899193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:29.899193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:29.899193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:29.899193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:29.899193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:29.901852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:29.901852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:29.901852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:29.901852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:29.901852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:29.901852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:29.901852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:29.901852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:29.901852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:29.901852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:29.901852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:29.901852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:29.901852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:29.901852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:29.901852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:29.901852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:29.902850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:29.902850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:29.902850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:29.902850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:29.902850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:29.902850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:29.902850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:29.902850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:29.902850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:29.902850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:29.902850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:29.902850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:29.902850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 153/298] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:29.908380 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b42dc-21ab-41bb-b3de-4dcd8b41f71d None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:29.954570 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 146/299] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:29.977801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165109e-7437-4d17-9088-8d9339d6298f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:30.031670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b42dc-21ab-41bb-b3de-4dcd8b41f71d None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:30.066518 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5e6b2-d4ae-4ffe-94e4-9691a097dc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:30.067195 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5e6b2-d4ae-4ffe-94e4-9691a097dc54 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:30.067485 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5e6b2-d4ae-4ffe-94e4-9691a097dc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:30.067762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5e6b2-d4ae-4ffe-94e4-9691a097dc54 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:30.068516 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5e6b2-d4ae-4ffe-94e4-9691a097dc54 None admin] RBAC: Adding query filter params (name=member) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:30.068820 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5e6b2-d4ae-4ffe-94e4-9691a097dc54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:30.070189 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5e6b2-d4ae-4ffe-94e4-9691a097dc54 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:30.076153 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165109e-7437-4d17-9088-8d9339d6298f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:30.078830 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 154/300] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:30.084681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5e6b2-d4ae-4ffe-94e4-9691a097dc54 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:30.113471 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b71c3c-361b-4463-8b52-2eaa83261d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:30.114586 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b71c3c-361b-4463-8b52-2eaa83261d7e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:30.115131 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b71c3c-361b-4463-8b52-2eaa83261d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:30.115407 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b71c3c-361b-4463-8b52-2eaa83261d7e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:30.128859 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b71c3c-361b-4463-8b52-2eaa83261d7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:30.140171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-72b71c3c-361b-4463-8b52-2eaa83261d7e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 21:01:30.140171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:30.140171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:30.140171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:30.140171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:30.140171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:30.140171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:30.140171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:30.140171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:30.140171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:30.140171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:30.140171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:30.140171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:30.140171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:30.140171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:30.140171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:30.142100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:30.142100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:30.142100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:30.142100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:30.142100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:30.142100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:30.142100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:30.142100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:30.142100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:30.142100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:30.142100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:30.142100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:30.142100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:30.142100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:30.142100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:30.142100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:30.143357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:30.143357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:30.143357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:30.143357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:30.143357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:30.143357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:30.143357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:30.143357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:30.143357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:30.143357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:30.143357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 21:01:30.143357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:30.144642 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 147/301] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:30.146063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964d358-f976-42ba-84f1-eb787e69c079 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:30.146358 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964d358-f976-42ba-84f1-eb787e69c079 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:30.146675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964d358-f976-42ba-84f1-eb787e69c079 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:30.148273 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 148/302] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:30.152746 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964d358-f976-42ba-84f1-eb787e69c079 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:30.190257 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5e6b2-d4ae-4ffe-94e4-9691a097dc54 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:30.223233 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bddba-66bc-45cf-b2d0-90e8334c1beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:30.224113 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bddba-66bc-45cf-b2d0-90e8334c1beb None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:30.224403 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bddba-66bc-45cf-b2d0-90e8334c1beb None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:30.224682 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bddba-66bc-45cf-b2d0-90e8334c1beb None admin] PATH_INFO: `/v3/users/a6e9ee68ee0b49eb8844b80600872523` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:30.225883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bddba-66bc-45cf-b2d0-90e8334c1beb None admin] RBAC: Authorizing `identity:get_user(user_id=a6e9ee68ee0b49eb8844b80600872523)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:30.227351 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bddba-66bc-45cf-b2d0-90e8334c1beb None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:30.228999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 155/303] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:30 2022] GET /identity/v3/users/a6e9ee68ee0b49eb8844b80600872523 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:30.234879 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1065c0c-c6a0-4218-a5af-fb5f54408d49 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:30.235174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1065c0c-c6a0-4218-a5af-fb5f54408d49 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:30.235460 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1065c0c-c6a0-4218-a5af-fb5f54408d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:30.251470 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-a1065c0c-c6a0-4218-a5af-fb5f54408d49 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:30.252107 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964d358-f976-42ba-84f1-eb787e69c079 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:30.252865 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a1065c0c-c6a0-4218-a5af-fb5f54408d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:30.286062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e666d-4313-4f1e-891e-54a33384c894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:30.286748 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e666d-4313-4f1e-891e-54a33384c894 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:30.287040 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e666d-4313-4f1e-891e-54a33384c894 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:30.287320 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e666d-4313-4f1e-891e-54a33384c894 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:30.288073 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e666d-4313-4f1e-891e-54a33384c894 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:30.288380 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e666d-4313-4f1e-891e-54a33384c894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:30.289765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e666d-4313-4f1e-891e-54a33384c894 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:30.298545 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 149/304] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:30.299209 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e666d-4313-4f1e-891e-54a33384c894 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:30.321096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 156/305] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:30.321842 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1065c0c-c6a0-4218-a5af-fb5f54408d49 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:30.401642 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e666d-4313-4f1e-891e-54a33384c894 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:30.457637 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1065c0c-c6a0-4218-a5af-fb5f54408d49 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:30.459801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55522e-1584-4d11-8307-3b1427d40035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:30.460667 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55522e-1584-4d11-8307-3b1427d40035 None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:30.460952 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55522e-1584-4d11-8307-3b1427d40035 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:30.461231 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55522e-1584-4d11-8307-3b1427d40035 None admin] PATH_INFO: `/v3/system/users/a6e9ee68ee0b49eb8844b80600872523/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:30.462794 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55522e-1584-4d11-8307-3b1427d40035 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a6e9ee68ee0b49eb8844b80600872523, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:30.464252 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55522e-1584-4d11-8307-3b1427d40035 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:30.490276 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95e897-373c-4c0e-a09c-9b826f6bdba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:30.491232 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95e897-373c-4c0e-a09c-9b826f6bdba8 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:30.491515 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95e897-373c-4c0e-a09c-9b826f6bdba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:30.491787 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95e897-373c-4c0e-a09c-9b826f6bdba8 None admin] PATH_INFO: `/v3/users/5dadb9188d524baf975d2a1d931ee896` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:30.505026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95e897-373c-4c0e-a09c-9b826f6bdba8 None admin] RBAC: Authorizing `identity:get_user(user_id=5dadb9188d524baf975d2a1d931ee896)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:30.506476 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95e897-373c-4c0e-a09c-9b826f6bdba8 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:30.508285 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 157/306] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:30 2022] GET /identity/v3/users/5dadb9188d524baf975d2a1d931ee896 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:30.508936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95e897-373c-4c0e-a09c-9b826f6bdba8 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:30.562487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 150/307] 10.222.0.25 () {58 vars in 1334 bytes} [Tue May 10 21:01:30 2022] PUT /identity/v3/system/users/a6e9ee68ee0b49eb8844b80600872523/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:01:30.562487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55522e-1584-4d11-8307-3b1427d40035 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:30.613966 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95e897-373c-4c0e-a09c-9b826f6bdba8 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:30.652704 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e341b-3f1c-43be-add1-fdcec7aca961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:30.653428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e341b-3f1c-43be-add1-fdcec7aca961 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:30.653711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e341b-3f1c-43be-add1-fdcec7aca961 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:30.653985 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e341b-3f1c-43be-add1-fdcec7aca961 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:30.655461 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e341b-3f1c-43be-add1-fdcec7aca961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:30.656933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e341b-3f1c-43be-add1-fdcec7aca961 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:30.658791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 158/308] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:30.664553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e341b-3f1c-43be-add1-fdcec7aca961 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:30.681350 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55522e-1584-4d11-8307-3b1427d40035 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:30.718662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de5463-c81a-403c-88e2-694c990812ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:30.719374 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de5463-c81a-403c-88e2-694c990812ec None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:30.719663 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de5463-c81a-403c-88e2-694c990812ec None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:30.719939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de5463-c81a-403c-88e2-694c990812ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:30.720782 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de5463-c81a-403c-88e2-694c990812ec None admin] RBAC: Adding query filter params (role.id=09fc23a294c748939513cefa3e91b27f, user.id=5dadb9188d524baf975d2a1d931ee896, scope.system=all) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:30.721097 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de5463-c81a-403c-88e2-694c990812ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:30.722589 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de5463-c81a-403c-88e2-694c990812ec None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:30.728447 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 151/309] 10.222.0.25 () {56 vars in 1308 bytes} [Tue May 10 21:01:30 2022] GET /identity/v3/role_assignments?user.id=5dadb9188d524baf975d2a1d931ee896&scope.system=all&role.id=09fc23a294c748939513cefa3e91b27f => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:30.778535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e341b-3f1c-43be-add1-fdcec7aca961 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:30.817333 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f0b07-78bf-495d-b917-c519fadd09fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:30.818024 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f0b07-78bf-495d-b917-c519fadd09fd None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:30.818307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f0b07-78bf-495d-b917-c519fadd09fd None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:30.818614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f0b07-78bf-495d-b917-c519fadd09fd None admin] PATH_INFO: `/v3/groups` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:30.819322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f0b07-78bf-495d-b917-c519fadd09fd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:30.820802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f0b07-78bf-495d-b917-c519fadd09fd None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:30.894000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 159/310] 10.222.0.25 () {60 vars in 1134 bytes} [Tue May 10 21:01:30 2022] POST /identity/v3/groups => generated 229 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:01:31.120656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9ac7c-9ed4-4a4b-8dc7-8918eb0bddb3 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:31.121019 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9ac7c-9ed4-4a4b-8dc7-8918eb0bddb3 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:31.121324 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9ac7c-9ed4-4a4b-8dc7-8918eb0bddb3 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:31.123035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 152/311] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:31.128350 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d61b5-e4e3-4af9-8499-d36849e68ea5 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:31.128647 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d61b5-e4e3-4af9-8499-d36849e68ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:31.128997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d61b5-e4e3-4af9-8499-d36849e68ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:31.146267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-4f5d61b5-e4e3-4af9-8499-d36849e68ea5 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:31.147488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4f5d61b5-e4e3-4af9-8499-d36849e68ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:31.219018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 160/312] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:31.241947 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9ac7c-9ed4-4a4b-8dc7-8918eb0bddb3 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:31.351089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9ac7c-9ed4-4a4b-8dc7-8918eb0bddb3 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:31.386268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a734797-9cbb-46e9-bf07-f6c0edbfd6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:31.387065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a734797-9cbb-46e9-bf07-f6c0edbfd6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:31.387353 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a734797-9cbb-46e9-bf07-f6c0edbfd6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:31.387629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a734797-9cbb-46e9-bf07-f6c0edbfd6f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:31.397892 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a734797-9cbb-46e9-bf07-f6c0edbfd6f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:31.405747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-5a734797-9cbb-46e9-bf07-f6c0edbfd6f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 21:01:31.405747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:31.405747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:31.405747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:31.405747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:31.405747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:31.405747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:31.405747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:31.405747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:31.405747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:31.405747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:31.405747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:31.405747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:31.405747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:31.405747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:31.405747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:31.407613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:31.407613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:31.407613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:31.407613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:31.407613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:31.407613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:31.407613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:31.407613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:31.407613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:31.407613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:31.407613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:31.407613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:31.407613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:31.407613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:31.407613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:31.407613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:31.409333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:31.409333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:31.409333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:31.409333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:31.409333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:31.409333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:31.409333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:31.409333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:31.409333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:31.409333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:31.409333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 21:01:31.409333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:31.409333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 153/313] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:31.415507 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d61b5-e4e3-4af9-8499-d36849e68ea5 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:31.520471 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d61b5-e4e3-4af9-8499-d36849e68ea5 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:31.557398 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91a265-7531-41d7-af73-f7f98fa2cd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:31.558574 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91a265-7531-41d7-af73-f7f98fa2cd5c None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:31.559169 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91a265-7531-41d7-af73-f7f98fa2cd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:31.559650 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91a265-7531-41d7-af73-f7f98fa2cd5c None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:31.560707 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91a265-7531-41d7-af73-f7f98fa2cd5c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:31.561228 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91a265-7531-41d7-af73-f7f98fa2cd5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:31.562825 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91a265-7531-41d7-af73-f7f98fa2cd5c None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:31.571648 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 161/314] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:31.578204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a734797-9cbb-46e9-bf07-f6c0edbfd6f2 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:31.678694 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a734797-9cbb-46e9-bf07-f6c0edbfd6f2 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:31.712188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad20c3-449f-4efe-8cfc-fb41bd32687a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:31.713712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad20c3-449f-4efe-8cfc-fb41bd32687a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:31.714023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad20c3-449f-4efe-8cfc-fb41bd32687a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:31.714306 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad20c3-449f-4efe-8cfc-fb41bd32687a None admin] PATH_INFO: `/v3/users/a36cffa213414288b2d86b9badee16ed` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:31.715543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad20c3-449f-4efe-8cfc-fb41bd32687a None admin] RBAC: Authorizing `identity:get_user(user_id=a36cffa213414288b2d86b9badee16ed)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:31.716979 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad20c3-449f-4efe-8cfc-fb41bd32687a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:31.719002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 154/315] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:31 2022] GET /identity/v3/users/a36cffa213414288b2d86b9badee16ed => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:31.724396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91a265-7531-41d7-af73-f7f98fa2cd5c None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:31.830798 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91a265-7531-41d7-af73-f7f98fa2cd5c None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:31.865504 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976e06c-3e47-40d8-89b8-2dccf7bdbced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:31.866158 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976e06c-3e47-40d8-89b8-2dccf7bdbced None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:31.866521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976e06c-3e47-40d8-89b8-2dccf7bdbced None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:31.866811 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976e06c-3e47-40d8-89b8-2dccf7bdbced None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:31.939238 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6976e06c-3e47-40d8-89b8-2dccf7bdbced None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:31.940624 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6976e06c-3e47-40d8-89b8-2dccf7bdbced None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:32.040406 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 162/316] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:32.045984 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad20c3-449f-4efe-8cfc-fb41bd32687a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:32.154265 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad20c3-449f-4efe-8cfc-fb41bd32687a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:32.189598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f774dbf-ec11-43a2-84e8-6027f476c67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:32.190379 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f774dbf-ec11-43a2-84e8-6027f476c67a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:32.190688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f774dbf-ec11-43a2-84e8-6027f476c67a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:32.190966 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f774dbf-ec11-43a2-84e8-6027f476c67a None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:32.192151 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f774dbf-ec11-43a2-84e8-6027f476c67a None admin] RBAC: Authorizing `identity:get_project(project_id=5149a355272344e6928de24fc5261d16)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:32.193598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f774dbf-ec11-43a2-84e8-6027f476c67a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:32.195625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 155/317] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:32 2022] GET /identity/v3/projects/5149a355272344e6928de24fc5261d16 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:32.202206 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976e06c-3e47-40d8-89b8-2dccf7bdbced None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:32.305209 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976e06c-3e47-40d8-89b8-2dccf7bdbced None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:32.340412 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c110c-b8bc-4b9e-862a-194e8483ed3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:32.341442 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c110c-b8bc-4b9e-862a-194e8483ed3d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:32.341940 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c110c-b8bc-4b9e-862a-194e8483ed3d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:32.342417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c110c-b8bc-4b9e-862a-194e8483ed3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:32.343542 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c110c-b8bc-4b9e-862a-194e8483ed3d None admin] RBAC: Adding query filter params (role.id=09fc23a294c748939513cefa3e91b27f, scope.project.id=5149a355272344e6928de24fc5261d16, user.id=a36cffa213414288b2d86b9badee16ed) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:32.344070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c110c-b8bc-4b9e-862a-194e8483ed3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:32.345706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c110c-b8bc-4b9e-862a-194e8483ed3d None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:32.352335 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 163/318] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:01:32 2022] GET /identity/v3/role_assignments?user.id=a36cffa213414288b2d86b9badee16ed&scope.project.id=5149a355272344e6928de24fc5261d16&role.id=09fc23a294c748939513cefa3e91b27f => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:32.858213 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec32849-06cf-4ea0-9695-341f20070ad7 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:32.858727 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec32849-06cf-4ea0-9695-341f20070ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:32.858825 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec32849-06cf-4ea0-9695-341f20070ad7 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:32.860188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 156/319] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:32.865535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfcbbc-1e75-49c0-ad87-e369d18f3e86 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:32.865930 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfcbbc-1e75-49c0-ad87-e369d18f3e86 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:32.866106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfcbbc-1e75-49c0-ad87-e369d18f3e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:32.883664 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-1adfcbbc-1e75-49c0-ad87-e369d18f3e86 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:32.884904 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-1adfcbbc-1e75-49c0-ad87-e369d18f3e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:32.953922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 164/320] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:32.975872 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec32849-06cf-4ea0-9695-341f20070ad7 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:33.075446 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263360f-1919-4bdc-bdc9-6c9febbf0d11 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:33.075732 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263360f-1919-4bdc-bdc9-6c9febbf0d11 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:33.076178 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263360f-1919-4bdc-bdc9-6c9febbf0d11 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:33.077530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 165/321] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:01:33.079843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec32849-06cf-4ea0-9695-341f20070ad7 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:33.083115 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255aa17-5857-4cf5-8b78-7bd535c7d5c9 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:33.083408 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255aa17-5857-4cf5-8b78-7bd535c7d5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:33.083688 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255aa17-5857-4cf5-8b78-7bd535c7d5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:33.101504 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-6255aa17-5857-4cf5-8b78-7bd535c7d5c9 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:33.102961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-6255aa17-5857-4cf5-8b78-7bd535c7d5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:33.114894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9db6d-95d6-4311-a1da-d93d99d483d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:33.115690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9db6d-95d6-4311-a1da-d93d99d483d9 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:33.115986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9db6d-95d6-4311-a1da-d93d99d483d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:33.116254 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9db6d-95d6-4311-a1da-d93d99d483d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:33.127432 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9db6d-95d6-4311-a1da-d93d99d483d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:33.135622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-79d9db6d-95d6-4311-a1da-d93d99d483d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:33.135622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:33.135622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:33.135622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:33.135622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:33.135622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:33.135622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:33.135622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:33.135622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:33.135622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:33.135622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:33.135622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:33.135622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:33.135622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:33.135622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:33.135622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:33.136598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:33.136598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:33.136598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:33.136598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:33.136598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:33.136598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:33.136598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:33.136598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:33.136598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:33.136598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:33.136598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:33.136598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:33.136598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:33.136598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:33.136598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:33.136598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:33.137462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:33.137462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:33.137462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:33.137462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:33.137462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:33.137462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:33.137462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:33.137462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:33.137462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:33.137462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:33.137462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:33.137462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:33.141544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 157/322] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:33.142376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9db6d-95d6-4311-a1da-d93d99d483d9 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:33.170366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 166/323] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:01:33.192732 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255aa17-5857-4cf5-8b78-7bd535c7d5c9 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:33.243954 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9db6d-95d6-4311-a1da-d93d99d483d9 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:33.275255 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291832f4-07b2-4da5-a2e3-5c6d77ae35b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:33.275956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291832f4-07b2-4da5-a2e3-5c6d77ae35b3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:33.276236 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291832f4-07b2-4da5-a2e3-5c6d77ae35b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:33.276507 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291832f4-07b2-4da5-a2e3-5c6d77ae35b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:33.277248 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291832f4-07b2-4da5-a2e3-5c6d77ae35b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:33.277548 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291832f4-07b2-4da5-a2e3-5c6d77ae35b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:33.278934 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291832f4-07b2-4da5-a2e3-5c6d77ae35b3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:33.285392 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255aa17-5857-4cf5-8b78-7bd535c7d5c9 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:33.286651 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 158/324] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:33.287661 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc372b71-6b0e-46b7-8ec3-8bddbc9c304f None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:33.287975 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc372b71-6b0e-46b7-8ec3-8bddbc9c304f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:33.288277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc372b71-6b0e-46b7-8ec3-8bddbc9c304f None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:33.289481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 159/325] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:33.292641 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc372b71-6b0e-46b7-8ec3-8bddbc9c304f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:33.322525 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee5936-b0a9-4bbb-a10f-5e52c6e62f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:33.323480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee5936-b0a9-4bbb-a10f-5e52c6e62f34 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:33.323766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee5936-b0a9-4bbb-a10f-5e52c6e62f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:33.324041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee5936-b0a9-4bbb-a10f-5e52c6e62f34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:33.333687 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee5936-b0a9-4bbb-a10f-5e52c6e62f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:33.341366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-92ee5936-b0a9-4bbb-a10f-5e52c6e62f34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 21:01:33.341366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:33.341366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:33.341366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:33.341366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:33.341366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:33.341366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:33.341366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:33.341366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:33.341366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:33.341366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:33.341366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:33.341366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:33.341366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:33.341366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:33.341366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:33.342242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:33.342242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:33.342242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:33.342242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:33.342242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:33.342242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:33.342242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:33.342242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:33.342242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:33.342242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:33.342242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:33.342242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:33.342242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:33.342242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:33.342242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:33.342242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:33.343117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:33.343117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:33.343117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:33.343117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:33.343117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:33.343117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:33.343117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:33.343117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:33.343117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:33.343117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:33.343117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 21:01:33.343117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:33.343117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 167/326] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:01:33.344586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dbd94-8aeb-437d-b27f-55e2ab689cbe None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:33.344876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dbd94-8aeb-437d-b27f-55e2ab689cbe None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:33.345158 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dbd94-8aeb-437d-b27f-55e2ab689cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:33.364629 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-e18dbd94-8aeb-437d-b27f-55e2ab689cbe None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:33.364629 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e18dbd94-8aeb-437d-b27f-55e2ab689cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:33.389835 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc372b71-6b0e-46b7-8ec3-8bddbc9c304f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:33.422314 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c80fdc-4636-4d40-9790-38fc0aa6f57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:33.423480 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c80fdc-4636-4d40-9790-38fc0aa6f57c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:33.423765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c80fdc-4636-4d40-9790-38fc0aa6f57c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:33.424043 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c80fdc-4636-4d40-9790-38fc0aa6f57c None admin] PATH_INFO: `/v3/users/a6e9ee68ee0b49eb8844b80600872523` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:33.425218 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c80fdc-4636-4d40-9790-38fc0aa6f57c None admin] RBAC: Authorizing `identity:get_user(user_id=a6e9ee68ee0b49eb8844b80600872523)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:33.426699 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c80fdc-4636-4d40-9790-38fc0aa6f57c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:33.427241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 168/327] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:33.428080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dbd94-8aeb-437d-b27f-55e2ab689cbe None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:33.428293 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 160/328] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:33 2022] GET /identity/v3/users/a6e9ee68ee0b49eb8844b80600872523 => generated 293 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:33.442120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c80fdc-4636-4d40-9790-38fc0aa6f57c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:33.521796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dbd94-8aeb-437d-b27f-55e2ab689cbe None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:33.535047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c80fdc-4636-4d40-9790-38fc0aa6f57c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:33.554579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990da7f9-f23a-4c5d-adc9-fe8ea975143e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:33.555246 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990da7f9-f23a-4c5d-adc9-fe8ea975143e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:33.555529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990da7f9-f23a-4c5d-adc9-fe8ea975143e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:33.555804 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990da7f9-f23a-4c5d-adc9-fe8ea975143e None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:33.556544 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990da7f9-f23a-4c5d-adc9-fe8ea975143e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:33.557379 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990da7f9-f23a-4c5d-adc9-fe8ea975143e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:33.558859 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990da7f9-f23a-4c5d-adc9-fe8ea975143e None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:33.566536 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 169/329] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:33.568253 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c505d-a744-4a52-b079-bb88d3d784ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:33.568490 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990da7f9-f23a-4c5d-adc9-fe8ea975143e None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:33.568904 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c505d-a744-4a52-b079-bb88d3d784ed None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:33.569195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c505d-a744-4a52-b079-bb88d3d784ed None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:33.569474 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c505d-a744-4a52-b079-bb88d3d784ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:33.570308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c505d-a744-4a52-b079-bb88d3d784ed None admin] RBAC: Adding query filter params (role.id=390d715fbb0f4d029b222894fa3ac65b, user.id=a6e9ee68ee0b49eb8844b80600872523, scope.system=all) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:33.570652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c505d-a744-4a52-b079-bb88d3d784ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:33.573053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c505d-a744-4a52-b079-bb88d3d784ed None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:33.584924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 161/330] 10.222.0.25 () {56 vars in 1308 bytes} [Tue May 10 21:01:33 2022] GET /identity/v3/role_assignments?user.id=a6e9ee68ee0b49eb8844b80600872523&scope.system=all&role.id=390d715fbb0f4d029b222894fa3ac65b => generated 510 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:33.585643 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c505d-a744-4a52-b079-bb88d3d784ed None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:33.683279 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990da7f9-f23a-4c5d-adc9-fe8ea975143e None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:33.690980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c505d-a744-4a52-b079-bb88d3d784ed None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:33.717491 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ed93f-aed2-460d-a02f-a320f0de5126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:33.718304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ed93f-aed2-460d-a02f-a320f0de5126 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:33.718618 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ed93f-aed2-460d-a02f-a320f0de5126 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:33.718891 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ed93f-aed2-460d-a02f-a320f0de5126 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:33.720124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ed93f-aed2-460d-a02f-a320f0de5126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:33.721683 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ed93f-aed2-460d-a02f-a320f0de5126 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:33.723558 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 170/331] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:33.726134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc48c2-16e2-4153-a23f-84b74e963498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:33.727068 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc48c2-16e2-4153-a23f-84b74e963498 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:33.727355 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc48c2-16e2-4153-a23f-84b74e963498 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:33.727631 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc48c2-16e2-4153-a23f-84b74e963498 None admin] PATH_INFO: `/v3/users/5dadb9188d524baf975d2a1d931ee896` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:33.729208 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ed93f-aed2-460d-a02f-a320f0de5126 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:33.729320 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc48c2-16e2-4153-a23f-84b74e963498 None admin] RBAC: Authorizing `identity:get_user(user_id=5dadb9188d524baf975d2a1d931ee896)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:33.730736 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc48c2-16e2-4153-a23f-84b74e963498 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:33.737034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 162/332] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:33 2022] GET /identity/v3/users/5dadb9188d524baf975d2a1d931ee896 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:33.738025 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc48c2-16e2-4153-a23f-84b74e963498 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:33.837785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ed93f-aed2-460d-a02f-a320f0de5126 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:33.849820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc48c2-16e2-4153-a23f-84b74e963498 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:33.870822 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b0649-0fa7-4e45-a908-506480909d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:33.871482 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b0649-0fa7-4e45-a908-506480909d56 None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:33.871763 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b0649-0fa7-4e45-a908-506480909d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:33.872038 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b0649-0fa7-4e45-a908-506480909d56 None admin] PATH_INFO: `/v3/groups` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:33.872721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b0649-0fa7-4e45-a908-506480909d56 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:33.874133 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b0649-0fa7-4e45-a908-506480909d56 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:33.886046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23aad1-61a4-491e-a77d-79fd563aee6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:33.886933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23aad1-61a4-491e-a77d-79fd563aee6c None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:33.887218 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23aad1-61a4-491e-a77d-79fd563aee6c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:33.896392 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23aad1-61a4-491e-a77d-79fd563aee6c None admin] PATH_INFO: `/v3/system/users/5dadb9188d524baf975d2a1d931ee896/roles/09fc23a294c748939513cefa3e91b27f` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:33.896392 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23aad1-61a4-491e-a77d-79fd563aee6c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5dadb9188d524baf975d2a1d931ee896, role_id=09fc23a294c748939513cefa3e91b27f)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:33.896392 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23aad1-61a4-491e-a77d-79fd563aee6c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:33.978012 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 171/333] 10.222.0.25 () {60 vars in 1134 bytes} [Tue May 10 21:01:33 2022] POST /identity/v3/groups => generated 226 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:01:33.995957 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 163/334] 10.222.0.25 () {58 vars in 1334 bytes} [Tue May 10 21:01:33 2022] PUT /identity/v3/system/users/5dadb9188d524baf975d2a1d931ee896/roles/09fc23a294c748939513cefa3e91b27f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:01:36.698383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3ab8f-8c84-4f05-a53c-34e850b1e463 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:36.699030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3ab8f-8c84-4f05-a53c-34e850b1e463 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:36.699030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3ab8f-8c84-4f05-a53c-34e850b1e463 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:36.700667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 172/335] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:36.706029 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1488a-b5ce-4c8b-b68b-913762f3d86f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:36.711312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1488a-b5ce-4c8b-b68b-913762f3d86f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:36.711312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1488a-b5ce-4c8b-b68b-913762f3d86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:36.711576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7297a-6a06-42a7-adff-4235c8e51f60 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:36.711820 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7297a-6a06-42a7-adff-4235c8e51f60 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:36.712100 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7297a-6a06-42a7-adff-4235c8e51f60 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:36.714190 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 173/336] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:01:36.731497 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-ede1488a-b5ce-4c8b-b68b-913762f3d86f None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:36.732700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ede1488a-b5ce-4c8b-b68b-913762f3d86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:36.747848 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d249563-7777-42ac-9135-4eccdd892a1b None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:36.748147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d249563-7777-42ac-9135-4eccdd892a1b None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:36.748424 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d249563-7777-42ac-9135-4eccdd892a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:36.774298 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-4d249563-7777-42ac-9135-4eccdd892a1b None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:36.776548 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4d249563-7777-42ac-9135-4eccdd892a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:36.834410 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 164/337] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:36.835774 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e67c00-67dc-4a9f-b83c-871ac1d8358f None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:36.836070 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e67c00-67dc-4a9f-b83c-871ac1d8358f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:36.836351 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e67c00-67dc-4a9f-b83c-871ac1d8358f None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:36.842295 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 165/338] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:36.861075 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431a9d3-c984-4d02-b5ad-9b0a0c997487 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:36.861075 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431a9d3-c984-4d02-b5ad-9b0a0c997487 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:36.861075 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431a9d3-c984-4d02-b5ad-9b0a0c997487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:36.881409 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 174/339] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:36.882342 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-3431a9d3-c984-4d02-b5ad-9b0a0c997487 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:36.883578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3431a9d3-c984-4d02-b5ad-9b0a0c997487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:36.889392 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d249563-7777-42ac-9135-4eccdd892a1b None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:37.033269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d249563-7777-42ac-9135-4eccdd892a1b None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:37.054793 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 166/340] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:37.055994 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431a9d3-c984-4d02-b5ad-9b0a0c997487 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:37.080081 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fb7b6-9eaf-4207-bb94-dc605a45e161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:37.082007 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fb7b6-9eaf-4207-bb94-dc605a45e161 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:37.083272 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fb7b6-9eaf-4207-bb94-dc605a45e161 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:37.083923 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fb7b6-9eaf-4207-bb94-dc605a45e161 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:37.109447 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fb7b6-9eaf-4207-bb94-dc605a45e161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:37.124062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-1e9fb7b6-9eaf-4207-bb94-dc605a45e161 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 21:01:37.124062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:37.124062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:37.124062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:37.124062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:37.124062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:37.124062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:37.124062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:37.124062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:37.124062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:37.124062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:37.124062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:37.124062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:37.124062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:37.124062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:37.124062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:37.125030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:37.125030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:37.125030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:37.125030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:37.125030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:37.125030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:37.125030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:37.125030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:37.125030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:37.125030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:37.125030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:37.125030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:37.125030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:37.125030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:37.125030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:37.125030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:37.125858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:37.125858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:37.125858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:37.125858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:37.125858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:37.125858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:37.125858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:37.125858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:37.125858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:37.125858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:37.125858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 21:01:37.125858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:37.131857 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 175/341] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:37.143399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fb7b6-9eaf-4207-bb94-dc605a45e161 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:37.266696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431a9d3-c984-4d02-b5ad-9b0a0c997487 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:37.337591 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fb7b6-9eaf-4207-bb94-dc605a45e161 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:37.342555 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be626580-8d96-4aef-ad10-f82928cbe901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:37.343381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be626580-8d96-4aef-ad10-f82928cbe901 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:37.343671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be626580-8d96-4aef-ad10-f82928cbe901 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:37.343952 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be626580-8d96-4aef-ad10-f82928cbe901 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:37.359553 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be626580-8d96-4aef-ad10-f82928cbe901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:37.367619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-be626580-8d96-4aef-ad10-f82928cbe901 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:37.367619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:37.367619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:37.367619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:37.367619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:37.367619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:37.367619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:37.367619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:37.367619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:37.367619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:37.367619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:37.367619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:37.367619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:37.367619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:37.367619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:37.367619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:37.368541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:37.368541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:37.368541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:37.368541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:37.368541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:37.368541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:37.368541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:37.368541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:37.368541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:37.368541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:37.368541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:37.368541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:37.368541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:37.368541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:37.368541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:37.368541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:37.370029 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:37.370029 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:37.370029 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:37.370029 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:37.370029 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:37.370029 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:37.370029 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:37.370029 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:37.370029 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:37.370029 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:37.370029 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:37.370029 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:37.370029 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 167/342] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:01:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:37.371742 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be626580-8d96-4aef-ad10-f82928cbe901 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:37.386594 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1875b8-8e4a-4811-9aac-c2043b030e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:37.387629 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1875b8-8e4a-4811-9aac-c2043b030e5d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:37.388116 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1875b8-8e4a-4811-9aac-c2043b030e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:37.388592 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1875b8-8e4a-4811-9aac-c2043b030e5d None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:37.389546 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1875b8-8e4a-4811-9aac-c2043b030e5d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:37.390060 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1875b8-8e4a-4811-9aac-c2043b030e5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:37.391663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1875b8-8e4a-4811-9aac-c2043b030e5d None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:37.406873 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 176/343] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:37.408084 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1875b8-8e4a-4811-9aac-c2043b030e5d None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:37.482878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be626580-8d96-4aef-ad10-f82928cbe901 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:37.517966 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fc31c-b664-43d2-b6fd-d3bbbccb3395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:37.519136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fc31c-b664-43d2-b6fd-d3bbbccb3395 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:37.519136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fc31c-b664-43d2-b6fd-d3bbbccb3395 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:37.519444 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fc31c-b664-43d2-b6fd-d3bbbccb3395 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:37.530104 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fc31c-b664-43d2-b6fd-d3bbbccb3395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:37.532725 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1875b8-8e4a-4811-9aac-c2043b030e5d None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:37.537956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-2b2fc31c-b664-43d2-b6fd-d3bbbccb3395 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:37.537956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:37.537956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:37.537956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:37.537956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:37.537956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:37.537956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:37.537956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:37.537956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:37.537956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:37.537956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:37.537956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:37.537956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:37.537956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:37.537956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:37.537956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:37.538991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:37.538991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:37.538991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:37.538991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:37.538991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:37.538991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:37.538991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:37.538991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:37.538991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:37.538991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:37.538991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:37.538991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:37.538991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:37.538991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:37.538991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:37.538991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:37.539820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:37.539820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:37.539820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:37.539820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:37.539820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:37.539820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:37.539820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:37.539820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:37.539820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:37.539820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:37.539820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:37.539820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:37.539820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 168/344] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:37.540511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fc31c-b664-43d2-b6fd-d3bbbccb3395 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:37.581482 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed96bd-ba4b-4310-a037-311096769cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:37.582668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed96bd-ba4b-4310-a037-311096769cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:37.583324 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed96bd-ba4b-4310-a037-311096769cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:37.583817 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed96bd-ba4b-4310-a037-311096769cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:37.584770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed96bd-ba4b-4310-a037-311096769cf1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:37.585278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed96bd-ba4b-4310-a037-311096769cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:37.587445 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed96bd-ba4b-4310-a037-311096769cf1 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:37.599639 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 177/345] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:01:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:37.601553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccbdcc-9a33-40ad-9de3-5b5f0823d050 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:37.602061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccbdcc-9a33-40ad-9de3-5b5f0823d050 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:37.602726 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccbdcc-9a33-40ad-9de3-5b5f0823d050 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:37.605165 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 178/346] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:37.606114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccbdcc-9a33-40ad-9de3-5b5f0823d050 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:37.661357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fc31c-b664-43d2-b6fd-d3bbbccb3395 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:37.710768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3d21b-6466-461d-849b-14b92706cc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:37.711669 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3d21b-6466-461d-849b-14b92706cc19 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:37.711952 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3d21b-6466-461d-849b-14b92706cc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:37.712227 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3d21b-6466-461d-849b-14b92706cc19 None admin] PATH_INFO: `/v3/users/5dadb9188d524baf975d2a1d931ee896` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:37.714513 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3d21b-6466-461d-849b-14b92706cc19 None admin] RBAC: Authorizing `identity:get_user(user_id=5dadb9188d524baf975d2a1d931ee896)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:37.715980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3d21b-6466-461d-849b-14b92706cc19 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:37.719080 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 169/347] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:01:37 2022] GET /identity/v3/users/5dadb9188d524baf975d2a1d931ee896 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:37.719958 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3d21b-6466-461d-849b-14b92706cc19 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:37.740105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccbdcc-9a33-40ad-9de3-5b5f0823d050 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:37.775505 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fa0d7-c2c3-4320-8fe7-3ca41b8db550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:37.776026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fa0d7-c2c3-4320-8fe7-3ca41b8db550 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:37.776313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fa0d7-c2c3-4320-8fe7-3ca41b8db550 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:37.776593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fa0d7-c2c3-4320-8fe7-3ca41b8db550 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:37.777358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77fa0d7-c2c3-4320-8fe7-3ca41b8db550 None admin] RBAC: Adding query filter params (name=member) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:37.777668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77fa0d7-c2c3-4320-8fe7-3ca41b8db550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:37.779072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77fa0d7-c2c3-4320-8fe7-3ca41b8db550 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:37.787997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 179/348] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:37.789320 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1eb75-2f6f-4900-807b-c3346c946bf6 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:37.789616 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1eb75-2f6f-4900-807b-c3346c946bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:37.789896 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1eb75-2f6f-4900-807b-c3346c946bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:37.809175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-f0e1eb75-2f6f-4900-807b-c3346c946bf6 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:37.810384 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-f0e1eb75-2f6f-4900-807b-c3346c946bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:37.826870 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3d21b-6466-461d-849b-14b92706cc19 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:37.862737 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27764ba5-5366-4a5c-9d3d-baf6483e3ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:37.863323 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27764ba5-5366-4a5c-9d3d-baf6483e3ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:37.863608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27764ba5-5366-4a5c-9d3d-baf6483e3ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:37.863884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27764ba5-5366-4a5c-9d3d-baf6483e3ad3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:37.880740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 180/349] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:37.881591 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1eb75-2f6f-4900-807b-c3346c946bf6 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:37.933403 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27764ba5-5366-4a5c-9d3d-baf6483e3ad3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:37.934912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27764ba5-5366-4a5c-9d3d-baf6483e3ad3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:38.010316 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1eb75-2f6f-4900-807b-c3346c946bf6 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:38.033031 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 170/350] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:38.033985 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27764ba5-5366-4a5c-9d3d-baf6483e3ad3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:38.049008 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6bc12-4747-433a-91a2-2c16aaeecb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:38.049693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6bc12-4747-433a-91a2-2c16aaeecb76 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:38.049981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6bc12-4747-433a-91a2-2c16aaeecb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:38.050257 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6bc12-4747-433a-91a2-2c16aaeecb76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:38.051160 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6bc12-4747-433a-91a2-2c16aaeecb76 None admin] RBAC: Adding query filter params (role.id=09fc23a294c748939513cefa3e91b27f, user.id=5dadb9188d524baf975d2a1d931ee896, scope.system=all) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:38.051477 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6bc12-4747-433a-91a2-2c16aaeecb76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:38.052963 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6bc12-4747-433a-91a2-2c16aaeecb76 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:38.066467 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 181/351] 10.222.0.25 () {56 vars in 1308 bytes} [Tue May 10 21:01:37 2022] GET /identity/v3/role_assignments?user.id=5dadb9188d524baf975d2a1d931ee896&scope.system=all&role.id=09fc23a294c748939513cefa3e91b27f => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:38.067211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6bc12-4747-433a-91a2-2c16aaeecb76 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:38.144709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27764ba5-5366-4a5c-9d3d-baf6483e3ad3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:38.175957 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6bc12-4747-433a-91a2-2c16aaeecb76 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:38.181076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a9b1b-1629-4607-b6ec-ec2004e7d7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:38.181840 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a9b1b-1629-4607-b6ec-ec2004e7d7fe None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:38.182059 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a9b1b-1629-4607-b6ec-ec2004e7d7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:38.182402 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a9b1b-1629-4607-b6ec-ec2004e7d7fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:38.213573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddab58-7e4e-494b-a1d8-c76214229a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:38.214556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddab58-7e4e-494b-a1d8-c76214229a4e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:38.214848 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddab58-7e4e-494b-a1d8-c76214229a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:38.215130 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddab58-7e4e-494b-a1d8-c76214229a4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:38.226576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bddab58-7e4e-494b-a1d8-c76214229a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:38.236606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-6bddab58-7e4e-494b-a1d8-c76214229a4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:38.236606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:38.236606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:38.236606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:38.236606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:38.236606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:38.236606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:38.236606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:38.236606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:38.236606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:38.236606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:38.236606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:38.236606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:38.236606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:38.236606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:38.236606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:38.237584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:38.237584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:38.237584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:38.237584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:38.237584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:38.237584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:38.237584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:38.237584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:38.237584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:38.237584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:38.237584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:38.237584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:38.237584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:38.237584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:38.237584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:38.237584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:38.238390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:38.238390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:38.238390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:38.238390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:38.238390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:38.238390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:38.238390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:38.238390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:38.238390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:38.238390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:38.238390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:38.238390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:38.238390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 182/352] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:38.239954 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddab58-7e4e-494b-a1d8-c76214229a4e None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:38.254215 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a9b1b-1629-4607-b6ec-ec2004e7d7fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:38.255713 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a9b1b-1629-4607-b6ec-ec2004e7d7fe None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:38.349011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddab58-7e4e-494b-a1d8-c76214229a4e None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:38.362787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 171/353] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:38.363582 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a9b1b-1629-4607-b6ec-ec2004e7d7fe None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:38.386804 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a23e3f-c5ee-4458-b0dd-ffb9d34e29f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:38.387699 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a23e3f-c5ee-4458-b0dd-ffb9d34e29f3 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:38.387988 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a23e3f-c5ee-4458-b0dd-ffb9d34e29f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:38.388269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a23e3f-c5ee-4458-b0dd-ffb9d34e29f3 None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:38.389529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a23e3f-c5ee-4458-b0dd-ffb9d34e29f3 None admin] RBAC: Authorizing `identity:get_project(project_id=f157df588b834944b8799b6d43e8319a)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:38.391052 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a23e3f-c5ee-4458-b0dd-ffb9d34e29f3 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:38.392999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 183/354] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:38 2022] GET /identity/v3/projects/f157df588b834944b8799b6d43e8319a => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:38.394078 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030dccd-e607-4f8b-8dba-cc3aa5a18fd1 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:38.394366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030dccd-e607-4f8b-8dba-cc3aa5a18fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:38.394673 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030dccd-e607-4f8b-8dba-cc3aa5a18fd1 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:38.395961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 184/355] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:38.396595 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030dccd-e607-4f8b-8dba-cc3aa5a18fd1 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:38.475348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a9b1b-1629-4607-b6ec-ec2004e7d7fe None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:38.522735 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030dccd-e607-4f8b-8dba-cc3aa5a18fd1 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:38.526132 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a79c2-652e-40cd-af8d-30a5615641bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:38.527751 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a79c2-652e-40cd-af8d-30a5615641bd None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:38.528038 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a79c2-652e-40cd-af8d-30a5615641bd None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:38.528318 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a79c2-652e-40cd-af8d-30a5615641bd None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:38.529084 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a79c2-652e-40cd-af8d-30a5615641bd None admin] RBAC: Adding query filter params (name=member) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:38.529393 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a79c2-652e-40cd-af8d-30a5615641bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:38.530799 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a79c2-652e-40cd-af8d-30a5615641bd None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:38.541565 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 172/356] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:38.543084 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ec870-a59b-472e-b342-9c14effc92d5 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:38.543380 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ec870-a59b-472e-b342-9c14effc92d5 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:38.543666 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ec870-a59b-472e-b342-9c14effc92d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:38.564163 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-0f9ec870-a59b-472e-b342-9c14effc92d5 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:38.565352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0f9ec870-a59b-472e-b342-9c14effc92d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:38.573419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0d633-3072-4d59-a93a-13d7b2574d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:38.574299 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0d633-3072-4d59-a93a-13d7b2574d90 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:38.574619 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0d633-3072-4d59-a93a-13d7b2574d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:38.574896 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0d633-3072-4d59-a93a-13d7b2574d90 None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:38.576134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0d633-3072-4d59-a93a-13d7b2574d90 None admin] RBAC: Authorizing `identity:get_project(project_id=f157df588b834944b8799b6d43e8319a)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:38.578787 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0d633-3072-4d59-a93a-13d7b2574d90 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:38.579320 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 185/357] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:38 2022] GET /identity/v3/projects/f157df588b834944b8799b6d43e8319a => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:38.580078 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0d633-3072-4d59-a93a-13d7b2574d90 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:38.655577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 173/358] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:38.657291 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ec870-a59b-472e-b342-9c14effc92d5 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:38.717471 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0d633-3072-4d59-a93a-13d7b2574d90 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:38.755358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3599a2a-660b-4794-bc90-7f6249e33691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:38.756245 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3599a2a-660b-4794-bc90-7f6249e33691 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:38.756530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3599a2a-660b-4794-bc90-7f6249e33691 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:38.756809 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3599a2a-660b-4794-bc90-7f6249e33691 None admin] PATH_INFO: `/v3/groups/a3f4283437d74c10b7c54a375b3a9656` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:38.768564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3599a2a-660b-4794-bc90-7f6249e33691 None admin] RBAC: Authorizing `identity:get_group(group_id=a3f4283437d74c10b7c54a375b3a9656)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:38.768564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3599a2a-660b-4794-bc90-7f6249e33691 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:38.769736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 186/359] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 10 21:01:38 2022] GET /identity/v3/groups/a3f4283437d74c10b7c54a375b3a9656 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:38.771229 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3599a2a-660b-4794-bc90-7f6249e33691 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:38.779354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ec870-a59b-472e-b342-9c14effc92d5 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:38.823667 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b51359-83ab-41dc-a696-5323919c2792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:38.824331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b51359-83ab-41dc-a696-5323919c2792 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:38.824627 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b51359-83ab-41dc-a696-5323919c2792 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:38.824898 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b51359-83ab-41dc-a696-5323919c2792 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:38.898307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3599a2a-660b-4794-bc90-7f6249e33691 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:38.909154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b51359-83ab-41dc-a696-5323919c2792 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:38.910963 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b51359-83ab-41dc-a696-5323919c2792 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:38.942502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c836cfe-bfdd-4e93-bfc2-a6cd0747408f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:38.943375 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c836cfe-bfdd-4e93-bfc2-a6cd0747408f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:38.943661 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c836cfe-bfdd-4e93-bfc2-a6cd0747408f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:38.943938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c836cfe-bfdd-4e93-bfc2-a6cd0747408f None admin] PATH_INFO: `/v3/groups/a3f4283437d74c10b7c54a375b3a9656` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:38.945151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c836cfe-bfdd-4e93-bfc2-a6cd0747408f None admin] RBAC: Authorizing `identity:get_group(group_id=a3f4283437d74c10b7c54a375b3a9656)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:38.946681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c836cfe-bfdd-4e93-bfc2-a6cd0747408f None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:38.949249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 187/360] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 10 21:01:38 2022] GET /identity/v3/groups/a3f4283437d74c10b7c54a375b3a9656 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:38.950029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c836cfe-bfdd-4e93-bfc2-a6cd0747408f None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:39.018767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 174/361] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:39.019723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b51359-83ab-41dc-a696-5323919c2792 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:39.060448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c836cfe-bfdd-4e93-bfc2-a6cd0747408f None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:39.101369 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2832d05-ea3d-490e-ab10-bf931b0de33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:39.102191 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2832d05-ea3d-490e-ab10-bf931b0de33d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:39.102497 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2832d05-ea3d-490e-ab10-bf931b0de33d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:39.103644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2832d05-ea3d-490e-ab10-bf931b0de33d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:39.114175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2832d05-ea3d-490e-ab10-bf931b0de33d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:39.123965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-d2832d05-ea3d-490e-ab10-bf931b0de33d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:39.123965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:39.123965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:39.123965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:39.123965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:39.123965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:39.123965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:39.123965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:39.123965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:39.123965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:39.123965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:39.123965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:39.123965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:39.123965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:39.123965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:39.123965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:39.124881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:39.124881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:39.124881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:39.124881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:39.124881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:39.124881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:39.124881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:39.124881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:39.124881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:39.124881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:39.124881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:39.124881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:39.124881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:39.124881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:39.124881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:39.124881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:39.125693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:39.125693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:39.125693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:39.125693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:39.125693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:39.125693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:39.125693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:39.125693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:39.125693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:39.125693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:39.125693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:39.125693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:39.125693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 188/362] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:01:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:39.130477 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2832d05-ea3d-490e-ab10-bf931b0de33d None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:39.133851 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b51359-83ab-41dc-a696-5323919c2792 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:39.173753 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c27030-12bd-4592-ae97-bc7638dbb371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:39.174333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c27030-12bd-4592-ae97-bc7638dbb371 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:39.174644 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c27030-12bd-4592-ae97-bc7638dbb371 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:39.174944 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c27030-12bd-4592-ae97-bc7638dbb371 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:39.175759 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c27030-12bd-4592-ae97-bc7638dbb371 None admin] RBAC: Adding query filter params (group.id=a3f4283437d74c10b7c54a375b3a9656, role.id=c1ddef32606649809bb218b686f472c5, scope.project.id=f157df588b834944b8799b6d43e8319a) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:39.176115 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c27030-12bd-4592-ae97-bc7638dbb371 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:39.177537 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c27030-12bd-4592-ae97-bc7638dbb371 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:39.186373 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 175/363] 10.222.0.25 () {56 vars in 1376 bytes} [Tue May 10 21:01:39 2022] GET /identity/v3/role_assignments?group.id=a3f4283437d74c10b7c54a375b3a9656&scope.project.id=f157df588b834944b8799b6d43e8319a&role.id=c1ddef32606649809bb218b686f472c5 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:39.187604 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240acdd0-5fda-4448-83b6-0b15ce55466b None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:39.187878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240acdd0-5fda-4448-83b6-0b15ce55466b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:39.188150 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240acdd0-5fda-4448-83b6-0b15ce55466b None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:39.189371 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 176/364] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:39.190051 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240acdd0-5fda-4448-83b6-0b15ce55466b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:39.252016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2832d05-ea3d-490e-ab10-bf931b0de33d None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:39.299074 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0cd20-ba81-4a3b-b115-a3fbc162c1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:39.299784 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0cd20-ba81-4a3b-b115-a3fbc162c1bb None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:39.300030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0cd20-ba81-4a3b-b115-a3fbc162c1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:39.300305 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0cd20-ba81-4a3b-b115-a3fbc162c1bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:39.301152 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0cd20-ba81-4a3b-b115-a3fbc162c1bb None admin] RBAC: Adding query filter params (group.id=a3f4283437d74c10b7c54a375b3a9656, role.id=390d715fbb0f4d029b222894fa3ac65b, scope.project.id=f157df588b834944b8799b6d43e8319a) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:39.301515 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0cd20-ba81-4a3b-b115-a3fbc162c1bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:39.302963 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0cd20-ba81-4a3b-b115-a3fbc162c1bb None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:39.310841 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 189/365] 10.222.0.25 () {56 vars in 1376 bytes} [Tue May 10 21:01:39 2022] GET /identity/v3/role_assignments?group.id=a3f4283437d74c10b7c54a375b3a9656&scope.project.id=f157df588b834944b8799b6d43e8319a&role.id=390d715fbb0f4d029b222894fa3ac65b => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:39.312050 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0cd20-ba81-4a3b-b115-a3fbc162c1bb None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:39.329182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240acdd0-5fda-4448-83b6-0b15ce55466b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:39.381043 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be95d37-43f8-4a9e-b8ae-bf32b80f1a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:39.381999 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be95d37-43f8-4a9e-b8ae-bf32b80f1a12 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:39.382282 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be95d37-43f8-4a9e-b8ae-bf32b80f1a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:39.383143 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be95d37-43f8-4a9e-b8ae-bf32b80f1a12 None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:39.384941 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be95d37-43f8-4a9e-b8ae-bf32b80f1a12 None admin] RBAC: Authorizing `identity:get_project(project_id=5149a355272344e6928de24fc5261d16)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:39.387167 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be95d37-43f8-4a9e-b8ae-bf32b80f1a12 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:39.390315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 177/366] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:39 2022] GET /identity/v3/projects/5149a355272344e6928de24fc5261d16 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:39.391695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e5cde-eb28-4547-892f-37526a626927 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:39.391982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e5cde-eb28-4547-892f-37526a626927 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:39.392260 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e5cde-eb28-4547-892f-37526a626927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:39.422237 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-e40e5cde-eb28-4547-892f-37526a626927 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:39.427149 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e40e5cde-eb28-4547-892f-37526a626927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:39.471793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0cd20-ba81-4a3b-b115-a3fbc162c1bb None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:39.510401 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 178/367] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:39.511695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e5cde-eb28-4547-892f-37526a626927 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:39.517083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116235ab-4ce7-4a28-a285-cfeb85f55162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:39.518173 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116235ab-4ce7-4a28-a285-cfeb85f55162 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:39.518173 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116235ab-4ce7-4a28-a285-cfeb85f55162 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:39.518370 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116235ab-4ce7-4a28-a285-cfeb85f55162 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:39.519129 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116235ab-4ce7-4a28-a285-cfeb85f55162 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:39.519440 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116235ab-4ce7-4a28-a285-cfeb85f55162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:39.520809 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116235ab-4ce7-4a28-a285-cfeb85f55162 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:39.538257 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 190/368] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:01:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:39.538975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116235ab-4ce7-4a28-a285-cfeb85f55162 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:39.645451 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e5cde-eb28-4547-892f-37526a626927 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:39.675988 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116235ab-4ce7-4a28-a285-cfeb85f55162 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:39.683224 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d508005-8560-4b03-8434-79ef40f5ca7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:39.684033 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d508005-8560-4b03-8434-79ef40f5ca7d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:39.684320 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d508005-8560-4b03-8434-79ef40f5ca7d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:39.684598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d508005-8560-4b03-8434-79ef40f5ca7d None admin] PATH_INFO: `/v3/groups/a3f4283437d74c10b7c54a375b3a9656` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:39.685781 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d508005-8560-4b03-8434-79ef40f5ca7d None admin] RBAC: Authorizing `identity:get_group(group_id=a3f4283437d74c10b7c54a375b3a9656)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:39.687300 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d508005-8560-4b03-8434-79ef40f5ca7d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:39.689094 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 179/369] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 10 21:01:39 2022] GET /identity/v3/groups/a3f4283437d74c10b7c54a375b3a9656 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:39.690867 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d508005-8560-4b03-8434-79ef40f5ca7d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:39.719737 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac430636-63f7-47c7-a38d-3367cc1cadfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:39.720590 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac430636-63f7-47c7-a38d-3367cc1cadfa None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:39.720886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac430636-63f7-47c7-a38d-3367cc1cadfa None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:39.721173 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac430636-63f7-47c7-a38d-3367cc1cadfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:39.732722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac430636-63f7-47c7-a38d-3367cc1cadfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:39.741976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-ac430636-63f7-47c7-a38d-3367cc1cadfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:01:39.741976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:39.741976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:39.741976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:39.741976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:39.741976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:39.741976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:39.741976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:39.741976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:39.741976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:39.741976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:39.741976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:39.741976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:39.741976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:39.741976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:39.741976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:39.743029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:39.743029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:39.743029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:39.743029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:39.743029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:39.743029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:39.743029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:39.743029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:39.743029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:39.743029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:39.743029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:39.743029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:39.743029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:39.743029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:39.743029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:39.743029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:39.743858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:39.743858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:39.743858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:39.743858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:39.743858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:39.743858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:39.743858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:39.743858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:39.743858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:39.743858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:39.743858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:01:39.743858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:39.743858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 191/370] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:01:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:39.744531 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac430636-63f7-47c7-a38d-3367cc1cadfa None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:39.810615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d508005-8560-4b03-8434-79ef40f5ca7d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:39.856869 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a60da-49db-4569-8b88-4645b0b5995c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:39.856869 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a60da-49db-4569-8b88-4645b0b5995c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:39.856869 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a60da-49db-4569-8b88-4645b0b5995c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:39.856869 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a60da-49db-4569-8b88-4645b0b5995c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:39.866334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac430636-63f7-47c7-a38d-3367cc1cadfa None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:39.902828 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f219ebf-3330-4ba2-bc39-73031d4188fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:39.903495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f219ebf-3330-4ba2-bc39-73031d4188fa None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:39.903778 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f219ebf-3330-4ba2-bc39-73031d4188fa None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:39.904055 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f219ebf-3330-4ba2-bc39-73031d4188fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:39.904899 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f219ebf-3330-4ba2-bc39-73031d4188fa None admin] RBAC: Adding query filter params (group.id=a3f4283437d74c10b7c54a375b3a9656, role.id=390d715fbb0f4d029b222894fa3ac65b, scope.project.id=5149a355272344e6928de24fc5261d16) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:39.905209 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f219ebf-3330-4ba2-bc39-73031d4188fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:39.906734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f219ebf-3330-4ba2-bc39-73031d4188fa None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:39.912841 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 192/371] 10.222.0.25 () {56 vars in 1376 bytes} [Tue May 10 21:01:39 2022] GET /identity/v3/role_assignments?group.id=a3f4283437d74c10b7c54a375b3a9656&scope.project.id=5149a355272344e6928de24fc5261d16&role.id=390d715fbb0f4d029b222894fa3ac65b => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:39.913773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f219ebf-3330-4ba2-bc39-73031d4188fa None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:39.936532 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a60da-49db-4569-8b88-4645b0b5995c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:39.937920 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a60da-49db-4569-8b88-4645b0b5995c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:40.040566 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f219ebf-3330-4ba2-bc39-73031d4188fa None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:40.065054 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 180/372] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:40.070659 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a60da-49db-4569-8b88-4645b0b5995c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:40.079546 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750cae9c-a1c4-47ea-a084-952e67a70bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:40.080304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cae9c-a1c4-47ea-a084-952e67a70bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:40.080588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cae9c-a1c4-47ea-a084-952e67a70bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:40.080915 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cae9c-a1c4-47ea-a084-952e67a70bd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:40.081748 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750cae9c-a1c4-47ea-a084-952e67a70bd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:40.082063 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750cae9c-a1c4-47ea-a084-952e67a70bd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:40.083524 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750cae9c-a1c4-47ea-a084-952e67a70bd8 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:40.093313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 193/373] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:40.101429 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750cae9c-a1c4-47ea-a084-952e67a70bd8 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:40.193105 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a60da-49db-4569-8b88-4645b0b5995c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:40.235557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab64fc3-9c07-45de-8262-5475b2ce1afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:40.236437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab64fc3-9c07-45de-8262-5475b2ce1afa None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:40.236719 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab64fc3-9c07-45de-8262-5475b2ce1afa None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:40.236994 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab64fc3-9c07-45de-8262-5475b2ce1afa None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:40.238243 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab64fc3-9c07-45de-8262-5475b2ce1afa None admin] RBAC: Authorizing `identity:get_project(project_id=5149a355272344e6928de24fc5261d16)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:40.240220 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab64fc3-9c07-45de-8262-5475b2ce1afa None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:40.242481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 181/374] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:40 2022] GET /identity/v3/projects/5149a355272344e6928de24fc5261d16 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:40.249037 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab64fc3-9c07-45de-8262-5475b2ce1afa None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:40.305632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750cae9c-a1c4-47ea-a084-952e67a70bd8 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:40.344565 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3a4d1-afc1-408e-8de3-920782c7c58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:40.345230 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3a4d1-afc1-408e-8de3-920782c7c58f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:40.345516 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3a4d1-afc1-408e-8de3-920782c7c58f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:40.345795 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3a4d1-afc1-408e-8de3-920782c7c58f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:40.366726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab64fc3-9c07-45de-8262-5475b2ce1afa None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:40.408935 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0eb76-6f96-44f0-a0e4-0895b934ea16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:40.409943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0eb76-6f96-44f0-a0e4-0895b934ea16 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:40.410378 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0eb76-6f96-44f0-a0e4-0895b934ea16 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:40.410689 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0eb76-6f96-44f0-a0e4-0895b934ea16 None admin] PATH_INFO: `/v3/groups/a3f4283437d74c10b7c54a375b3a9656` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:40.412237 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0eb76-6f96-44f0-a0e4-0895b934ea16 None admin] RBAC: Authorizing `identity:get_group(group_id=a3f4283437d74c10b7c54a375b3a9656)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:40.414114 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0eb76-6f96-44f0-a0e4-0895b934ea16 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:40.417382 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 182/375] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 10 21:01:40 2022] GET /identity/v3/groups/a3f4283437d74c10b7c54a375b3a9656 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:40.423157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0eb76-6f96-44f0-a0e4-0895b934ea16 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:40.425806 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3a4d1-afc1-408e-8de3-920782c7c58f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:40.427406 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3a4d1-afc1-408e-8de3-920782c7c58f None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:40.530399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 194/376] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:40.539429 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3a4d1-afc1-408e-8de3-920782c7c58f None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:40.550059 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0eb76-6f96-44f0-a0e4-0895b934ea16 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:40.596080 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5d2cb-c4fb-4301-a0b5-794fe5b4f517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:40.596743 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5d2cb-c4fb-4301-a0b5-794fe5b4f517 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:40.597028 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5d2cb-c4fb-4301-a0b5-794fe5b4f517 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:40.597304 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5d2cb-c4fb-4301-a0b5-794fe5b4f517 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:40.598150 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5d2cb-c4fb-4301-a0b5-794fe5b4f517 None admin] RBAC: Adding query filter params (group.id=a3f4283437d74c10b7c54a375b3a9656, role.id=c1ddef32606649809bb218b686f472c5, scope.project.id=5149a355272344e6928de24fc5261d16) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:40.598472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5d2cb-c4fb-4301-a0b5-794fe5b4f517 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:40.599913 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5d2cb-c4fb-4301-a0b5-794fe5b4f517 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:40.612823 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 183/377] 10.222.0.25 () {56 vars in 1376 bytes} [Tue May 10 21:01:40 2022] GET /identity/v3/role_assignments?group.id=a3f4283437d74c10b7c54a375b3a9656&scope.project.id=5149a355272344e6928de24fc5261d16&role.id=c1ddef32606649809bb218b686f472c5 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:40.671997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3a4d1-afc1-408e-8de3-920782c7c58f None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:40.708980 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad01cb-04ce-44a6-ac3f-4cff6953e938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:40.709860 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad01cb-04ce-44a6-ac3f-4cff6953e938 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:40.710140 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad01cb-04ce-44a6-ac3f-4cff6953e938 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:40.710413 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad01cb-04ce-44a6-ac3f-4cff6953e938 None admin] PATH_INFO: `/v3/projects/3ea6acf0b7844ccca48ba57f57c13860` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:40.711704 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad01cb-04ce-44a6-ac3f-4cff6953e938 None admin] RBAC: Authorizing `identity:get_project(project_id=3ea6acf0b7844ccca48ba57f57c13860)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:40.713755 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad01cb-04ce-44a6-ac3f-4cff6953e938 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:40.715882 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 195/378] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:40 2022] GET /identity/v3/projects/3ea6acf0b7844ccca48ba57f57c13860 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:40.722376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5d2cb-c4fb-4301-a0b5-794fe5b4f517 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:40.866694 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5d2cb-c4fb-4301-a0b5-794fe5b4f517 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:40.905991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc4e94-3ac1-48c6-940a-19df6bb73d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:40.906893 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc4e94-3ac1-48c6-940a-19df6bb73d98 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:40.907173 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc4e94-3ac1-48c6-940a-19df6bb73d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:40.907445 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc4e94-3ac1-48c6-940a-19df6bb73d98 None admin] PATH_INFO: `/v3/groups/f7bf5665cd0849e39488e1358e3569db` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:40.915814 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc4e94-3ac1-48c6-940a-19df6bb73d98 None admin] RBAC: Authorizing `identity:get_group(group_id=f7bf5665cd0849e39488e1358e3569db)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:40.917341 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc4e94-3ac1-48c6-940a-19df6bb73d98 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:40.919863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 184/379] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 10 21:01:40 2022] GET /identity/v3/groups/f7bf5665cd0849e39488e1358e3569db => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:40.925999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad01cb-04ce-44a6-ac3f-4cff6953e938 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:41.073448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad01cb-04ce-44a6-ac3f-4cff6953e938 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:41.121851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88763d-595f-4d2d-bb91-2ff28ba0699d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:41.122955 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88763d-595f-4d2d-bb91-2ff28ba0699d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:41.123486 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88763d-595f-4d2d-bb91-2ff28ba0699d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:41.123975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88763d-595f-4d2d-bb91-2ff28ba0699d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:41.125011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88763d-595f-4d2d-bb91-2ff28ba0699d None admin] RBAC: Adding query filter params (group.id=f7bf5665cd0849e39488e1358e3569db, role.id=5cd001edc58744738aa57180c0be68a9, scope.project.id=3ea6acf0b7844ccca48ba57f57c13860) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:41.125534 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88763d-595f-4d2d-bb91-2ff28ba0699d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:41.127186 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88763d-595f-4d2d-bb91-2ff28ba0699d None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:41.138557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 196/380] 10.222.0.25 () {56 vars in 1376 bytes} [Tue May 10 21:01:40 2022] GET /identity/v3/role_assignments?group.id=f7bf5665cd0849e39488e1358e3569db&scope.project.id=3ea6acf0b7844ccca48ba57f57c13860&role.id=5cd001edc58744738aa57180c0be68a9 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:41.953325 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1366e9-1fd6-43f0-9fbb-51beaabcef84 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:41.953838 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1366e9-1fd6-43f0-9fbb-51beaabcef84 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:41.953915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1366e9-1fd6-43f0-9fbb-51beaabcef84 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:41.955539 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 185/381] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:41.961669 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c0690-9833-4873-a741-17803cb7d158 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:41.963111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c0690-9833-4873-a741-17803cb7d158 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:41.963602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c0690-9833-4873-a741-17803cb7d158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:41.985897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-755c0690-9833-4873-a741-17803cb7d158 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:41.987476 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-755c0690-9833-4873-a741-17803cb7d158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:42.027343 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515f999-c571-47b5-94c4-6a2992e611a2 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:42.027969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515f999-c571-47b5-94c4-6a2992e611a2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:42.028446 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515f999-c571-47b5-94c4-6a2992e611a2 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:42.031449 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 186/382] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:01:42.037273 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5a5f9-e43b-4fa8-897f-2e6eb1505332 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:42.037862 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5a5f9-e43b-4fa8-897f-2e6eb1505332 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:42.038342 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5a5f9-e43b-4fa8-897f-2e6eb1505332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:42.056967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b2e5a5f9-e43b-4fa8-897f-2e6eb1505332 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:42.058534 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b2e5a5f9-e43b-4fa8-897f-2e6eb1505332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:42.068086 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 197/383] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:42.093419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c0690-9833-4873-a741-17803cb7d158 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:42.134921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 187/384] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:01:42.154314 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5a5f9-e43b-4fa8-897f-2e6eb1505332 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:42.195224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c0690-9833-4873-a741-17803cb7d158 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:42.231324 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551be105-89b0-4f3f-a85e-e22264b9f465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:42.232142 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551be105-89b0-4f3f-a85e-e22264b9f465 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:42.232428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551be105-89b0-4f3f-a85e-e22264b9f465 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:42.232713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551be105-89b0-4f3f-a85e-e22264b9f465 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:42.243428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551be105-89b0-4f3f-a85e-e22264b9f465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:42.251838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-551be105-89b0-4f3f-a85e-e22264b9f465 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:42.251838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:42.251838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:42.251838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:42.251838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:42.251838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:42.251838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:42.251838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:42.251838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:42.251838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:42.251838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:42.251838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:42.251838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:42.251838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:42.251838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:42.251838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:42.252754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:42.252754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:42.252754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:42.252754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:42.252754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:42.252754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:42.252754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:42.252754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:42.252754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:42.252754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:42.252754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:42.252754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:42.252754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:42.252754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:42.252754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:42.252754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:42.253991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:42.253991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:42.253991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:42.253991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:42.253991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:42.253991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:42.253991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:42.253991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:42.253991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:42.253991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:42.253991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:42.253991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:42.253991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 198/385] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:42.258901 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551be105-89b0-4f3f-a85e-e22264b9f465 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:42.261592 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5a5f9-e43b-4fa8-897f-2e6eb1505332 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:42.297442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd229f3-96db-420f-9870-7bd32eba2491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:42.298999 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd229f3-96db-420f-9870-7bd32eba2491 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:42.299485 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd229f3-96db-420f-9870-7bd32eba2491 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:42.299990 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd229f3-96db-420f-9870-7bd32eba2491 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:42.311481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd229f3-96db-420f-9870-7bd32eba2491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:42.320182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-2fd229f3-96db-420f-9870-7bd32eba2491 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:42.320182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:42.320182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:42.320182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:42.320182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:42.320182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:42.320182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:42.320182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:42.320182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:42.320182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:42.320182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:42.320182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:42.320182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:42.320182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:42.320182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:42.320182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:42.321067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:42.321067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:42.321067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:42.321067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:42.321067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:42.321067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:42.321067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:42.321067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:42.321067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:42.321067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:42.321067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:42.321067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:42.321067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:42.321067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:42.321067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:42.321067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:42.321933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:42.321933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:42.321933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:42.321933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:42.321933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:42.321933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:42.321933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:42.321933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:42.321933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:42.321933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:42.321933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:42.321933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:42.325648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 188/386] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:01:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:42.332383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd229f3-96db-420f-9870-7bd32eba2491 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:42.363680 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551be105-89b0-4f3f-a85e-e22264b9f465 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:42.398744 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61614b-b982-41fc-b3f6-cd41cedfb9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:42.399420 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61614b-b982-41fc-b3f6-cd41cedfb9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:42.399709 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61614b-b982-41fc-b3f6-cd41cedfb9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:42.400022 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61614b-b982-41fc-b3f6-cd41cedfb9c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:42.401360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61614b-b982-41fc-b3f6-cd41cedfb9c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:42.401360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61614b-b982-41fc-b3f6-cd41cedfb9c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:42.402699 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61614b-b982-41fc-b3f6-cd41cedfb9c0 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:42.411885 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 199/387] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:42.418088 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61614b-b982-41fc-b3f6-cd41cedfb9c0 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:42.438648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd229f3-96db-420f-9870-7bd32eba2491 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:42.474406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a66cc-974e-42a9-b090-72d1385f32bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:42.475569 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a66cc-974e-42a9-b090-72d1385f32bb None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:42.476112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a66cc-974e-42a9-b090-72d1385f32bb None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:42.476598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a66cc-974e-42a9-b090-72d1385f32bb None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:42.477576 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a66cc-974e-42a9-b090-72d1385f32bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:42.478755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a66cc-974e-42a9-b090-72d1385f32bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:42.480514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a66cc-974e-42a9-b090-72d1385f32bb None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:42.494575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 189/388] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:01:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:42.496781 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a66cc-974e-42a9-b090-72d1385f32bb None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:42.524148 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61614b-b982-41fc-b3f6-cd41cedfb9c0 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:42.559705 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8b9db-141b-4ab4-af30-c782258c8db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:42.560506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8b9db-141b-4ab4-af30-c782258c8db2 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:42.560800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8b9db-141b-4ab4-af30-c782258c8db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:42.561133 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8b9db-141b-4ab4-af30-c782258c8db2 None admin] PATH_INFO: `/v3/groups/a3f4283437d74c10b7c54a375b3a9656` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:42.562281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8b9db-141b-4ab4-af30-c782258c8db2 None admin] RBAC: Authorizing `identity:get_group(group_id=a3f4283437d74c10b7c54a375b3a9656)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:42.563794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8b9db-141b-4ab4-af30-c782258c8db2 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:42.565675 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 200/389] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 10 21:01:42 2022] GET /identity/v3/groups/a3f4283437d74c10b7c54a375b3a9656 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:42.571013 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8b9db-141b-4ab4-af30-c782258c8db2 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:42.604531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a66cc-974e-42a9-b090-72d1385f32bb None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:42.639100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a78ee8-1331-4305-a278-e68899ebca2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:42.640346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a78ee8-1331-4305-a278-e68899ebca2f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:42.640829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a78ee8-1331-4305-a278-e68899ebca2f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:42.641303 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a78ee8-1331-4305-a278-e68899ebca2f None admin] PATH_INFO: `/v3/groups/a3f4283437d74c10b7c54a375b3a9656` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:42.642841 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a78ee8-1331-4305-a278-e68899ebca2f None admin] RBAC: Authorizing `identity:get_group(group_id=a3f4283437d74c10b7c54a375b3a9656)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:42.644503 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a78ee8-1331-4305-a278-e68899ebca2f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:42.650557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 190/390] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 10 21:01:42 2022] GET /identity/v3/groups/a3f4283437d74c10b7c54a375b3a9656 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:42.653066 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a78ee8-1331-4305-a278-e68899ebca2f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:42.676543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8b9db-141b-4ab4-af30-c782258c8db2 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:42.711096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc6d06-1f83-430e-a43f-44147cbf63e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:42.711981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc6d06-1f83-430e-a43f-44147cbf63e5 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:42.712247 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc6d06-1f83-430e-a43f-44147cbf63e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:42.713075 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc6d06-1f83-430e-a43f-44147cbf63e5 None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:42.714478 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc6d06-1f83-430e-a43f-44147cbf63e5 None admin] RBAC: Authorizing `identity:get_project(project_id=f157df588b834944b8799b6d43e8319a)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:42.715945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc6d06-1f83-430e-a43f-44147cbf63e5 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:42.717922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 201/391] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:42 2022] GET /identity/v3/projects/f157df588b834944b8799b6d43e8319a => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:42.723372 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc6d06-1f83-430e-a43f-44147cbf63e5 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:42.760367 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a78ee8-1331-4305-a278-e68899ebca2f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:42.796654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e39df3-ec85-4667-ad12-71dcd9288400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:42.798198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e39df3-ec85-4667-ad12-71dcd9288400 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:42.798762 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e39df3-ec85-4667-ad12-71dcd9288400 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:42.799236 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e39df3-ec85-4667-ad12-71dcd9288400 None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:42.800672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e39df3-ec85-4667-ad12-71dcd9288400 None admin] RBAC: Authorizing `identity:get_project(project_id=f157df588b834944b8799b6d43e8319a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:42.802385 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e39df3-ec85-4667-ad12-71dcd9288400 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:42.809365 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 191/392] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:42 2022] GET /identity/v3/projects/f157df588b834944b8799b6d43e8319a => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:42.810939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e39df3-ec85-4667-ad12-71dcd9288400 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:42.828780 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc6d06-1f83-430e-a43f-44147cbf63e5 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:42.876217 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03fe29-f1d6-416d-a9f2-206d4d9cb1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:42.876862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03fe29-f1d6-416d-a9f2-206d4d9cb1c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:42.877146 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03fe29-f1d6-416d-a9f2-206d4d9cb1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:42.877422 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03fe29-f1d6-416d-a9f2-206d4d9cb1c4 None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a/groups/a3f4283437d74c10b7c54a375b3a9656/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:42.879502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03fe29-f1d6-416d-a9f2-206d4d9cb1c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f157df588b834944b8799b6d43e8319a, group_id=a3f4283437d74c10b7c54a375b3a9656, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:42.880940 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03fe29-f1d6-416d-a9f2-206d4d9cb1c4 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:42.923292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e39df3-ec85-4667-ad12-71dcd9288400 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:42.960062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 202/393] 10.222.0.25 () {58 vars in 1442 bytes} [Tue May 10 21:01:42 2022] PUT /identity/v3/projects/f157df588b834944b8799b6d43e8319a/groups/a3f4283437d74c10b7c54a375b3a9656/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:01:42.975760 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868f243-a948-43c3-9883-decc70010255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:42.976742 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868f243-a948-43c3-9883-decc70010255 None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:42.977043 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868f243-a948-43c3-9883-decc70010255 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:42.977326 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868f243-a948-43c3-9883-decc70010255 None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a/groups/a3f4283437d74c10b7c54a375b3a9656/roles/c1ddef32606649809bb218b686f472c5` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:42.980025 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868f243-a948-43c3-9883-decc70010255 None admin] RBAC: Authorizing `identity:create_grant(project_id=f157df588b834944b8799b6d43e8319a, group_id=a3f4283437d74c10b7c54a375b3a9656, role_id=c1ddef32606649809bb218b686f472c5)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:42.981658 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868f243-a948-43c3-9883-decc70010255 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:43.069789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 192/394] 10.222.0.25 () {58 vars in 1442 bytes} [Tue May 10 21:01:42 2022] PUT /identity/v3/projects/f157df588b834944b8799b6d43e8319a/groups/a3f4283437d74c10b7c54a375b3a9656/roles/c1ddef32606649809bb218b686f472c5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:01:43.140062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18d92b-6a9f-40f0-b365-337ff6190923 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:43.140586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18d92b-6a9f-40f0-b365-337ff6190923 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:43.140704 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18d92b-6a9f-40f0-b365-337ff6190923 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:43.142351 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 203/395] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:43.148483 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291722c-792a-47ab-a180-a8e03f15056d None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:43.148787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291722c-792a-47ab-a180-a8e03f15056d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:43.149069 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291722c-792a-47ab-a180-a8e03f15056d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:43.168178 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6291722c-792a-47ab-a180-a8e03f15056d None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:43.169423 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6291722c-792a-47ab-a180-a8e03f15056d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:43.250712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 193/396] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:01:43.273338 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18d92b-6a9f-40f0-b365-337ff6190923 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:43.398400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18d92b-6a9f-40f0-b365-337ff6190923 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:43.438712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c8775-19af-4521-a048-c4c7aeea3b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:43.439573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c8775-19af-4521-a048-c4c7aeea3b22 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:43.439862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c8775-19af-4521-a048-c4c7aeea3b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:43.440139 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c8775-19af-4521-a048-c4c7aeea3b22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:43.454261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c8775-19af-4521-a048-c4c7aeea3b22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:43.462224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-8a6c8775-19af-4521-a048-c4c7aeea3b22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:43.462224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:43.462224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:43.462224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:43.462224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:43.462224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:43.462224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:43.462224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:43.462224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:43.462224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:43.462224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:43.462224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:43.462224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:43.462224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:43.462224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:43.462224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:43.464323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:43.464323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:43.464323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:43.464323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:43.464323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:43.464323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:43.464323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:43.464323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:43.464323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:43.464323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:43.464323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:43.464323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:43.464323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:43.464323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:43.464323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:43.464323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:43.465905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:43.465905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:43.465905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:43.465905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:43.465905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:43.465905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:43.465905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:43.465905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:43.465905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:43.465905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:43.465905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:43.465905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:43.465905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 204/397] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:43.470491 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291722c-792a-47ab-a180-a8e03f15056d None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:43.579938 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291722c-792a-47ab-a180-a8e03f15056d None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:43.617949 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079b8e0-534d-47b5-95db-0e611b4bf1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:43.619228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079b8e0-534d-47b5-95db-0e611b4bf1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:43.619649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079b8e0-534d-47b5-95db-0e611b4bf1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:43.620162 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079b8e0-534d-47b5-95db-0e611b4bf1b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:43.620992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079b8e0-534d-47b5-95db-0e611b4bf1b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:43.621306 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079b8e0-534d-47b5-95db-0e611b4bf1b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:43.622751 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079b8e0-534d-47b5-95db-0e611b4bf1b9 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:43.639525 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c8775-19af-4521-a048-c4c7aeea3b22 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:43.640572 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 194/398] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:43.773716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c8775-19af-4521-a048-c4c7aeea3b22 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:43.816557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99902dc-2eb9-4f8c-809e-e8e879387d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:43.817448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99902dc-2eb9-4f8c-809e-e8e879387d1a None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:43.817731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99902dc-2eb9-4f8c-809e-e8e879387d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:43.818012 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99902dc-2eb9-4f8c-809e-e8e879387d1a None admin] PATH_INFO: `/v3/groups/a3f4283437d74c10b7c54a375b3a9656` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:43.819260 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99902dc-2eb9-4f8c-809e-e8e879387d1a None admin] RBAC: Authorizing `identity:get_group(group_id=a3f4283437d74c10b7c54a375b3a9656)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:43.820705 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99902dc-2eb9-4f8c-809e-e8e879387d1a None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:43.823285 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 205/399] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 10 21:01:43 2022] GET /identity/v3/groups/a3f4283437d74c10b7c54a375b3a9656 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:43.831699 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079b8e0-534d-47b5-95db-0e611b4bf1b9 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:44.000984 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079b8e0-534d-47b5-95db-0e611b4bf1b9 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:44.064096 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0633d9-9fa5-4cbc-92b4-5c55acc6dff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:44.064978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0633d9-9fa5-4cbc-92b4-5c55acc6dff8 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:44.065266 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0633d9-9fa5-4cbc-92b4-5c55acc6dff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:44.065542 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0633d9-9fa5-4cbc-92b4-5c55acc6dff8 None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:44.066797 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0633d9-9fa5-4cbc-92b4-5c55acc6dff8 None admin] RBAC: Authorizing `identity:get_project(project_id=5149a355272344e6928de24fc5261d16)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:44.071273 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0633d9-9fa5-4cbc-92b4-5c55acc6dff8 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:44.073866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 195/400] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:43 2022] GET /identity/v3/projects/5149a355272344e6928de24fc5261d16 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:44.083593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99902dc-2eb9-4f8c-809e-e8e879387d1a None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:44.089267 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f749e1-f402-4647-a6e7-eb8b3435e4e8 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:44.089563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f749e1-f402-4647-a6e7-eb8b3435e4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:44.089849 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f749e1-f402-4647-a6e7-eb8b3435e4e8 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:44.091506 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 196/401] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:01:44.099770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9edb42-627a-4a8e-848c-2901dbdcf8a5 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:44.100060 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9edb42-627a-4a8e-848c-2901dbdcf8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:44.100345 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9edb42-627a-4a8e-848c-2901dbdcf8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:44.130677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-5b9edb42-627a-4a8e-848c-2901dbdcf8a5 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:44.131913 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5b9edb42-627a-4a8e-848c-2901dbdcf8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:44.214990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99902dc-2eb9-4f8c-809e-e8e879387d1a None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:44.275308 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2bc15-c570-445a-9634-ceff599028bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:44.276495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2bc15-c570-445a-9634-ceff599028bd None admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:44.276785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2bc15-c570-445a-9634-ceff599028bd None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:44.277068 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2bc15-c570-445a-9634-ceff599028bd None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16/groups/a3f4283437d74c10b7c54a375b3a9656/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:44.285711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2bc15-c570-445a-9634-ceff599028bd None admin] RBAC: Authorizing `identity:create_grant(project_id=5149a355272344e6928de24fc5261d16, group_id=a3f4283437d74c10b7c54a375b3a9656, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:44.287233 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2bc15-c570-445a-9634-ceff599028bd None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:44.325157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 197/402] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:44.349047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9edb42-627a-4a8e-848c-2901dbdcf8a5 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:44.394510 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 206/403] 10.222.0.25 () {58 vars in 1442 bytes} [Tue May 10 21:01:44 2022] PUT /identity/v3/projects/5149a355272344e6928de24fc5261d16/groups/a3f4283437d74c10b7c54a375b3a9656/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:01:44.462670 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9edb42-627a-4a8e-848c-2901dbdcf8a5 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:44.499358 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24d5d2-361f-4d40-a934-6558d0692e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:44.500547 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24d5d2-361f-4d40-a934-6558d0692e51 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:44.501057 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24d5d2-361f-4d40-a934-6558d0692e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:44.501549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24d5d2-361f-4d40-a934-6558d0692e51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:44.513801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24d5d2-361f-4d40-a934-6558d0692e51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:44.522313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-3a24d5d2-361f-4d40-a934-6558d0692e51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:44.522313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:44.522313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:44.522313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:44.522313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:44.522313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:44.522313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:44.522313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:44.522313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:44.522313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:44.522313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:44.522313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:44.522313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:44.522313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:44.522313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:44.522313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:44.523235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:44.523235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:44.523235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:44.523235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:44.523235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:44.523235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:44.523235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:44.523235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:44.523235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:44.523235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:44.523235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:44.523235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:44.523235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:44.523235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:44.523235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:44.523235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:44.524046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:44.524046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:44.524046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:44.524046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:44.524046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:44.524046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:44.524046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:44.524046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:44.524046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:44.524046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:44.524046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:44.524046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:44.526964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 198/404] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:01:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:01:44.532587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2bc15-c570-445a-9634-ceff599028bd None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:44.586230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1c8a0-d69d-451a-93c7-30092b633887 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:44.586876 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1c8a0-d69d-451a-93c7-30092b633887 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:44.587416 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1c8a0-d69d-451a-93c7-30092b633887 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:44.589001 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 199/405] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:01:44.594588 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bc05b-acc4-458d-aa96-eb942a44505a None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:44.595149 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bc05b-acc4-458d-aa96-eb942a44505a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:44.595631 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bc05b-acc4-458d-aa96-eb942a44505a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:44.628512 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d05bc05b-acc4-458d-aa96-eb942a44505a None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:44.631443 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d05bc05b-acc4-458d-aa96-eb942a44505a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:44.718760 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2bc15-c570-445a-9634-ceff599028bd None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:44.764496 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff9617-8935-489e-888a-de470d66c0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:44.765534 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff9617-8935-489e-888a-de470d66c0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:44.766020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff9617-8935-489e-888a-de470d66c0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:44.766775 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff9617-8935-489e-888a-de470d66c0d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:44.767754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff9617-8935-489e-888a-de470d66c0d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:44.768425 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff9617-8935-489e-888a-de470d66c0d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:44.770089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff9617-8935-489e-888a-de470d66c0d8 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:44.780993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 200/406] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:01:44.781548 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 207/407] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:01:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:44.792098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bc05b-acc4-458d-aa96-eb942a44505a None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:44.817531 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff9617-8935-489e-888a-de470d66c0d8 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:44.987570 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bc05b-acc4-458d-aa96-eb942a44505a None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:45.008195 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff9617-8935-489e-888a-de470d66c0d8 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:45.052908 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f33c2-aaaf-4776-8c42-53d3ff641608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:45.053781 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f33c2-aaaf-4776-8c42-53d3ff641608 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:45.054071 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f33c2-aaaf-4776-8c42-53d3ff641608 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:45.054350 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f33c2-aaaf-4776-8c42-53d3ff641608 None admin] PATH_INFO: `/v3/groups/a3f4283437d74c10b7c54a375b3a9656` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:45.056806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f33c2-aaaf-4776-8c42-53d3ff641608 None admin] RBAC: Authorizing `identity:get_group(group_id=a3f4283437d74c10b7c54a375b3a9656)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:45.058267 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f33c2-aaaf-4776-8c42-53d3ff641608 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:45.059934 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 201/408] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 10 21:01:44 2022] GET /identity/v3/groups/a3f4283437d74c10b7c54a375b3a9656 => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:45.067321 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f33c2-aaaf-4776-8c42-53d3ff641608 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:45.079216 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71bfb03-ea56-463a-ad46-2100b0653981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:45.080029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bfb03-ea56-463a-ad46-2100b0653981 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:45.080318 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bfb03-ea56-463a-ad46-2100b0653981 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:45.080600 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bfb03-ea56-463a-ad46-2100b0653981 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:45.095921 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71bfb03-ea56-463a-ad46-2100b0653981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:45.104658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-f71bfb03-ea56-463a-ad46-2100b0653981 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:01:45.104658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:45.104658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:45.104658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:45.104658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:45.104658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:45.104658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:45.104658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:45.104658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:45.104658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:45.104658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:45.104658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:45.104658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:45.104658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:45.104658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:45.104658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:45.105554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:45.105554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:45.105554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:45.105554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:45.105554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:45.105554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:45.105554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:45.105554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:45.105554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:45.105554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:45.105554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:45.105554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:45.105554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:45.105554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:45.105554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:45.105554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:45.106469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:45.106469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:45.106469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:45.106469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:45.106469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:45.106469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:45.106469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:45.106469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:45.106469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:45.106469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:45.106469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:01:45.106469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:45.109187 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 208/409] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:01:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:01:45.119424 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71bfb03-ea56-463a-ad46-2100b0653981 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:45.189367 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f33c2-aaaf-4776-8c42-53d3ff641608 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:45.224224 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c259ce-6fde-4be1-b296-0af005b7433e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:45.225098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c259ce-6fde-4be1-b296-0af005b7433e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:45.225393 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c259ce-6fde-4be1-b296-0af005b7433e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:45.225719 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c259ce-6fde-4be1-b296-0af005b7433e None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:45.227151 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c259ce-6fde-4be1-b296-0af005b7433e None admin] RBAC: Authorizing `identity:get_project(project_id=5149a355272344e6928de24fc5261d16)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:45.228791 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c259ce-6fde-4be1-b296-0af005b7433e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:45.231269 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 202/410] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:45 2022] GET /identity/v3/projects/5149a355272344e6928de24fc5261d16 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:45.236706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71bfb03-ea56-463a-ad46-2100b0653981 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:45.237162 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c259ce-6fde-4be1-b296-0af005b7433e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:45.271508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24055f91-fda1-426e-8e01-fdeeb86019c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:45.272507 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24055f91-fda1-426e-8e01-fdeeb86019c8 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:45.272993 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24055f91-fda1-426e-8e01-fdeeb86019c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:45.273491 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24055f91-fda1-426e-8e01-fdeeb86019c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:45.274452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24055f91-fda1-426e-8e01-fdeeb86019c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:45.275586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24055f91-fda1-426e-8e01-fdeeb86019c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:45.277437 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24055f91-fda1-426e-8e01-fdeeb86019c8 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:45.286381 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 209/411] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:45.295626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24055f91-fda1-426e-8e01-fdeeb86019c8 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:45.359899 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c259ce-6fde-4be1-b296-0af005b7433e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:45.404010 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24055f91-fda1-426e-8e01-fdeeb86019c8 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:45.420762 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b9aa0-d03f-4966-a604-aafac2b0caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:45.421778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b9aa0-d03f-4966-a604-aafac2b0caa6 None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:45.422069 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b9aa0-d03f-4966-a604-aafac2b0caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:45.422623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b9aa0-d03f-4966-a604-aafac2b0caa6 None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16/groups/a3f4283437d74c10b7c54a375b3a9656/roles/c1ddef32606649809bb218b686f472c5` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:45.432074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b9aa0-d03f-4966-a604-aafac2b0caa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5149a355272344e6928de24fc5261d16, group_id=a3f4283437d74c10b7c54a375b3a9656, role_id=c1ddef32606649809bb218b686f472c5)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:45.433545 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b9aa0-d03f-4966-a604-aafac2b0caa6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:45.441038 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64102fd5-2222-47e2-8840-aef97abb35e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:45.442202 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64102fd5-2222-47e2-8840-aef97abb35e9 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:45.442715 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64102fd5-2222-47e2-8840-aef97abb35e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:45.443190 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64102fd5-2222-47e2-8840-aef97abb35e9 None admin] PATH_INFO: `/v3/groups/f7bf5665cd0849e39488e1358e3569db` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:45.444571 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64102fd5-2222-47e2-8840-aef97abb35e9 None admin] RBAC: Authorizing `identity:get_group(group_id=f7bf5665cd0849e39488e1358e3569db)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:45.446225 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64102fd5-2222-47e2-8840-aef97abb35e9 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:45.449074 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 210/412] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 10 21:01:45 2022] GET /identity/v3/groups/f7bf5665cd0849e39488e1358e3569db => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:45.454314 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64102fd5-2222-47e2-8840-aef97abb35e9 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:45.555872 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64102fd5-2222-47e2-8840-aef97abb35e9 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:45.559877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 203/413] 10.222.0.25 () {58 vars in 1442 bytes} [Tue May 10 21:01:45 2022] PUT /identity/v3/projects/5149a355272344e6928de24fc5261d16/groups/a3f4283437d74c10b7c54a375b3a9656/roles/c1ddef32606649809bb218b686f472c5 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:01:45.598193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dc736-6875-40f2-956b-77430da6dab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:45.599453 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dc736-6875-40f2-956b-77430da6dab8 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:45.599938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dc736-6875-40f2-956b-77430da6dab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:45.600411 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dc736-6875-40f2-956b-77430da6dab8 None admin] PATH_INFO: `/v3/projects/3ea6acf0b7844ccca48ba57f57c13860` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:45.606755 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dc736-6875-40f2-956b-77430da6dab8 None admin] RBAC: Authorizing `identity:get_project(project_id=3ea6acf0b7844ccca48ba57f57c13860)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:45.608579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dc736-6875-40f2-956b-77430da6dab8 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:45.610970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 211/414] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:45 2022] GET /identity/v3/projects/3ea6acf0b7844ccca48ba57f57c13860 => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:45.616597 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b9aa0-d03f-4966-a604-aafac2b0caa6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:45.779641 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b9aa0-d03f-4966-a604-aafac2b0caa6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:45.816811 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68b36b-1709-42dc-a74a-c43356ca8175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:45.817637 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68b36b-1709-42dc-a74a-c43356ca8175 None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:45.817925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68b36b-1709-42dc-a74a-c43356ca8175 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:45.818203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68b36b-1709-42dc-a74a-c43356ca8175 None admin] PATH_INFO: `/v3/projects/3ea6acf0b7844ccca48ba57f57c13860/groups/f7bf5665cd0849e39488e1358e3569db/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:45.820556 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68b36b-1709-42dc-a74a-c43356ca8175 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ea6acf0b7844ccca48ba57f57c13860, group_id=f7bf5665cd0849e39488e1358e3569db, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:45.822198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68b36b-1709-42dc-a74a-c43356ca8175 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:45.904027 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 204/415] 10.222.0.25 () {58 vars in 1442 bytes} [Tue May 10 21:01:45 2022] PUT /identity/v3/projects/3ea6acf0b7844ccca48ba57f57c13860/groups/f7bf5665cd0849e39488e1358e3569db/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:01:46.070328 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8044b-9caf-4ca9-9fb0-402fc487ce1f None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:46.071069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8044b-9caf-4ca9-9fb0-402fc487ce1f None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:46.072085 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8044b-9caf-4ca9-9fb0-402fc487ce1f None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:46.073737 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 212/416] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:46.092501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574fb6c-9317-4125-9854-22804233c283 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:46.093455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574fb6c-9317-4125-9854-22804233c283 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:46.093955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574fb6c-9317-4125-9854-22804233c283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:46.120251 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-1574fb6c-9317-4125-9854-22804233c283 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:46.121839 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1574fb6c-9317-4125-9854-22804233c283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:46.207376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71870b-0ecd-436c-8b5f-2268815534c1 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:46.207691 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71870b-0ecd-436c-8b5f-2268815534c1 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:46.207927 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71870b-0ecd-436c-8b5f-2268815534c1 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:46.209488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 213/417] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:46.214945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ca86d-25c8-46d2-a986-3ad5c3ddffab None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:46.215129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 205/418] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:46.215237 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ca86d-25c8-46d2-a986-3ad5c3ddffab None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:46.215570 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ca86d-25c8-46d2-a986-3ad5c3ddffab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:46.241031 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574fb6c-9317-4125-9854-22804233c283 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:46.251923 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-3b6ca86d-25c8-46d2-a986-3ad5c3ddffab None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:46.253777 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-3b6ca86d-25c8-46d2-a986-3ad5c3ddffab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:46.382694 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 214/419] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:46.411732 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ca86d-25c8-46d2-a986-3ad5c3ddffab None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:46.422955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574fb6c-9317-4125-9854-22804233c283 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:46.490569 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e453c2-ce37-4c89-a344-66c1c074d24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:46.491389 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e453c2-ce37-4c89-a344-66c1c074d24d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:46.491675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e453c2-ce37-4c89-a344-66c1c074d24d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:46.491953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e453c2-ce37-4c89-a344-66c1c074d24d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:46.508281 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e453c2-ce37-4c89-a344-66c1c074d24d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:46.524188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-75e453c2-ce37-4c89-a344-66c1c074d24d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:46.524188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:46.524188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:46.524188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:46.524188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:46.524188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:46.524188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:46.524188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:46.524188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:46.524188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:46.524188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:46.524188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:46.524188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:46.524188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:46.524188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:46.524188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:46.525909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:46.525909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:46.525909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:46.525909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:46.525909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:46.525909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:46.525909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:46.525909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:46.525909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:46.525909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:46.525909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:46.525909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:46.525909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:46.525909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:46.525909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:46.525909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:46.527048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:46.527048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:46.527048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:46.527048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:46.527048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:46.527048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:46.527048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:46.527048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:46.527048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:46.527048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:46.527048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:46.527048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:46.527048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 206/420] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:01:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:01:46.534032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e453c2-ce37-4c89-a344-66c1c074d24d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:46.567944 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ca86d-25c8-46d2-a986-3ad5c3ddffab None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:46.606168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8c0a6-7861-4a9d-bb36-ce9034ad5c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:46.607005 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8c0a6-7861-4a9d-bb36-ce9034ad5c9f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:46.607287 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8c0a6-7861-4a9d-bb36-ce9034ad5c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:46.607559 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8c0a6-7861-4a9d-bb36-ce9034ad5c9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:46.628514 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8c0a6-7861-4a9d-bb36-ce9034ad5c9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:46.637294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-47a8c0a6-7861-4a9d-bb36-ce9034ad5c9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:46.637294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:46.637294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:46.637294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:46.637294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:46.637294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:46.637294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:46.637294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:46.637294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:46.637294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:46.637294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:46.637294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:46.637294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:46.637294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:46.637294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:46.637294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:46.638167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:46.638167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:46.638167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:46.638167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:46.638167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:46.638167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:46.638167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:46.638167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:46.638167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:46.638167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:46.638167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:46.638167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:46.638167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:46.638167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:46.638167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:46.638167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:46.639579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:46.639579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:46.639579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:46.639579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:46.639579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:46.639579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:46.639579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:46.639579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:46.639579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:46.639579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:46.639579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:46.639579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:46.639579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 215/421] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:01:46.644430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8c0a6-7861-4a9d-bb36-ce9034ad5c9f None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:46.722409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e453c2-ce37-4c89-a344-66c1c074d24d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:46.759762 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8df09-e20c-4f1b-b343-4b7db127bdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:46.760450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8df09-e20c-4f1b-b343-4b7db127bdf3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:46.760737 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8df09-e20c-4f1b-b343-4b7db127bdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:46.761016 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8df09-e20c-4f1b-b343-4b7db127bdf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:46.761907 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8df09-e20c-4f1b-b343-4b7db127bdf3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:46.762220 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8df09-e20c-4f1b-b343-4b7db127bdf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:46.770622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8df09-e20c-4f1b-b343-4b7db127bdf3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:46.779669 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 207/422] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:01:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:46.785326 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8df09-e20c-4f1b-b343-4b7db127bdf3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:46.851736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8c0a6-7861-4a9d-bb36-ce9034ad5c9f None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:46.896621 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753af4c2-7c53-414c-8061-4c61a1379875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:46.897226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753af4c2-7c53-414c-8061-4c61a1379875 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:46.897513 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753af4c2-7c53-414c-8061-4c61a1379875 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:46.897792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753af4c2-7c53-414c-8061-4c61a1379875 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:46.898574 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753af4c2-7c53-414c-8061-4c61a1379875 None admin] RBAC: Adding query filter params (name=member) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:46.898883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753af4c2-7c53-414c-8061-4c61a1379875 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:46.900835 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753af4c2-7c53-414c-8061-4c61a1379875 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:46.918151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 216/423] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:46.923059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753af4c2-7c53-414c-8061-4c61a1379875 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:46.944099 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8df09-e20c-4f1b-b343-4b7db127bdf3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:46.981510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940be8f-c4a7-4b52-938e-dad1830fbf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:46.982170 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940be8f-c4a7-4b52-938e-dad1830fbf86 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:46.982469 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940be8f-c4a7-4b52-938e-dad1830fbf86 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:46.983550 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940be8f-c4a7-4b52-938e-dad1830fbf86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:47.065917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753af4c2-7c53-414c-8061-4c61a1379875 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:47.073515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940be8f-c4a7-4b52-938e-dad1830fbf86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:47.075436 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940be8f-c4a7-4b52-938e-dad1830fbf86 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:47.101322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8064a96-130e-4d17-978a-6a6bf9f0d03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:47.102331 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8064a96-130e-4d17-978a-6a6bf9f0d03c None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:47.102912 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8064a96-130e-4d17-978a-6a6bf9f0d03c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:47.103660 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8064a96-130e-4d17-978a-6a6bf9f0d03c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:47.187266 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 208/424] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 21:01:47.189246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970cbbf-d6f9-4fbf-8401-95cee7eb226c None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:47.189741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970cbbf-d6f9-4fbf-8401-95cee7eb226c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:47.190242 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970cbbf-d6f9-4fbf-8401-95cee7eb226c None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:47.191714 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 209/425] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:47.192948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970cbbf-d6f9-4fbf-8401-95cee7eb226c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:47.193508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8064a96-130e-4d17-978a-6a6bf9f0d03c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:47.195153 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8064a96-130e-4d17-978a-6a6bf9f0d03c None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:47.296514 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 217/426] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 21:01:47.298718 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213ccf9-de40-44e6-a998-d7700abda06a None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:47.299133 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213ccf9-de40-44e6-a998-d7700abda06a None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:47.299565 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213ccf9-de40-44e6-a998-d7700abda06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:47.306607 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970cbbf-d6f9-4fbf-8401-95cee7eb226c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:47.319412 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-5213ccf9-de40-44e6-a998-d7700abda06a None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:47.320845 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-5213ccf9-de40-44e6-a998-d7700abda06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:47.346019 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d5bf7-4a0c-441b-821d-bdf6433d6726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:47.347257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d5bf7-4a0c-441b-821d-bdf6433d6726 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:47.347716 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d5bf7-4a0c-441b-821d-bdf6433d6726 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:47.348186 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d5bf7-4a0c-441b-821d-bdf6433d6726 None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:47.349628 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d5bf7-4a0c-441b-821d-bdf6433d6726 None admin] RBAC: Authorizing `identity:get_project(project_id=f157df588b834944b8799b6d43e8319a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:47.351642 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d5bf7-4a0c-441b-821d-bdf6433d6726 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:47.358561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 210/427] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:47 2022] GET /identity/v3/projects/f157df588b834944b8799b6d43e8319a => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:47.359707 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d5bf7-4a0c-441b-821d-bdf6433d6726 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:47.402171 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 218/428] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:47.403103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213ccf9-de40-44e6-a998-d7700abda06a None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:47.469110 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d5bf7-4a0c-441b-821d-bdf6433d6726 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:47.512627 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213ccf9-de40-44e6-a998-d7700abda06a None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:47.512890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33de1d0-79bc-4c4b-9ed0-f7c7920db463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:47.514023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33de1d0-79bc-4c4b-9ed0-f7c7920db463 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:47.514632 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33de1d0-79bc-4c4b-9ed0-f7c7920db463 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:47.515057 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33de1d0-79bc-4c4b-9ed0-f7c7920db463 None admin] PATH_INFO: `/v3/projects/f157df588b834944b8799b6d43e8319a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:47.517201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33de1d0-79bc-4c4b-9ed0-f7c7920db463 None admin] RBAC: Authorizing `identity:get_project(project_id=f157df588b834944b8799b6d43e8319a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:47.518791 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33de1d0-79bc-4c4b-9ed0-f7c7920db463 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:47.520639 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 211/429] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:47 2022] GET /identity/v3/projects/f157df588b834944b8799b6d43e8319a => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:47.525843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33de1d0-79bc-4c4b-9ed0-f7c7920db463 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:47.559569 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd47d9c-09bd-4a9f-97fc-5c866eb8346e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:47.561265 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd47d9c-09bd-4a9f-97fc-5c866eb8346e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:47.562012 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd47d9c-09bd-4a9f-97fc-5c866eb8346e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:47.562562 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd47d9c-09bd-4a9f-97fc-5c866eb8346e None admin] PATH_INFO: `/v3/groups/a3f4283437d74c10b7c54a375b3a9656` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:47.564095 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd47d9c-09bd-4a9f-97fc-5c866eb8346e None admin] RBAC: Authorizing `identity:get_group(group_id=a3f4283437d74c10b7c54a375b3a9656)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:47.566485 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd47d9c-09bd-4a9f-97fc-5c866eb8346e None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:47.568601 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 219/430] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 10 21:01:47 2022] GET /identity/v3/groups/a3f4283437d74c10b7c54a375b3a9656 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:47.569575 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd47d9c-09bd-4a9f-97fc-5c866eb8346e None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:47.635130 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33de1d0-79bc-4c4b-9ed0-f7c7920db463 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:47.672921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd415474-1d29-46a9-9505-c663c71b457c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:47.673883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd415474-1d29-46a9-9505-c663c71b457c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:47.674274 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd415474-1d29-46a9-9505-c663c71b457c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:47.674674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd415474-1d29-46a9-9505-c663c71b457c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:47.688530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd47d9c-09bd-4a9f-97fc-5c866eb8346e None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:47.689077 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd415474-1d29-46a9-9505-c663c71b457c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:47.699275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-fd415474-1d29-46a9-9505-c663c71b457c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:47.699275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:47.699275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:47.699275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:47.699275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:47.699275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:47.699275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:47.699275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:47.699275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:47.699275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:47.699275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:47.699275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:47.699275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:47.699275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:47.699275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:47.699275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:47.700226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:47.700226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:47.700226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:47.700226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:47.700226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:47.700226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:47.700226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:47.700226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:47.700226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:47.700226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:47.700226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:47.700226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:47.700226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:47.700226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:47.700226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:47.700226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:47.701034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:47.701034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:47.701034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:47.701034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:47.701034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:47.701034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:47.701034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:47.701034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:47.701034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:47.701034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:47.701034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 21:01:47.701034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:47.701034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 212/431] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:47.701685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd415474-1d29-46a9-9505-c663c71b457c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:47.726368 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b4c27-b46a-407c-9734-48acc334ba08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:47.727642 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b4c27-b46a-407c-9734-48acc334ba08 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:47.728714 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b4c27-b46a-407c-9734-48acc334ba08 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:47.729208 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b4c27-b46a-407c-9734-48acc334ba08 None admin] PATH_INFO: `/v3/groups/a3f4283437d74c10b7c54a375b3a9656` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:47.730760 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b4c27-b46a-407c-9734-48acc334ba08 None admin] RBAC: Authorizing `identity:get_group(group_id=a3f4283437d74c10b7c54a375b3a9656)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:47.732459 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b4c27-b46a-407c-9734-48acc334ba08 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:47.734646 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 220/432] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 10 21:01:47 2022] GET /identity/v3/groups/a3f4283437d74c10b7c54a375b3a9656 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:47.735753 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b4c27-b46a-407c-9734-48acc334ba08 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:47.818701 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd415474-1d29-46a9-9505-c663c71b457c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:47.862522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad46cb-bbe6-44d9-81d9-9bb3cfed5a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:47.863277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad46cb-bbe6-44d9-81d9-9bb3cfed5a4d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:47.863721 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad46cb-bbe6-44d9-81d9-9bb3cfed5a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:47.864021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad46cb-bbe6-44d9-81d9-9bb3cfed5a4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:47.864960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad46cb-bbe6-44d9-81d9-9bb3cfed5a4d None admin] RBAC: Adding query filter params (group.id=a3f4283437d74c10b7c54a375b3a9656, role.id=c1ddef32606649809bb218b686f472c5, scope.project.id=f157df588b834944b8799b6d43e8319a) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:47.865389 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad46cb-bbe6-44d9-81d9-9bb3cfed5a4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:47.866164 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b4c27-b46a-407c-9734-48acc334ba08 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:47.867059 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad46cb-bbe6-44d9-81d9-9bb3cfed5a4d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:47.882824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 213/433] 10.222.0.25 () {56 vars in 1376 bytes} [Tue May 10 21:01:47 2022] GET /identity/v3/role_assignments?group.id=a3f4283437d74c10b7c54a375b3a9656&scope.project.id=f157df588b834944b8799b6d43e8319a&role.id=c1ddef32606649809bb218b686f472c5 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:47.884415 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad46cb-bbe6-44d9-81d9-9bb3cfed5a4d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:47.904172 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a8dea-86b4-495e-b100-de90eba655aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:47.905173 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8dea-86b4-495e-b100-de90eba655aa None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:47.905649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8dea-86b4-495e-b100-de90eba655aa None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:47.906066 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8dea-86b4-495e-b100-de90eba655aa None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:47.906986 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a8dea-86b4-495e-b100-de90eba655aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:47.907455 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a8dea-86b4-495e-b100-de90eba655aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:47.909085 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a8dea-86b4-495e-b100-de90eba655aa None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:47.919909 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 221/434] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:01:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:47.931910 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a8dea-86b4-495e-b100-de90eba655aa None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:48.055333 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a8dea-86b4-495e-b100-de90eba655aa None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:48.091606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ac196-ff8e-4f74-935b-bcaeed638a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:48.092277 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ac196-ff8e-4f74-935b-bcaeed638a41 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:48.092565 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ac196-ff8e-4f74-935b-bcaeed638a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:48.092844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ac196-ff8e-4f74-935b-bcaeed638a41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:48.104892 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad46cb-bbe6-44d9-81d9-9bb3cfed5a4d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:48.173295 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ac196-ff8e-4f74-935b-bcaeed638a41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:48.174941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ac196-ff8e-4f74-935b-bcaeed638a41 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:48.191589 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a120c3-f26a-46a1-bd56-886289a38fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:48.192863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a120c3-f26a-46a1-bd56-886289a38fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:48.193287 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a120c3-f26a-46a1-bd56-886289a38fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:48.193729 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a120c3-f26a-46a1-bd56-886289a38fc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:48.195330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a120c3-f26a-46a1-bd56-886289a38fc4 None admin] RBAC: Adding query filter params (group.id=a3f4283437d74c10b7c54a375b3a9656, role.id=390d715fbb0f4d029b222894fa3ac65b, scope.project.id=f157df588b834944b8799b6d43e8319a) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:48.195797 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a120c3-f26a-46a1-bd56-886289a38fc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:48.201443 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a120c3-f26a-46a1-bd56-886289a38fc4 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:48.205132 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 214/435] 10.222.0.25 () {56 vars in 1376 bytes} [Tue May 10 21:01:47 2022] GET /identity/v3/role_assignments?group.id=a3f4283437d74c10b7c54a375b3a9656&scope.project.id=f157df588b834944b8799b6d43e8319a&role.id=390d715fbb0f4d029b222894fa3ac65b => generated 611 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:48.206603 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8495a-f41e-4c91-84ab-c730f225a43d None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:48.206899 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8495a-f41e-4c91-84ab-c730f225a43d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:48.207178 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8495a-f41e-4c91-84ab-c730f225a43d None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:48.208430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 215/436] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:48.220781 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca27d42-5728-44a8-9669-78d4799b5360 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:48.221475 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca27d42-5728-44a8-9669-78d4799b5360 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:48.221976 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca27d42-5728-44a8-9669-78d4799b5360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:48.241684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2ca27d42-5728-44a8-9669-78d4799b5360 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:48.244096 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2ca27d42-5728-44a8-9669-78d4799b5360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:48.306870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 222/437] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:48.313400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ac196-ff8e-4f74-935b-bcaeed638a41 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:48.345689 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 216/438] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:01:48.372909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca27d42-5728-44a8-9669-78d4799b5360 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:48.457443 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ac196-ff8e-4f74-935b-bcaeed638a41 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:48.493763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca27d42-5728-44a8-9669-78d4799b5360 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:48.493982 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f848f1-6390-40e9-b95a-ee3792562cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:48.494911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f848f1-6390-40e9-b95a-ee3792562cfb None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:48.495242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f848f1-6390-40e9-b95a-ee3792562cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:48.495486 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f848f1-6390-40e9-b95a-ee3792562cfb None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:48.497095 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f848f1-6390-40e9-b95a-ee3792562cfb None admin] RBAC: Authorizing `identity:get_project(project_id=5149a355272344e6928de24fc5261d16)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:48.498136 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f848f1-6390-40e9-b95a-ee3792562cfb None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:48.499870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 223/439] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:48 2022] GET /identity/v3/projects/5149a355272344e6928de24fc5261d16 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:48.501921 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac53d36-6845-4c49-afa4-637b6ad51e31 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:48.501921 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac53d36-6845-4c49-afa4-637b6ad51e31 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:48.501921 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac53d36-6845-4c49-afa4-637b6ad51e31 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:48.504287 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 224/440] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:48.507484 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac53d36-6845-4c49-afa4-637b6ad51e31 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:48.536496 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85809846-de0e-4fa7-b11f-6d8a91ce5f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:48.537516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85809846-de0e-4fa7-b11f-6d8a91ce5f9a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:48.537621 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85809846-de0e-4fa7-b11f-6d8a91ce5f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:48.537862 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85809846-de0e-4fa7-b11f-6d8a91ce5f9a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:48.548814 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85809846-de0e-4fa7-b11f-6d8a91ce5f9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:48.557772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-85809846-de0e-4fa7-b11f-6d8a91ce5f9a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:48.557772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:48.557772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:48.557772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:48.557772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:48.557772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:48.557772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:48.557772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:48.557772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:48.557772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:48.557772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:48.557772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:48.557772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:48.557772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:48.557772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:48.557772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:48.558911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:48.558911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:48.558911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:48.558911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:48.558911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:48.558911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:48.558911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:48.558911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:48.558911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:48.558911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:48.558911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:48.558911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:48.558911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:48.558911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:48.558911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:48.558911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:48.560199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:48.560199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:48.560199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:48.560199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:48.560199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:48.560199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:48.560199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:48.560199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:48.560199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:48.560199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:48.560199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:48.560199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:48.560199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 217/441] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:01:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:01:48.561055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14cb36-6516-4b02-9508-a6874bd05410 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:48.561055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14cb36-6516-4b02-9508-a6874bd05410 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:48.561055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14cb36-6516-4b02-9508-a6874bd05410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:48.578591 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-da14cb36-6516-4b02-9508-a6874bd05410 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:48.579783 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-da14cb36-6516-4b02-9508-a6874bd05410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:48.632350 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac53d36-6845-4c49-afa4-637b6ad51e31 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:48.660983 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 218/442] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:48.661948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14cb36-6516-4b02-9508-a6874bd05410 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:48.682888 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac93ceb-787f-4f77-8024-b840c49dcce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:48.683762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac93ceb-787f-4f77-8024-b840c49dcce1 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:48.684469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac93ceb-787f-4f77-8024-b840c49dcce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:48.684838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac93ceb-787f-4f77-8024-b840c49dcce1 None admin] PATH_INFO: `/v3/groups/a3f4283437d74c10b7c54a375b3a9656` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:48.686054 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac93ceb-787f-4f77-8024-b840c49dcce1 None admin] RBAC: Authorizing `identity:get_group(group_id=a3f4283437d74c10b7c54a375b3a9656)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:48.687550 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac93ceb-787f-4f77-8024-b840c49dcce1 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:48.689175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 225/443] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 10 21:01:48 2022] GET /identity/v3/groups/a3f4283437d74c10b7c54a375b3a9656 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:48.689997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac93ceb-787f-4f77-8024-b840c49dcce1 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:48.777179 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14cb36-6516-4b02-9508-a6874bd05410 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:48.802756 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac93ceb-787f-4f77-8024-b840c49dcce1 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:48.814868 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadf315-4cbd-4c2d-8b46-a239c4270b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:48.815495 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadf315-4cbd-4c2d-8b46-a239c4270b1b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:48.815776 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadf315-4cbd-4c2d-8b46-a239c4270b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:48.816048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadf315-4cbd-4c2d-8b46-a239c4270b1b None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:48.816801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadf315-4cbd-4c2d-8b46-a239c4270b1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:48.817105 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadf315-4cbd-4c2d-8b46-a239c4270b1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:48.818508 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadf315-4cbd-4c2d-8b46-a239c4270b1b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:48.826425 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 219/444] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:01:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:48.827277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadf315-4cbd-4c2d-8b46-a239c4270b1b None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:48.836015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee81260-4aee-441f-9936-f61852b63cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:48.836803 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee81260-4aee-441f-9936-f61852b63cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:48.837623 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee81260-4aee-441f-9936-f61852b63cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:48.837896 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee81260-4aee-441f-9936-f61852b63cc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:48.848128 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee81260-4aee-441f-9936-f61852b63cc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:48.856710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-6ee81260-4aee-441f-9936-f61852b63cc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:01:48.856710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:48.856710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:48.856710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:48.856710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:48.856710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:48.856710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:48.856710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:48.856710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:48.856710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:48.856710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:48.856710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:48.856710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:48.856710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:48.856710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:48.856710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:48.857762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:48.857762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:48.857762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:48.857762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:48.857762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:48.857762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:48.857762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:48.857762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:48.857762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:48.857762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:48.857762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:48.857762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:48.857762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:48.857762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:48.857762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:48.857762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:48.858588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:48.858588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:48.858588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:48.858588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:48.858588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:48.858588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:48.858588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:48.858588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:48.858588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:48.858588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:48.858588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:01:48.858588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:48.858588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 226/445] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:01:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:48.859601 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee81260-4aee-441f-9936-f61852b63cc4 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:48.924964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadf315-4cbd-4c2d-8b46-a239c4270b1b None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:48.951640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee81260-4aee-441f-9936-f61852b63cc4 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:48.956671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2249f-d501-4866-9911-01421dbbeaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:48.957318 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2249f-d501-4866-9911-01421dbbeaa6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:48.957600 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2249f-d501-4866-9911-01421dbbeaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:48.957875 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2249f-d501-4866-9911-01421dbbeaa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:48.958733 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2249f-d501-4866-9911-01421dbbeaa6 None admin] RBAC: Adding query filter params (group.id=a3f4283437d74c10b7c54a375b3a9656, role.id=390d715fbb0f4d029b222894fa3ac65b, scope.project.id=5149a355272344e6928de24fc5261d16) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:48.959067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2249f-d501-4866-9911-01421dbbeaa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:48.960466 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2249f-d501-4866-9911-01421dbbeaa6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:48.966687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 220/446] 10.222.0.25 () {56 vars in 1376 bytes} [Tue May 10 21:01:48 2022] GET /identity/v3/role_assignments?group.id=a3f4283437d74c10b7c54a375b3a9656&scope.project.id=5149a355272344e6928de24fc5261d16&role.id=390d715fbb0f4d029b222894fa3ac65b => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:48.967448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2249f-d501-4866-9911-01421dbbeaa6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:49.000916 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7249b7d-5b0d-48a4-bd31-38fe90d927d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:49.001907 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7249b7d-5b0d-48a4-bd31-38fe90d927d3 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:49.002341 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7249b7d-5b0d-48a4-bd31-38fe90d927d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:49.002659 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7249b7d-5b0d-48a4-bd31-38fe90d927d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:49.073244 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2249f-d501-4866-9911-01421dbbeaa6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:49.074748 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7249b7d-5b0d-48a4-bd31-38fe90d927d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:49.076237 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7249b7d-5b0d-48a4-bd31-38fe90d927d3 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:49.108010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4650c79-d091-415c-a527-25b0fdbcd9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:49.108989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4650c79-d091-415c-a527-25b0fdbcd9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:49.109279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4650c79-d091-415c-a527-25b0fdbcd9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:49.109555 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4650c79-d091-415c-a527-25b0fdbcd9a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:49.110318 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4650c79-d091-415c-a527-25b0fdbcd9a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:49.110662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4650c79-d091-415c-a527-25b0fdbcd9a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:49.112059 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4650c79-d091-415c-a527-25b0fdbcd9a2 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:49.120683 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 221/447] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:49.126371 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4650c79-d091-415c-a527-25b0fdbcd9a2 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:49.187876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 227/448] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:49.193690 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7249b7d-5b0d-48a4-bd31-38fe90d927d3 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:49.233459 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4650c79-d091-415c-a527-25b0fdbcd9a2 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:49.268432 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b7fc4-29bb-44ac-a45c-8ed84ce775d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:49.269086 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b7fc4-29bb-44ac-a45c-8ed84ce775d9 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:49.269370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b7fc4-29bb-44ac-a45c-8ed84ce775d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:49.269646 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b7fc4-29bb-44ac-a45c-8ed84ce775d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:49.297106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7249b7d-5b0d-48a4-bd31-38fe90d927d3 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:49.335297 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1b079-8025-4007-87e9-0842861d30ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:49.336089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1b079-8025-4007-87e9-0842861d30ff None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:49.336371 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1b079-8025-4007-87e9-0842861d30ff None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:49.336646 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1b079-8025-4007-87e9-0842861d30ff None admin] PATH_INFO: `/v3/projects/5149a355272344e6928de24fc5261d16` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:49.340884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1b079-8025-4007-87e9-0842861d30ff None admin] RBAC: Authorizing `identity:get_project(project_id=5149a355272344e6928de24fc5261d16)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:49.340884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1b079-8025-4007-87e9-0842861d30ff None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:49.342529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 228/449] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:49 2022] GET /identity/v3/projects/5149a355272344e6928de24fc5261d16 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:49.347474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1b079-8025-4007-87e9-0842861d30ff None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:49.349765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b7fc4-29bb-44ac-a45c-8ed84ce775d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:49.351119 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b7fc4-29bb-44ac-a45c-8ed84ce775d9 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:49.444547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1b079-8025-4007-87e9-0842861d30ff None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:49.444916 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 222/450] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 21:01:49.451050 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b7fc4-29bb-44ac-a45c-8ed84ce775d9 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:49.477466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d1d53-5cbe-45d5-996c-efa2e69261ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:49.478768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d1d53-5cbe-45d5-996c-efa2e69261ca None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:49.479053 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d1d53-5cbe-45d5-996c-efa2e69261ca None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:49.479330 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d1d53-5cbe-45d5-996c-efa2e69261ca None admin] PATH_INFO: `/v3/groups/a3f4283437d74c10b7c54a375b3a9656` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:49.480512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d1d53-5cbe-45d5-996c-efa2e69261ca None admin] RBAC: Authorizing `identity:get_group(group_id=a3f4283437d74c10b7c54a375b3a9656)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:49.481945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d1d53-5cbe-45d5-996c-efa2e69261ca None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:49.483565 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 229/451] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 10 21:01:49 2022] GET /identity/v3/groups/a3f4283437d74c10b7c54a375b3a9656 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:49.489155 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d1d53-5cbe-45d5-996c-efa2e69261ca None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:49.541761 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b7fc4-29bb-44ac-a45c-8ed84ce775d9 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:49.573707 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea496bd6-dbe4-480e-bb4c-ecd9b9ebf012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:49.574585 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea496bd6-dbe4-480e-bb4c-ecd9b9ebf012 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:49.574862 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea496bd6-dbe4-480e-bb4c-ecd9b9ebf012 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:49.575137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea496bd6-dbe4-480e-bb4c-ecd9b9ebf012 None admin] PATH_INFO: `/v3/projects/3ea6acf0b7844ccca48ba57f57c13860` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:49.576304 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea496bd6-dbe4-480e-bb4c-ecd9b9ebf012 None admin] RBAC: Authorizing `identity:get_project(project_id=3ea6acf0b7844ccca48ba57f57c13860)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:49.577732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea496bd6-dbe4-480e-bb4c-ecd9b9ebf012 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:49.579414 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 223/452] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:01:49 2022] GET /identity/v3/projects/3ea6acf0b7844ccca48ba57f57c13860 => generated 344 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:49.584618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea496bd6-dbe4-480e-bb4c-ecd9b9ebf012 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:49.584763 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d1d53-5cbe-45d5-996c-efa2e69261ca None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:49.616742 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadb35b-9f94-45d5-b4d3-029a0b6814bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:49.617389 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadb35b-9f94-45d5-b4d3-029a0b6814bb None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:49.617675 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadb35b-9f94-45d5-b4d3-029a0b6814bb None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:49.617954 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadb35b-9f94-45d5-b4d3-029a0b6814bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:49.619645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadb35b-9f94-45d5-b4d3-029a0b6814bb None admin] RBAC: Adding query filter params (group.id=a3f4283437d74c10b7c54a375b3a9656, role.id=c1ddef32606649809bb218b686f472c5, scope.project.id=5149a355272344e6928de24fc5261d16) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:49.619959 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadb35b-9f94-45d5-b4d3-029a0b6814bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:49.621386 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadb35b-9f94-45d5-b4d3-029a0b6814bb None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:49.626966 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 230/453] 10.222.0.25 () {56 vars in 1376 bytes} [Tue May 10 21:01:49 2022] GET /identity/v3/role_assignments?group.id=a3f4283437d74c10b7c54a375b3a9656&scope.project.id=5149a355272344e6928de24fc5261d16&role.id=c1ddef32606649809bb218b686f472c5 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:49.679854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea496bd6-dbe4-480e-bb4c-ecd9b9ebf012 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:49.715466 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370b824-f3fe-47d3-b267-0ed7d8b26573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:49.716369 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370b824-f3fe-47d3-b267-0ed7d8b26573 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:49.716649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370b824-f3fe-47d3-b267-0ed7d8b26573 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:49.716921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370b824-f3fe-47d3-b267-0ed7d8b26573 None admin] PATH_INFO: `/v3/groups/f7bf5665cd0849e39488e1358e3569db` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:49.718136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370b824-f3fe-47d3-b267-0ed7d8b26573 None admin] RBAC: Authorizing `identity:get_group(group_id=f7bf5665cd0849e39488e1358e3569db)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:49.719693 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370b824-f3fe-47d3-b267-0ed7d8b26573 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:49.721348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 224/454] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 10 21:01:49 2022] GET /identity/v3/groups/f7bf5665cd0849e39488e1358e3569db => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:01:49.727298 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadb35b-9f94-45d5-b4d3-029a0b6814bb None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:49.829546 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadb35b-9f94-45d5-b4d3-029a0b6814bb None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:49.864253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fde1b-fccd-4942-98d2-90c41f4ce7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:49.864913 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fde1b-fccd-4942-98d2-90c41f4ce7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:49.865198 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fde1b-fccd-4942-98d2-90c41f4ce7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:49.865472 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fde1b-fccd-4942-98d2-90c41f4ce7c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:49.866300 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fde1b-fccd-4942-98d2-90c41f4ce7c5 None admin] RBAC: Adding query filter params (group.id=f7bf5665cd0849e39488e1358e3569db, role.id=5cd001edc58744738aa57180c0be68a9, scope.project.id=3ea6acf0b7844ccca48ba57f57c13860) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:49.866637 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fde1b-fccd-4942-98d2-90c41f4ce7c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:49.868119 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fde1b-fccd-4942-98d2-90c41f4ce7c5 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:49.874226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 231/455] 10.222.0.25 () {56 vars in 1376 bytes} [Tue May 10 21:01:49 2022] GET /identity/v3/role_assignments?group.id=f7bf5665cd0849e39488e1358e3569db&scope.project.id=3ea6acf0b7844ccca48ba57f57c13860&role.id=5cd001edc58744738aa57180c0be68a9 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:52.673744 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bfa6a-8ce4-4b03-b43b-5984a2e01fc9 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:52.674771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bfa6a-8ce4-4b03-b43b-5984a2e01fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:52.675269 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bfa6a-8ce4-4b03-b43b-5984a2e01fc9 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:52.677094 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 225/456] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:52.683530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a68ea-728e-4bbd-b36b-f6ccf13c25bb None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:52.684367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a68ea-728e-4bbd-b36b-f6ccf13c25bb None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:52.684851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a68ea-728e-4bbd-b36b-f6ccf13c25bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:52.711411 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-d72a68ea-728e-4bbd-b36b-f6ccf13c25bb None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:52.713054 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-d72a68ea-728e-4bbd-b36b-f6ccf13c25bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:52.721842 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a3987-c12a-4c8c-8104-618b7d9ed6f6 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:52.722505 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a3987-c12a-4c8c-8104-618b7d9ed6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:52.722994 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a3987-c12a-4c8c-8104-618b7d9ed6f6 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:52.724665 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 226/457] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:01:52.741431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290f577-9ed2-4663-bd3e-7abf9d946314 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:52.742056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290f577-9ed2-4663-bd3e-7abf9d946314 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:52.742582 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290f577-9ed2-4663-bd3e-7abf9d946314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:52.769585 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7290f577-9ed2-4663-bd3e-7abf9d946314 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:52.773385 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7290f577-9ed2-4663-bd3e-7abf9d946314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:52.814362 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 232/458] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:01:52.863099 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a68ea-728e-4bbd-b36b-f6ccf13c25bb None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:52.881282 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 227/459] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:52.924947 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290f577-9ed2-4663-bd3e-7abf9d946314 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:52.964677 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a68ea-728e-4bbd-b36b-f6ccf13c25bb None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:53.013335 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1902e-46e8-4e00-b388-3b70f505b662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:53.014168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1902e-46e8-4e00-b388-3b70f505b662 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:53.014480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1902e-46e8-4e00-b388-3b70f505b662 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:53.014768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1902e-46e8-4e00-b388-3b70f505b662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:53.026850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1902e-46e8-4e00-b388-3b70f505b662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:53.028351 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1902e-46e8-4e00-b388-3b70f505b662 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:53.049089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-cca1902e-46e8-4e00-b388-3b70f505b662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:53.049089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:53.049089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:53.049089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:53.049089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:53.049089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:53.049089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:53.049089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:53.049089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:53.049089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:53.049089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:53.049089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:53.049089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:01:53.049089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:01:53.049089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:01:53.050026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:01:53.050026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:53.050026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:53.050026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:53.050026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:53.050026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:53.050026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:53.050026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:53.050026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:53.050026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:53.050026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:53.050026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:53.050026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:53.050026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:53.050026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:53.050026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:53.050026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:53.050896 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:01:53.050896 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:01:53.050896 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:53.050896 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:53.054040 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290f577-9ed2-4663-bd3e-7abf9d946314 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:53.055221 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 233/460] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:53.057700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abedaf-bcec-4876-9873-f0c6526fa534 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:53.058157 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abedaf-bcec-4876-9873-f0c6526fa534 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:53.058631 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abedaf-bcec-4876-9873-f0c6526fa534 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:53.060128 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 234/461] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:53.060989 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abedaf-bcec-4876-9873-f0c6526fa534 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:53.089989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bea5b6-af23-4ae8-bf1f-37ed9a5a7639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:53.090822 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bea5b6-af23-4ae8-bf1f-37ed9a5a7639 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:53.091288 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bea5b6-af23-4ae8-bf1f-37ed9a5a7639 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:53.091695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bea5b6-af23-4ae8-bf1f-37ed9a5a7639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:53.102295 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bea5b6-af23-4ae8-bf1f-37ed9a5a7639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:53.103984 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bea5b6-af23-4ae8-bf1f-37ed9a5a7639 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:53.122672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-03bea5b6-af23-4ae8-bf1f-37ed9a5a7639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:53.122672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:53.122672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:53.122672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:53.122672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:53.122672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:53.122672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:53.122672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:53.122672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:53.122672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:53.122672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:53.122672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:53.122672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:01:53.122672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:01:53.122672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:01:53.123756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:01:53.123756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:53.123756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:53.123756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:53.123756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:53.123756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:53.123756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:53.123756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:53.123756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:53.123756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:53.123756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:53.123756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:53.123756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:53.123756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:53.123756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:53.123756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:53.123756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:53.124653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:01:53.124653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:01:53.124653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:53.124653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:53.126723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 228/462] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:01:53.128089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf51db-83a8-4208-bdc1-7dce7a8b9ecc None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:53.128567 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf51db-83a8-4208-bdc1-7dce7a8b9ecc None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:53.129033 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf51db-83a8-4208-bdc1-7dce7a8b9ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:53.147567 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-91bf51db-83a8-4208-bdc1-7dce7a8b9ecc None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:53.149005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-91bf51db-83a8-4208-bdc1-7dce7a8b9ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:53.172440 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abedaf-bcec-4876-9873-f0c6526fa534 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:53.207720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be383829-967d-4bc9-a6c7-1e76b79e3b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:53.208312 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be383829-967d-4bc9-a6c7-1e76b79e3b00 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:53.208599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be383829-967d-4bc9-a6c7-1e76b79e3b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:53.208879 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be383829-967d-4bc9-a6c7-1e76b79e3b00 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:53.209607 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be383829-967d-4bc9-a6c7-1e76b79e3b00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:53.209915 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be383829-967d-4bc9-a6c7-1e76b79e3b00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:53.211346 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be383829-967d-4bc9-a6c7-1e76b79e3b00 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:53.219044 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 229/463] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:53.220099 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf51db-83a8-4208-bdc1-7dce7a8b9ecc None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:53.238201 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 235/464] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:53.239814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c10af-dcf8-4a1f-8104-c452f9a82f44 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:53.240278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c10af-dcf8-4a1f-8104-c452f9a82f44 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:53.240704 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c10af-dcf8-4a1f-8104-c452f9a82f44 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:53.246300 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 236/465] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:53.247308 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c10af-dcf8-4a1f-8104-c452f9a82f44 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:53.323806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf51db-83a8-4208-bdc1-7dce7a8b9ecc None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:53.348259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c10af-dcf8-4a1f-8104-c452f9a82f44 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:53.358059 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869528b1-3846-4ed8-bc90-6419271f232c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:53.358760 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869528b1-3846-4ed8-bc90-6419271f232c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:53.359057 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869528b1-3846-4ed8-bc90-6419271f232c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:53.359366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869528b1-3846-4ed8-bc90-6419271f232c None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:53.360073 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869528b1-3846-4ed8-bc90-6419271f232c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:53.360411 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869528b1-3846-4ed8-bc90-6419271f232c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:53.361755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869528b1-3846-4ed8-bc90-6419271f232c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:53.377056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 230/466] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:53.377056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347d8ca-edd1-4bc5-b213-b1293b1d4039 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:53.377056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347d8ca-edd1-4bc5-b213-b1293b1d4039 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:53.377056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347d8ca-edd1-4bc5-b213-b1293b1d4039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:53.386258 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cfcd5-23be-402e-bf93-c2458a9a29f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:53.386958 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cfcd5-23be-402e-bf93-c2458a9a29f5 None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:53.387240 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cfcd5-23be-402e-bf93-c2458a9a29f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:53.387513 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cfcd5-23be-402e-bf93-c2458a9a29f5 None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:53.388224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1cfcd5-23be-402e-bf93-c2458a9a29f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:53.389649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1cfcd5-23be-402e-bf93-c2458a9a29f5 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:53.392088 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-9347d8ca-edd1-4bc5-b213-b1293b1d4039 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:53.393262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9347d8ca-edd1-4bc5-b213-b1293b1d4039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:53.457382 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 231/467] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:53.458288 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347d8ca-edd1-4bc5-b213-b1293b1d4039 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:53.502089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 237/468] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 10 21:01:53 2022] POST /identity/v3/users => generated 248 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:01:53.503151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cfcd5-23be-402e-bf93-c2458a9a29f5 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:53.580499 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347d8ca-edd1-4bc5-b213-b1293b1d4039 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:53.614798 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cfcd5-23be-402e-bf93-c2458a9a29f5 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:53.625120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c8c64-da6a-4ad3-a296-83d126e59300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:53.625958 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c8c64-da6a-4ad3-a296-83d126e59300 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:53.626241 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c8c64-da6a-4ad3-a296-83d126e59300 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:53.626906 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c8c64-da6a-4ad3-a296-83d126e59300 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:53.641578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c8c64-da6a-4ad3-a296-83d126e59300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:53.643836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c8c64-da6a-4ad3-a296-83d126e59300 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:53.654598 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfd354-704b-493a-b31b-4c858cea9bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:53.655565 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfd354-704b-493a-b31b-4c858cea9bd8 None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:53.655999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfd354-704b-493a-b31b-4c858cea9bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:53.656442 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfd354-704b-493a-b31b-4c858cea9bd8 None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:53.657315 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfd354-704b-493a-b31b-4c858cea9bd8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:53.658970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfd354-704b-493a-b31b-4c858cea9bd8 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:53.665165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-c72c8c64-da6a-4ad3-a296-83d126e59300 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:53.665165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:53.665165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:53.665165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:53.665165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:53.665165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:53.665165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:53.665165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:53.665165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:53.665165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:53.665165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:53.665165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:53.665165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:01:53.665165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:01:53.665165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:01:53.666398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:01:53.666398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:53.666398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:53.666398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:53.666398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:53.666398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:53.666398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:53.666398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:53.666398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:53.666398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:53.666398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:53.666398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:53.666398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:53.666398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:53.666398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:53.666398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:53.666398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:53.667356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:01:53.667356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:01:53.667356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:53.667356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:53.667356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 232/469] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:53.667356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c8c64-da6a-4ad3-a296-83d126e59300 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:53.739654 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 238/470] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 10 21:01:53 2022] POST /identity/v3/users => generated 246 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:01:53.743036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfd354-704b-493a-b31b-4c858cea9bd8 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:53.778743 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c8c64-da6a-4ad3-a296-83d126e59300 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:53.817346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446124e-2e54-453b-8d4a-d6b100d7a048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:53.818229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446124e-2e54-453b-8d4a-d6b100d7a048 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:53.818603 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446124e-2e54-453b-8d4a-d6b100d7a048 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:53.818878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446124e-2e54-453b-8d4a-d6b100d7a048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:53.831594 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446124e-2e54-453b-8d4a-d6b100d7a048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:53.833091 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446124e-2e54-453b-8d4a-d6b100d7a048 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:53.854111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-d446124e-2e54-453b-8d4a-d6b100d7a048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:53.854111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:53.854111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:53.854111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:53.854111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:53.854111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:53.854111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:53.854111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:53.854111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:53.854111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:53.854111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:53.854111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:53.854111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:01:53.854111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:01:53.854111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:01:53.857752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:01:53.857752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:53.857752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:53.857752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:53.857752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:53.857752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:53.857752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:53.857752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:53.857752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:53.857752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:53.857752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:53.857752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:53.857752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:53.857752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:53.857752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:53.857752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:53.857752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:53.858630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:01:53.858630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:01:53.858630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:53.858630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:53.858630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 233/471] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:53.863613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfd354-704b-493a-b31b-4c858cea9bd8 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:53.867480 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446124e-2e54-453b-8d4a-d6b100d7a048 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:53.917114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da8107-13bc-4b6b-a002-b8f8fdf5a6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:53.917827 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da8107-13bc-4b6b-a002-b8f8fdf5a6df None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:53.918110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da8107-13bc-4b6b-a002-b8f8fdf5a6df None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:53.918421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da8107-13bc-4b6b-a002-b8f8fdf5a6df None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:53.919166 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da8107-13bc-4b6b-a002-b8f8fdf5a6df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:53.919471 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da8107-13bc-4b6b-a002-b8f8fdf5a6df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:53.920871 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da8107-13bc-4b6b-a002-b8f8fdf5a6df None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:53.935893 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 239/472] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:53.942469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da8107-13bc-4b6b-a002-b8f8fdf5a6df None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:54.016793 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446124e-2e54-453b-8d4a-d6b100d7a048 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:54.053070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da8107-13bc-4b6b-a002-b8f8fdf5a6df None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:54.053662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960a8b9-d66a-4e61-b9c2-892fbcd01e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:54.054333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960a8b9-d66a-4e61-b9c2-892fbcd01e67 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:54.054646 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960a8b9-d66a-4e61-b9c2-892fbcd01e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:54.054923 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960a8b9-d66a-4e61-b9c2-892fbcd01e67 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:54.056220 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960a8b9-d66a-4e61-b9c2-892fbcd01e67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:54.056522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960a8b9-d66a-4e61-b9c2-892fbcd01e67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:54.057954 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960a8b9-d66a-4e61-b9c2-892fbcd01e67 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:54.071898 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 234/473] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:54.077205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960a8b9-d66a-4e61-b9c2-892fbcd01e67 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:54.092261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd274eaf-57ce-44ef-94cf-2dc2ca38f8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:54.093204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd274eaf-57ce-44ef-94cf-2dc2ca38f8be None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:54.093635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd274eaf-57ce-44ef-94cf-2dc2ca38f8be None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:54.094068 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd274eaf-57ce-44ef-94cf-2dc2ca38f8be None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:54.094979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd274eaf-57ce-44ef-94cf-2dc2ca38f8be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:54.096596 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd274eaf-57ce-44ef-94cf-2dc2ca38f8be None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:54.186404 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960a8b9-d66a-4e61-b9c2-892fbcd01e67 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:54.220873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf7be3-fdcc-4134-9a66-e0519923a994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:54.221554 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf7be3-fdcc-4134-9a66-e0519923a994 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:54.221841 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf7be3-fdcc-4134-9a66-e0519923a994 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:54.222121 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf7be3-fdcc-4134-9a66-e0519923a994 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:54.222871 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf7be3-fdcc-4134-9a66-e0519923a994 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:54.224297 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf7be3-fdcc-4134-9a66-e0519923a994 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:54.239707 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 240/474] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 10 21:01:53 2022] POST /identity/v3/users => generated 248 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:01:54.245816 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb1bb-5cbf-46c5-ac9a-7d47f1b7fc7a None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:54.245816 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb1bb-5cbf-46c5-ac9a-7d47f1b7fc7a None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:54.245816 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb1bb-5cbf-46c5-ac9a-7d47f1b7fc7a None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:54.245816 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 241/475] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:54.261425 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c21d7-e848-47c0-9d10-59e1fa7d0d45 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:54.264268 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c21d7-e848-47c0-9d10-59e1fa7d0d45 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:54.264268 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c21d7-e848-47c0-9d10-59e1fa7d0d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:54.280750 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-1a5c21d7-e848-47c0-9d10-59e1fa7d0d45 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:54.281898 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-1a5c21d7-e848-47c0-9d10-59e1fa7d0d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:54.324979 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 235/476] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 10 21:01:54 2022] POST /identity/v3/users => generated 249 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:01:54.380317 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 242/477] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:54.403656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf7be3-fdcc-4134-9a66-e0519923a994 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:54.533951 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf7be3-fdcc-4134-9a66-e0519923a994 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:54.575194 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62b037-17b2-4a26-a0b1-df5cc8b1269d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:54.575924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62b037-17b2-4a26-a0b1-df5cc8b1269d None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:54.576215 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62b037-17b2-4a26-a0b1-df5cc8b1269d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:54.576495 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62b037-17b2-4a26-a0b1-df5cc8b1269d None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:54.577263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62b037-17b2-4a26-a0b1-df5cc8b1269d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:54.578765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62b037-17b2-4a26-a0b1-df5cc8b1269d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:54.622577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.sql.core [None req-ad62b037-17b2-4a26-a0b1-df5cc8b1269d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 21:01:54.622577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 21:01:54.622577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [parameters: {'id': '393e89d7d5a54c5c97e3a273e3fd2497', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 21:01:54.622577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80454) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 21:01:54.639599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-ad62b037-17b2-4a26-a0b1-df5cc8b1269d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 21:01:54.639599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:54.639599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 21:01:54.639599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 21:01:54.639599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 21:01:54.639599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 21:01:54.639599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 21:01:54.639599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application result = self._query(query) May 10 21:01:54.639599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 21:01:54.639599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application conn.query(q) May 10 21:01:54.639599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 21:01:54.639599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 21:01:54.639599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 21:01:54.639599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application result.read() May 10 21:01:54.639599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 21:01:54.640510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 21:01:54.640510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 21:01:54.640510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 21:01:54.640510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 21:01:54.640510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 21:01:54.640510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 21:01:54.640510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 21:01:54.640510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 21:01:54.640510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:54.640510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 21:01:54.640510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:54.640510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:54.640510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 21:01:54.640510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 21:01:54.640510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 10 21:01:54.640510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return ref.to_dict() May 10 21:01:54.640510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 21:01:54.640510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application next(self.gen) May 10 21:01:54.641413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 21:01:54.641413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application yield resource May 10 21:01:54.641413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 21:01:54.641413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application next(self.gen) May 10 21:01:54.641413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 21:01:54.641413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.session.rollback() May 10 21:01:54.641413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 21:01:54.641413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.force_reraise() May 10 21:01:54.641413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 21:01:54.641413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise self.value May 10 21:01:54.641413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 21:01:54.641413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 21:01:54.641413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 21:01:54.641413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application session.commit() May 10 21:01:54.641413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 21:01:54.641413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 21:01:54.641413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 21:01:54.642292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._prepare_impl() May 10 21:01:54.642292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 21:01:54.642292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.session.flush() May 10 21:01:54.642292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 21:01:54.642292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._flush(objects) May 10 21:01:54.642292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 21:01:54.642292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 21:01:54.642292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 21:01:54.642292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application compat.raise_( May 10 21:01:54.642292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 21:01:54.642292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception May 10 21:01:54.642292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 21:01:54.642292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application flush_context.execute() May 10 21:01:54.642292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 21:01:54.642292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rec.execute(self) May 10 21:01:54.642292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 21:01:54.642292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 21:01:54.643596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 21:01:54.643596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 21:01:54.643596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 21:01:54.643596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 21:01:54.643596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 21:01:54.643596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 21:01:54.643596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 21:01:54.643596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 21:01:54.643596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 21:01:54.643596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 21:01:54.643596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 21:01:54.643596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 21:01:54.643596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 21:01:54.643596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 21:01:54.643596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 21:01:54.643596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception May 10 21:01:54.645021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 21:01:54.645021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 21:01:54.645021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 21:01:54.645021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 21:01:54.645021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 21:01:54.645021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application result = self._query(query) May 10 21:01:54.645021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 21:01:54.645021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application conn.query(q) May 10 21:01:54.645021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 21:01:54.645021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 21:01:54.645021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 21:01:54.645021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application result.read() May 10 21:01:54.645021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 21:01:54.645021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 21:01:54.645021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 21:01:54.645021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 21:01:54.651279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 21:01:54.651279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 21:01:54.651279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 21:01:54.651279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 21:01:54.651279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 21:01:54.651279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 21:01:54.651279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [parameters: {'id': '393e89d7d5a54c5c97e3a273e3fd2497', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 21:01:54.651279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 21:01:54.651279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:54.651279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:01:54.651279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:54.651279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:54.651279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:54.651279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:54.651279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:54.651279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:54.656677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:54.656677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:54.656677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:54.656677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:54.656677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:54.656677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:54.656677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 10 21:01:54.656677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 10 21:01:54.656677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:54.656677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:54.656677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 10 21:01:54.656677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 10 21:01:54.656677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 21:01:54.656677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 21:01:54.656677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 21:01:54.656677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:54.658707 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 236/478] 10.222.0.25 () {60 vars in 1131 bytes} [Tue May 10 21:01:54 2022] POST /identity/v3/roles => generated 144 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:54.658864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c21d7-e848-47c0-9d10-59e1fa7d0d45 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:54.788071 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c21d7-e848-47c0-9d10-59e1fa7d0d45 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:54.835679 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a9892-194f-47ca-a109-bcacfeb4bd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:54.836551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a9892-194f-47ca-a109-bcacfeb4bd5f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:54.837546 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a9892-194f-47ca-a109-bcacfeb4bd5f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:54.837826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a9892-194f-47ca-a109-bcacfeb4bd5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:54.865763 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a9892-194f-47ca-a109-bcacfeb4bd5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:54.873792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-3c5a9892-194f-47ca-a109-bcacfeb4bd5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:54.873792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:54.873792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:54.873792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:54.873792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:54.873792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:54.873792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:54.873792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:54.873792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:54.873792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:54.873792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:54.873792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:54.873792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:54.873792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:54.873792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:54.873792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:54.874734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:54.874734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:54.874734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:54.874734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:54.874734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:54.874734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:54.874734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:54.874734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:54.874734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:54.874734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:54.874734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:54.874734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:54.874734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:54.874734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:54.874734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:54.874734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:54.875553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:54.875553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:54.875553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:54.875553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:54.875553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:54.875553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:54.875553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:54.875553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:54.875553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:54.875553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:54.875553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 21:01:54.875553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:54.875553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 243/479] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:01:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:54.881838 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62b037-17b2-4a26-a0b1-df5cc8b1269d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:55.007788 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62b037-17b2-4a26-a0b1-df5cc8b1269d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:55.046075 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854fa83-e4cf-4508-8eb1-e43fe7d20d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:55.046698 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854fa83-e4cf-4508-8eb1-e43fe7d20d6a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:55.047241 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854fa83-e4cf-4508-8eb1-e43fe7d20d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:55.047520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854fa83-e4cf-4508-8eb1-e43fe7d20d6a None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:55.048277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854fa83-e4cf-4508-8eb1-e43fe7d20d6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:55.048583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854fa83-e4cf-4508-8eb1-e43fe7d20d6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:55.049938 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854fa83-e4cf-4508-8eb1-e43fe7d20d6a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:55.059399 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 237/480] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:01:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:56.431391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffb845-7cc2-4a83-a219-b4fefd492cb2 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:56.431917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffb845-7cc2-4a83-a219-b4fefd492cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:56.431994 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffb845-7cc2-4a83-a219-b4fefd492cb2 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:56.433665 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 244/481] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:56.439221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024de0a-546d-4ffa-b2fa-d2e7f9a550e9 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:56.439694 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024de0a-546d-4ffa-b2fa-d2e7f9a550e9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:56.439774 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024de0a-546d-4ffa-b2fa-d2e7f9a550e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:56.457300 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8024de0a-546d-4ffa-b2fa-d2e7f9a550e9 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:56.458516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8024de0a-546d-4ffa-b2fa-d2e7f9a550e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:56.534667 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 238/482] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:56.551234 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffb845-7cc2-4a83-a219-b4fefd492cb2 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:56.676602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffb845-7cc2-4a83-a219-b4fefd492cb2 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:56.710406 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9054def-f86e-4c5c-bfc0-db54b5261b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:56.711155 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9054def-f86e-4c5c-bfc0-db54b5261b32 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:56.711444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9054def-f86e-4c5c-bfc0-db54b5261b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:56.711753 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9054def-f86e-4c5c-bfc0-db54b5261b32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:56.727767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9054def-f86e-4c5c-bfc0-db54b5261b32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:56.735826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-a9054def-f86e-4c5c-bfc0-db54b5261b32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:01:56.735826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:56.735826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:56.735826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:56.735826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:56.735826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:56.735826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:56.735826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:56.735826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:56.735826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:56.735826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:56.735826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:56.735826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:56.735826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:56.735826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:56.735826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:56.736721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:56.736721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:56.736721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:56.736721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:56.736721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:56.736721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:56.736721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:56.736721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:56.736721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:56.736721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:56.736721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:56.736721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:56.736721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:56.736721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:56.736721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:56.736721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:56.737599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:56.737599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:56.737599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:56.737599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:56.737599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:56.737599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:56.737599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:56.737599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:56.737599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:56.737599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:56.737599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:01:56.737599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:56.741764 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 245/483] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:01:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:56.743733 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024de0a-546d-4ffa-b2fa-d2e7f9a550e9 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:56.772737 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad004a7-ec9c-4993-8977-9b550bd0696e None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:56.773057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad004a7-ec9c-4993-8977-9b550bd0696e None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:56.773312 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad004a7-ec9c-4993-8977-9b550bd0696e None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:56.775934 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 246/484] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:56.792571 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f2789-4984-4fbe-9785-a81fee1d63df None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:56.792772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f2789-4984-4fbe-9785-a81fee1d63df None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:56.793055 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f2789-4984-4fbe-9785-a81fee1d63df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:56.823341 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-575f2789-4984-4fbe-9785-a81fee1d63df None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:56.824549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-575f2789-4984-4fbe-9785-a81fee1d63df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:56.932166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024de0a-546d-4ffa-b2fa-d2e7f9a550e9 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:56.967245 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 247/485] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 10 21:01:56.968998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8b95e-f10d-4101-b34e-378b3c074a76 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:56.969485 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8b95e-f10d-4101-b34e-378b3c074a76 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:56.969963 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8b95e-f10d-4101-b34e-378b3c074a76 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:56.971462 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 248/486] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:56.972342 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4534c1-a3ce-4a09-b467-1272fbb342c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:56.973259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4534c1-a3ce-4a09-b467-1272fbb342c3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:56.973745 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4534c1-a3ce-4a09-b467-1272fbb342c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:56.974241 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4534c1-a3ce-4a09-b467-1272fbb342c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:56.975244 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4534c1-a3ce-4a09-b467-1272fbb342c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:56.975777 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4534c1-a3ce-4a09-b467-1272fbb342c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:56.977977 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4534c1-a3ce-4a09-b467-1272fbb342c3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:56.985695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb25366-d9d4-428e-b7b6-9333935c5a79 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:56.986008 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb25366-d9d4-428e-b7b6-9333935c5a79 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:56.986265 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb25366-d9d4-428e-b7b6-9333935c5a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:56.993312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 239/487] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:01:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:56.994531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4534c1-a3ce-4a09-b467-1272fbb342c3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:57.015155 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-9cb25366-d9d4-428e-b7b6-9333935c5a79 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:57.016674 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-9cb25366-d9d4-428e-b7b6-9333935c5a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:57.096239 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4534c1-a3ce-4a09-b467-1272fbb342c3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:57.106471 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 249/488] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:57.106471 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb25366-d9d4-428e-b7b6-9333935c5a79 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:57.151481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc498070-3721-4f96-8b71-81cf4b990a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:57.152674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc498070-3721-4f96-8b71-81cf4b990a08 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:57.153154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc498070-3721-4f96-8b71-81cf4b990a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:57.153618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc498070-3721-4f96-8b71-81cf4b990a08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:57.167131 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc498070-3721-4f96-8b71-81cf4b990a08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:57.175372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-cc498070-3721-4f96-8b71-81cf4b990a08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:01:57.175372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:57.175372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:57.175372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:57.175372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:57.175372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:57.175372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:57.175372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:57.175372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:57.175372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:57.175372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:57.175372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:57.175372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:57.175372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:57.175372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:57.175372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:57.176315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:57.176315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:57.176315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:57.176315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:57.176315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:57.176315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:57.176315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:57.176315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:57.176315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:57.176315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:57.176315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:57.176315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:57.176315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:57.176315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:57.176315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:57.176315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:57.177142 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:57.177142 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:57.177142 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:57.177142 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:57.177142 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:57.177142 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:57.177142 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:57.177142 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:57.177142 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:57.177142 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:57.177142 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:01:57.177142 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:57.177142 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 240/489] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:01:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:57.177804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc498070-3721-4f96-8b71-81cf4b990a08 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:57.211701 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb25366-d9d4-428e-b7b6-9333935c5a79 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:57.248316 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101d7bd-5ad9-4369-bfbc-053a988d37a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:57.249037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101d7bd-5ad9-4369-bfbc-053a988d37a6 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:57.249325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101d7bd-5ad9-4369-bfbc-053a988d37a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:57.249603 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101d7bd-5ad9-4369-bfbc-053a988d37a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:57.259349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101d7bd-5ad9-4369-bfbc-053a988d37a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:57.260808 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101d7bd-5ad9-4369-bfbc-053a988d37a6 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:57.277704 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc498070-3721-4f96-8b71-81cf4b990a08 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:57.278274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-5101d7bd-5ad9-4369-bfbc-053a988d37a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:57.278274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:57.278274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:57.278274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:57.278274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:57.278274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:57.278274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:57.278274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:57.278274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:57.278274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:57.278274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:57.278274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:57.278274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:01:57.278274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:01:57.278274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:01:57.279259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:01:57.279259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:57.279259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:57.279259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:57.279259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:57.279259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:57.279259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:57.279259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:57.279259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:57.279259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:57.279259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:57.279259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:57.279259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:57.279259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:57.279259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:57.279259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:57.279259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:57.280641 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:01:57.280641 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:01:57.280641 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:57.280641 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:57.280641 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 250/490] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:57.281017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bb021-98e0-460c-a65a-1bcd3af2623d None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:57.281293 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bb021-98e0-460c-a65a-1bcd3af2623d None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:57.281567 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bb021-98e0-460c-a65a-1bcd3af2623d None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:57.282986 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 251/491] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:57.287443 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bb021-98e0-460c-a65a-1bcd3af2623d None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:57.315868 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff64b2d-2ba7-4b70-b36f-341a6c75a253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:57.316664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff64b2d-2ba7-4b70-b36f-341a6c75a253 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:57.316947 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff64b2d-2ba7-4b70-b36f-341a6c75a253 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:57.317221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff64b2d-2ba7-4b70-b36f-341a6c75a253 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:57.327229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff64b2d-2ba7-4b70-b36f-341a6c75a253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:57.334865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-2ff64b2d-2ba7-4b70-b36f-341a6c75a253 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:01:57.334865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:57.334865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:57.334865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:57.334865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:57.334865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:57.334865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:57.334865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:57.334865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:57.334865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:57.334865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:57.334865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:57.334865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:57.334865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:57.334865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:57.334865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:57.335790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:57.335790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:57.335790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:57.335790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:57.335790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:57.335790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:57.335790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:57.335790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:57.335790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:57.335790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:57.335790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:57.335790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:57.335790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:57.335790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:57.335790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:57.335790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:57.336601 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:57.336601 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:57.336601 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:57.336601 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:57.336601 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:57.336601 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:57.336601 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:57.336601 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:57.336601 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:57.336601 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:57.336601 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:01:57.336601 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:57.336601 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 241/492] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:01:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:57.337931 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff64b2d-2ba7-4b70-b36f-341a6c75a253 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:57.395462 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bb021-98e0-460c-a65a-1bcd3af2623d None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:57.428264 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74d7f0-6758-4a4e-b534-4f1606f78ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:57.428934 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74d7f0-6758-4a4e-b534-4f1606f78ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:57.429214 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74d7f0-6758-4a4e-b534-4f1606f78ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:57.429488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74d7f0-6758-4a4e-b534-4f1606f78ee1 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:57.430978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74d7f0-6758-4a4e-b534-4f1606f78ee1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:57.431215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74d7f0-6758-4a4e-b534-4f1606f78ee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:57.432555 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74d7f0-6758-4a4e-b534-4f1606f78ee1 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:57.439738 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff64b2d-2ba7-4b70-b36f-341a6c75a253 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:57.440281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 252/493] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:01:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:57.441447 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6532da9-27df-45be-8de8-64d1b506a0af None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:57.441733 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6532da9-27df-45be-8de8-64d1b506a0af None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:57.442009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6532da9-27df-45be-8de8-64d1b506a0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:57.458944 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-a6532da9-27df-45be-8de8-64d1b506a0af None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:57.460038 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a6532da9-27df-45be-8de8-64d1b506a0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:57.476487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287228de-2ee9-4e68-8f0a-d0039ba29f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:57.478248 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287228de-2ee9-4e68-8f0a-d0039ba29f68 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:57.478571 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287228de-2ee9-4e68-8f0a-d0039ba29f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:57.478853 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287228de-2ee9-4e68-8f0a-d0039ba29f68 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:57.479585 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287228de-2ee9-4e68-8f0a-d0039ba29f68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:57.479894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287228de-2ee9-4e68-8f0a-d0039ba29f68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:57.481245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287228de-2ee9-4e68-8f0a-d0039ba29f68 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:57.497541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 242/494] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:57.497541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287228de-2ee9-4e68-8f0a-d0039ba29f68 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:57.538539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 253/495] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:57.538539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6532da9-27df-45be-8de8-64d1b506a0af None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:57.593104 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287228de-2ee9-4e68-8f0a-d0039ba29f68 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:57.626809 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8805f-bbc3-4dac-97b6-50fcfd212667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:57.627474 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8805f-bbc3-4dac-97b6-50fcfd212667 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:57.627755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8805f-bbc3-4dac-97b6-50fcfd212667 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:57.628026 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8805f-bbc3-4dac-97b6-50fcfd212667 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:57.628754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6532da9-27df-45be-8de8-64d1b506a0af None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:57.628875 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8805f-bbc3-4dac-97b6-50fcfd212667 None admin] RBAC: Adding query filter params (name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:57.629059 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8805f-bbc3-4dac-97b6-50fcfd212667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:57.630421 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8805f-bbc3-4dac-97b6-50fcfd212667 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:57.638710 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 243/496] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:01:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:57.643541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8805f-bbc3-4dac-97b6-50fcfd212667 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:57.666403 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50fde1-98d5-455d-9bf1-f991970c5b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:57.667225 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50fde1-98d5-455d-9bf1-f991970c5b54 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:57.667510 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50fde1-98d5-455d-9bf1-f991970c5b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:57.667786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50fde1-98d5-455d-9bf1-f991970c5b54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:57.678184 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50fde1-98d5-455d-9bf1-f991970c5b54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:57.679659 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50fde1-98d5-455d-9bf1-f991970c5b54 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:57.697313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-2b50fde1-98d5-455d-9bf1-f991970c5b54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:57.697313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:57.697313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:57.697313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:57.697313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:57.697313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:57.697313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:57.697313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:57.697313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:57.697313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:57.697313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:57.697313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:57.697313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:01:57.697313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:01:57.697313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:01:57.698213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:01:57.698213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:57.698213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:57.698213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:57.698213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:57.698213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:57.698213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:57.698213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:57.698213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:57.698213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:57.698213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:57.698213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:57.698213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:57.698213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:57.698213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:57.698213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:57.698213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:57.704141 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:01:57.704141 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:01:57.704141 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:57.704141 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:57.704141 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 254/497] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:57.704141 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50fde1-98d5-455d-9bf1-f991970c5b54 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:57.742256 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8805f-bbc3-4dac-97b6-50fcfd212667 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:57.773869 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9598f27-757f-4c35-8cca-f6daca203dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:57.775458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9598f27-757f-4c35-8cca-f6daca203dbb None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:57.775735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9598f27-757f-4c35-8cca-f6daca203dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:57.776003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9598f27-757f-4c35-8cca-f6daca203dbb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:57.784180 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9598f27-757f-4c35-8cca-f6daca203dbb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:57.785614 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9598f27-757f-4c35-8cca-f6daca203dbb None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:57.801652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-f9598f27-757f-4c35-8cca-f6daca203dbb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 21:01:57.801652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:57.801652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:57.801652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:57.801652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:57.801652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:57.801652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:57.801652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:57.801652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:57.801652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:57.801652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:57.801652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:57.801652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:01:57.801652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:01:57.801652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:01:57.801652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:01:57.802741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:57.802741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:57.802741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:01:57.802741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:01:57.802741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:01:57.802741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:01:57.802741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:57.802741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:57.802741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:57.802741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:57.802741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:57.802741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:57.802741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:57.802741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:57.802741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:57.802741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:57.802741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:57.802741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:57.803649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:57.803649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:57.803649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:01:57.803649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:01:57.803649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:01:57.803649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:01:57.803649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:01:57.803649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:01:57.803649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 21:01:57.803649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:57.806708 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50fde1-98d5-455d-9bf1-f991970c5b54 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:57.807718 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 244/498] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:57.808333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9598f27-757f-4c35-8cca-f6daca203dbb None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:57.844203 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129b37b-a700-4fe2-aae4-d1492a55e57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:57.845018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129b37b-a700-4fe2-aae4-d1492a55e57c None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:57.845307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129b37b-a700-4fe2-aae4-d1492a55e57c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:57.845588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129b37b-a700-4fe2-aae4-d1492a55e57c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:57.857509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129b37b-a700-4fe2-aae4-d1492a55e57c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:01:57.865179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-0129b37b-a700-4fe2-aae4-d1492a55e57c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:01:57.865179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:57.865179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:57.865179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:57.865179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:57.865179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:57.865179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:57.865179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:57.865179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:57.865179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:57.865179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:57.865179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:57.865179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:01:57.865179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:01:57.865179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:01:57.865179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:01:57.866114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:01:57.866114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:01:57.866114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:01:57.866114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:01:57.866114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:57.866114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:57.866114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:57.866114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:57.866114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:57.866114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:57.866114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:57.866114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:57.866114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:57.866114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:57.866114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:57.866114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:57.866967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:57.866967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:57.866967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:57.866967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:57.866967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:01:57.866967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:01:57.866967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:01:57.866967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:01:57.866967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:01:57.866967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:01:57.866967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:01:57.866967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:57.866967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 255/499] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:01:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:57.867649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129b37b-a700-4fe2-aae4-d1492a55e57c None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:57.923423 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9598f27-757f-4c35-8cca-f6daca203dbb None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:57.962061 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb8ab5-3652-49be-95dc-ba11d06dc85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:57.962989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb8ab5-3652-49be-95dc-ba11d06dc85f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:57.963300 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb8ab5-3652-49be-95dc-ba11d06dc85f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:57.963540 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb8ab5-3652-49be-95dc-ba11d06dc85f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:57.971496 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129b37b-a700-4fe2-aae4-d1492a55e57c None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:57.973980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb8ab5-3652-49be-95dc-ba11d06dc85f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:57.975457 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb8ab5-3652-49be-95dc-ba11d06dc85f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:57.992484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-d0eb8ab5-3652-49be-95dc-ba11d06dc85f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:57.992484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:57.992484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:57.992484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:57.992484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:57.992484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:57.992484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:57.992484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:57.992484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:57.992484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:57.992484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:57.992484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:57.992484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:01:57.992484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:01:57.992484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:01:57.993390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:01:57.993390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:57.993390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:57.993390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:57.993390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:57.993390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:57.993390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:57.993390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:57.993390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:57.993390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:57.993390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:57.993390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:57.993390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:57.993390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:57.993390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:57.993390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:57.993390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:57.994304 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:01:57.994304 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:01:57.994304 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:57.994304 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:57.994304 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 245/500] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:57.994617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb8ab5-3652-49be-95dc-ba11d06dc85f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:58.009813 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad32f20-2bbb-43e0-a1de-278ac4a822b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:58.010530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad32f20-2bbb-43e0-a1de-278ac4a822b3 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:58.010785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad32f20-2bbb-43e0-a1de-278ac4a822b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:58.011062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad32f20-2bbb-43e0-a1de-278ac4a822b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:58.011789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad32f20-2bbb-43e0-a1de-278ac4a822b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:58.012093 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad32f20-2bbb-43e0-a1de-278ac4a822b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:58.013466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad32f20-2bbb-43e0-a1de-278ac4a822b3 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:58.026341 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 256/501] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:58.027182 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad32f20-2bbb-43e0-a1de-278ac4a822b3 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:58.097046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb8ab5-3652-49be-95dc-ba11d06dc85f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:58.123543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad32f20-2bbb-43e0-a1de-278ac4a822b3 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:58.128409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1c3f1-49b4-47eb-9981-d69660fd68f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:58.129075 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1c3f1-49b4-47eb-9981-d69660fd68f5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:58.129364 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1c3f1-49b4-47eb-9981-d69660fd68f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:58.129644 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1c3f1-49b4-47eb-9981-d69660fd68f5 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:58.130642 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1c3f1-49b4-47eb-9981-d69660fd68f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:58.130955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1c3f1-49b4-47eb-9981-d69660fd68f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:58.132372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1c3f1-49b4-47eb-9981-d69660fd68f5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:58.156136 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91deebb-c351-48d5-b9cc-8cb65f282932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:58.156796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91deebb-c351-48d5-b9cc-8cb65f282932 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:58.157077 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91deebb-c351-48d5-b9cc-8cb65f282932 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:58.157350 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91deebb-c351-48d5-b9cc-8cb65f282932 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:58.158084 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91deebb-c351-48d5-b9cc-8cb65f282932 None admin] RBAC: Adding query filter params (name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:58.158384 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91deebb-c351-48d5-b9cc-8cb65f282932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:58.159770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91deebb-c351-48d5-b9cc-8cb65f282932 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:58.167359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 257/502] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:01:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:58.168124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91deebb-c351-48d5-b9cc-8cb65f282932 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:58.173544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 246/503] 10.222.0.25 () {56 vars in 1137 bytes} [Tue May 10 21:01:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:58.173544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1c3f1-49b4-47eb-9981-d69660fd68f5 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:58.262603 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91deebb-c351-48d5-b9cc-8cb65f282932 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:58.262893 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1c3f1-49b4-47eb-9981-d69660fd68f5 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:58.295351 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0a0ec-2ce3-4212-8d19-8092095e1e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:58.296003 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0a0ec-2ce3-4212-8d19-8092095e1e65 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:58.296289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0a0ec-2ce3-4212-8d19-8092095e1e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:58.296556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0a0ec-2ce3-4212-8d19-8092095e1e65 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:58.297533 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0a0ec-2ce3-4212-8d19-8092095e1e65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:58.297834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0a0ec-2ce3-4212-8d19-8092095e1e65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:58.299207 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0a0ec-2ce3-4212-8d19-8092095e1e65 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:58.303873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d4a59-2faf-46e3-b17a-322eefdd1bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:58.304661 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d4a59-2faf-46e3-b17a-322eefdd1bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:58.304954 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d4a59-2faf-46e3-b17a-322eefdd1bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:58.305798 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d4a59-2faf-46e3-b17a-322eefdd1bb9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:58.311194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 258/504] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:58.312416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6d38e-4014-4593-959d-2ffefda03c08 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:58.312698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6d38e-4014-4593-959d-2ffefda03c08 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:58.312970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6d38e-4014-4593-959d-2ffefda03c08 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:58.314167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 259/505] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:01:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:58.316056 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6d38e-4014-4593-959d-2ffefda03c08 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:58.317059 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d4a59-2faf-46e3-b17a-322eefdd1bb9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:58.318542 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d4a59-2faf-46e3-b17a-322eefdd1bb9 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:58.333755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-1f1d4a59-2faf-46e3-b17a-322eefdd1bb9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 21:01:58.333755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:58.333755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:58.333755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:58.333755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:58.333755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:58.333755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:58.333755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:58.333755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:58.333755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:58.333755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:58.333755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:58.333755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:01:58.333755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:01:58.333755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:01:58.333755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:01:58.334778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:58.334778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:58.334778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:01:58.334778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:01:58.334778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:01:58.334778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:01:58.334778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:58.334778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:58.334778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:58.334778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:58.334778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:58.334778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:58.334778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:58.334778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:58.334778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:58.334778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:58.334778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:58.334778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:58.335685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:58.335685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:58.335685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:01:58.335685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:01:58.335685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:01:58.335685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:01:58.335685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:01:58.335685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:01:58.335685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 21:01:58.335685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:58.335685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 247/506] 10.222.0.25 () {56 vars in 1093 bytes} [Tue May 10 21:01:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:58.336471 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d4a59-2faf-46e3-b17a-322eefdd1bb9 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:58.421239 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6d38e-4014-4593-959d-2ffefda03c08 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:58.434617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d4a59-2faf-46e3-b17a-322eefdd1bb9 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:58.454610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4fc96-90a9-45cc-9fbe-85500afc16a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:58.455394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4fc96-90a9-45cc-9fbe-85500afc16a9 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:58.455671 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4fc96-90a9-45cc-9fbe-85500afc16a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:58.455936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4fc96-90a9-45cc-9fbe-85500afc16a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:58.465915 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4fc96-90a9-45cc-9fbe-85500afc16a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:58.467375 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4fc96-90a9-45cc-9fbe-85500afc16a9 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:58.467919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c8b21-ef96-4e0c-9f13-49d7ffd44a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:58.468564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c8b21-ef96-4e0c-9f13-49d7ffd44a36 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:58.468853 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c8b21-ef96-4e0c-9f13-49d7ffd44a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:58.469137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c8b21-ef96-4e0c-9f13-49d7ffd44a36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:58.485394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-3eb4fc96-90a9-45cc-9fbe-85500afc16a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:58.485394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:58.485394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:58.485394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:58.485394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:58.485394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:58.485394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:58.485394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:58.485394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:58.485394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:58.485394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:58.485394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:58.485394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:01:58.485394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:01:58.485394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:01:58.486286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:01:58.486286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:58.486286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:58.486286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:58.486286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:58.486286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:58.486286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:58.486286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:58.486286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:58.486286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:58.486286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:58.486286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:58.486286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:58.486286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:58.486286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:58.486286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:58.486286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:58.487186 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:01:58.487186 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:01:58.487186 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:58.487186 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:58.487186 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 260/507] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:58.487461 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4fc96-90a9-45cc-9fbe-85500afc16a9 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:58.532694 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c8b21-ef96-4e0c-9f13-49d7ffd44a36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:58.534154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c8b21-ef96-4e0c-9f13-49d7ffd44a36 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:58.583725 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4fc96-90a9-45cc-9fbe-85500afc16a9 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:58.615532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2e9e5-c311-4db5-aecf-ed19e9725cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:58.616315 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2e9e5-c311-4db5-aecf-ed19e9725cfd None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:58.616596 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2e9e5-c311-4db5-aecf-ed19e9725cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:58.616868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2e9e5-c311-4db5-aecf-ed19e9725cfd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:58.624113 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2e9e5-c311-4db5-aecf-ed19e9725cfd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:58.625537 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2e9e5-c311-4db5-aecf-ed19e9725cfd None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:58.626754 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 248/508] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:58.629162 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254de92-85b9-440d-acfa-fb3bfcba9eda None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:58.629458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254de92-85b9-440d-acfa-fb3bfcba9eda None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:58.629801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254de92-85b9-440d-acfa-fb3bfcba9eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:58.641626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-e6f2e9e5-c311-4db5-aecf-ed19e9725cfd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 21:01:58.641626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:58.641626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:58.641626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:58.641626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:58.641626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:58.641626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:58.641626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:58.641626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:58.641626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:58.641626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:58.641626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:58.641626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:01:58.641626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:01:58.641626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:01:58.641626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:01:58.642655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:58.642655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:58.642655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:01:58.642655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:01:58.642655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:01:58.642655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:01:58.642655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:58.642655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:58.642655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:58.642655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:58.642655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:58.642655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:58.642655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:58.642655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:58.642655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:58.642655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:58.642655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:58.642655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:58.643584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:58.643584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:58.643584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:01:58.643584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:01:58.643584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:01:58.643584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:01:58.643584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:01:58.643584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:01:58.643584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 21:01:58.643584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:58.643584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 261/509] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:01:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:58.644135 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2e9e5-c311-4db5-aecf-ed19e9725cfd None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:58.648290 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b254de92-85b9-440d-acfa-fb3bfcba9eda None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:58.650042 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b254de92-85b9-440d-acfa-fb3bfcba9eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:58.711280 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 249/510] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:01:58.712629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254de92-85b9-440d-acfa-fb3bfcba9eda None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:58.742399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2e9e5-c311-4db5-aecf-ed19e9725cfd None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:58.773740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5dd3c-069f-400c-b749-7b0c9f52cd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:58.775109 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5dd3c-069f-400c-b749-7b0c9f52cd2b None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:58.775398 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5dd3c-069f-400c-b749-7b0c9f52cd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:58.775673 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5dd3c-069f-400c-b749-7b0c9f52cd2b None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:58.776517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5dd3c-069f-400c-b749-7b0c9f52cd2b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:58.776827 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5dd3c-069f-400c-b749-7b0c9f52cd2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:58.778272 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5dd3c-069f-400c-b749-7b0c9f52cd2b None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:58.804806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254de92-85b9-440d-acfa-fb3bfcba9eda None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:58.813198 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 262/511] 10.222.0.25 () {56 vars in 1133 bytes} [Tue May 10 21:01:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:58.814015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5dd3c-069f-400c-b749-7b0c9f52cd2b None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:58.837626 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33f3ac-e4bb-4ed4-9c44-cabf755aa9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:58.838291 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33f3ac-e4bb-4ed4-9c44-cabf755aa9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:58.838912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33f3ac-e4bb-4ed4-9c44-cabf755aa9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:58.838912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33f3ac-e4bb-4ed4-9c44-cabf755aa9f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:58.839579 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33f3ac-e4bb-4ed4-9c44-cabf755aa9f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:58.839886 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33f3ac-e4bb-4ed4-9c44-cabf755aa9f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:58.841273 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33f3ac-e4bb-4ed4-9c44-cabf755aa9f6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:58.852055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 250/512] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:58.852892 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33f3ac-e4bb-4ed4-9c44-cabf755aa9f6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:58.912685 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5dd3c-069f-400c-b749-7b0c9f52cd2b None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:58.944734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73956b-5d49-4664-ac0c-73e01db1ad66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:58.945518 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73956b-5d49-4664-ac0c-73e01db1ad66 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:58.946399 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33f3ac-e4bb-4ed4-9c44-cabf755aa9f6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:58.946544 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73956b-5d49-4664-ac0c-73e01db1ad66 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:58.946779 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73956b-5d49-4664-ac0c-73e01db1ad66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:58.956506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73956b-5d49-4664-ac0c-73e01db1ad66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:58.957941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73956b-5d49-4664-ac0c-73e01db1ad66 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:58.975094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-1d73956b-5d49-4664-ac0c-73e01db1ad66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:58.975094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:58.975094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:58.975094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:58.975094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:58.975094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:58.975094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:58.975094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:58.975094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:58.975094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:58.975094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:58.975094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:58.975094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:01:58.975094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:01:58.975094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:01:58.975981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:01:58.975981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:58.975981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:58.975981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:58.975981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:58.975981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:58.975981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:58.975981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:58.975981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:58.975981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:58.975981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:58.975981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:58.975981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:58.975981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:58.975981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:58.975981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:58.975981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:58.977123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:01:58.977123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:01:58.977123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:58.977123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:58.977123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 263/513] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:58.977123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73956b-5d49-4664-ac0c-73e01db1ad66 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:58.978883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd2d37-7101-4933-9370-75bddaac7efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:58.979585 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd2d37-7101-4933-9370-75bddaac7efe None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:58.979873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd2d37-7101-4933-9370-75bddaac7efe None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:58.980151 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd2d37-7101-4933-9370-75bddaac7efe None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:58.981023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd2d37-7101-4933-9370-75bddaac7efe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:58.981336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd2d37-7101-4933-9370-75bddaac7efe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:58.982787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd2d37-7101-4933-9370-75bddaac7efe None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:58.999732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 251/514] 10.222.0.25 () {56 vars in 1137 bytes} [Tue May 10 21:01:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:59.000530 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd2d37-7101-4933-9370-75bddaac7efe None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:59.073870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73956b-5d49-4664-ac0c-73e01db1ad66 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:59.094259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd2d37-7101-4933-9370-75bddaac7efe None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:59.104882 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c711144-d387-4f19-9e12-463bf281e928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:59.105670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c711144-d387-4f19-9e12-463bf281e928 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:59.105949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c711144-d387-4f19-9e12-463bf281e928 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:59.106221 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c711144-d387-4f19-9e12-463bf281e928 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:59.116597 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c711144-d387-4f19-9e12-463bf281e928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:59.118768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c711144-d387-4f19-9e12-463bf281e928 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:59.125899 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702c7bb-ef44-45e3-90d2-7bc18f0c200a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:59.126566 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702c7bb-ef44-45e3-90d2-7bc18f0c200a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:59.126848 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702c7bb-ef44-45e3-90d2-7bc18f0c200a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:59.127120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702c7bb-ef44-45e3-90d2-7bc18f0c200a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:59.135289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-9c711144-d387-4f19-9e12-463bf281e928 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:59.135289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:59.135289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:59.135289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:59.135289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:59.135289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:59.135289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:59.135289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:59.135289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:59.135289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:59.135289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:59.135289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:59.135289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:01:59.135289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:01:59.135289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:01:59.136281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:01:59.136281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:59.136281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:59.136281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:59.136281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:59.136281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:59.136281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:59.136281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:59.136281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:59.136281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:59.136281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:59.136281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:59.136281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:59.136281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:59.136281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:59.136281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:59.136281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:59.137189 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:01:59.137189 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:01:59.137189 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:59.137189 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:59.137189 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 264/515] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:59.137714 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c711144-d387-4f19-9e12-463bf281e928 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:59.195848 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702c7bb-ef44-45e3-90d2-7bc18f0c200a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:59.197298 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702c7bb-ef44-45e3-90d2-7bc18f0c200a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:59.231299 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c711144-d387-4f19-9e12-463bf281e928 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:59.263682 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9671f-97a5-4a29-9dfc-a425dd21ec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:59.264461 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9671f-97a5-4a29-9dfc-a425dd21ec3e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:59.264739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9671f-97a5-4a29-9dfc-a425dd21ec3e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:59.265012 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9671f-97a5-4a29-9dfc-a425dd21ec3e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:59.271728 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9671f-97a5-4a29-9dfc-a425dd21ec3e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:59.273155 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9671f-97a5-4a29-9dfc-a425dd21ec3e None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:59.287640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-86f9671f-97a5-4a29-9dfc-a425dd21ec3e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 21:01:59.287640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:59.287640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:59.287640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:59.287640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:59.287640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:59.287640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:59.287640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:59.287640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:59.287640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:59.287640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:59.287640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:59.287640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:01:59.287640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:01:59.287640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:01:59.287640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:01:59.288556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:59.288556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:59.288556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:01:59.288556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:01:59.288556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:01:59.288556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:01:59.288556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:59.288556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:59.288556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:59.288556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:59.288556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:59.288556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:59.288556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:59.288556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:59.288556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:59.288556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:59.288556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:59.288556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:59.290512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:59.290512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:59.290512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:01:59.290512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:01:59.290512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:01:59.290512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:01:59.290512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:01:59.290512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:01:59.290512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 21:01:59.290512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:59.290512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 265/516] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:01:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:59.290512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9671f-97a5-4a29-9dfc-a425dd21ec3e None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:59.292775 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 252/517] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:59.292775 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702c7bb-ef44-45e3-90d2-7bc18f0c200a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:59.384214 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9671f-97a5-4a29-9dfc-a425dd21ec3e None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:59.385280 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702c7bb-ef44-45e3-90d2-7bc18f0c200a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:59.416572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3de8ad-6ab6-4993-b286-bc6bb7053738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:59.417227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3de8ad-6ab6-4993-b286-bc6bb7053738 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:59.417650 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3de8ad-6ab6-4993-b286-bc6bb7053738 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:59.417931 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3de8ad-6ab6-4993-b286-bc6bb7053738 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:59.418166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a06e18-f833-4b15-ba78-a382a33bd88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:59.418675 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3de8ad-6ab6-4993-b286-bc6bb7053738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:59.418841 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a06e18-f833-4b15-ba78-a382a33bd88f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:59.418978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3de8ad-6ab6-4993-b286-bc6bb7053738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:59.419124 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a06e18-f833-4b15-ba78-a382a33bd88f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:59.419400 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a06e18-f833-4b15-ba78-a382a33bd88f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:59.420336 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3de8ad-6ab6-4993-b286-bc6bb7053738 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:59.431364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 266/518] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:59.432153 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3de8ad-6ab6-4993-b286-bc6bb7053738 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:59.483411 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a06e18-f833-4b15-ba78-a382a33bd88f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:59.484787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a06e18-f833-4b15-ba78-a382a33bd88f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:59.525657 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3de8ad-6ab6-4993-b286-bc6bb7053738 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:59.557143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83699f0-1190-47ad-b9a8-60beb616091c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:59.557794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83699f0-1190-47ad-b9a8-60beb616091c None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:59.558083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83699f0-1190-47ad-b9a8-60beb616091c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:59.558364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83699f0-1190-47ad-b9a8-60beb616091c None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:59.559116 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83699f0-1190-47ad-b9a8-60beb616091c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:59.559427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83699f0-1190-47ad-b9a8-60beb616091c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:59.560783 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83699f0-1190-47ad-b9a8-60beb616091c None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:59.572693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 267/519] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:59.573468 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83699f0-1190-47ad-b9a8-60beb616091c None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:59.576328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 253/520] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:01:59.577399 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a06e18-f833-4b15-ba78-a382a33bd88f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:59.668942 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a06e18-f833-4b15-ba78-a382a33bd88f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:59.670372 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83699f0-1190-47ad-b9a8-60beb616091c None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:59.701308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101db5b-9c2d-40cd-b5a2-e6261648d74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:59.701959 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101db5b-9c2d-40cd-b5a2-e6261648d74d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:59.702240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101db5b-9c2d-40cd-b5a2-e6261648d74d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:59.702557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101db5b-9c2d-40cd-b5a2-e6261648d74d None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:59.702771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12720a-6e3e-4aca-8005-f4200a396b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:59.703381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101db5b-9c2d-40cd-b5a2-e6261648d74d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:01:59.703557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12720a-6e3e-4aca-8005-f4200a396b28 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:59.703685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101db5b-9c2d-40cd-b5a2-e6261648d74d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:59.703841 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12720a-6e3e-4aca-8005-f4200a396b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:59.704120 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12720a-6e3e-4aca-8005-f4200a396b28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:59.705091 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101db5b-9c2d-40cd-b5a2-e6261648d74d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:59.714043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12720a-6e3e-4aca-8005-f4200a396b28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:59.715535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12720a-6e3e-4aca-8005-f4200a396b28 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:59.721662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 254/521] 10.222.0.25 () {56 vars in 1139 bytes} [Tue May 10 21:01:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:01:59.722457 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101db5b-9c2d-40cd-b5a2-e6261648d74d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:59.733154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-dc12720a-6e3e-4aca-8005-f4200a396b28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:59.733154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:59.733154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:59.733154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:59.733154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:59.733154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:59.733154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:59.733154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:59.733154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:59.733154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:59.733154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:59.733154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:59.733154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:01:59.733154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:01:59.733154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:01:59.734212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:01:59.734212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:59.734212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:59.734212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:59.734212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:59.734212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:59.734212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:59.734212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:59.734212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:01:59.734212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:59.734212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:59.734212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:59.734212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:59.734212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:59.734212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:59.734212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:59.734212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:59.735825 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:01:59.735825 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:01:59.735825 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:01:59.735825 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:01:59.735825 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 268/522] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:59.735825 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12720a-6e3e-4aca-8005-f4200a396b28 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:59.817603 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101db5b-9c2d-40cd-b5a2-e6261648d74d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:59.831612 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12720a-6e3e-4aca-8005-f4200a396b28 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:59.849397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fde917-45d5-4629-ae95-9b2729b69bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:59.850184 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fde917-45d5-4629-ae95-9b2729b69bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:59.850493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fde917-45d5-4629-ae95-9b2729b69bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:59.850772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fde917-45d5-4629-ae95-9b2729b69bf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:59.860179 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fde917-45d5-4629-ae95-9b2729b69bf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:59.861616 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fde917-45d5-4629-ae95-9b2729b69bf3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:59.864945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327db4af-5788-4eee-9389-fe374e5d0333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:59.865609 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327db4af-5788-4eee-9389-fe374e5d0333 None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:59.865896 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327db4af-5788-4eee-9389-fe374e5d0333 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:59.866172 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327db4af-5788-4eee-9389-fe374e5d0333 None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:59.866918 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327db4af-5788-4eee-9389-fe374e5d0333 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:59.868335 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327db4af-5788-4eee-9389-fe374e5d0333 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:59.875575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-41fde917-45d5-4629-ae95-9b2729b69bf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:01:59.875575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:01:59.875575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:01:59.875575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:01:59.875575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:01:59.875575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:01:59.875575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:01:59.875575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:01:59.875575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:01:59.875575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:01:59.875575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:01:59.875575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:01:59.875575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:01:59.875575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:01:59.875575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:01:59.876458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:01:59.876458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:01:59.876458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:01:59.876458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:01:59.876458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:01:59.876458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:01:59.876458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:01:59.876458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:01:59.876458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:01:59.876458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:01:59.876458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:01:59.876458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:01:59.876458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:01:59.876458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:01:59.876458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:01:59.876458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:01:59.876458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:01:59.877863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:01:59.877863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:01:59.877863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:01:59.877863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:01:59.877863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:01:59.877863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:01:59.877863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:01:59.877863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:01:59.877863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 255/523] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:01:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:01:59.877863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fde917-45d5-4629-ae95-9b2729b69bf3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:59.965040 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 269/524] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 10 21:01:59 2022] POST /identity/v3/users => generated 247 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:01:59.965858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327db4af-5788-4eee-9389-fe374e5d0333 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:59.970168 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fde917-45d5-4629-ae95-9b2729b69bf3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:00.006423 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96d322-8817-48d9-a875-fb2896c8c678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:00.007203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96d322-8817-48d9-a875-fb2896c8c678 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:00.007488 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96d322-8817-48d9-a875-fb2896c8c678 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:00.007762 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96d322-8817-48d9-a875-fb2896c8c678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:00.020600 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96d322-8817-48d9-a875-fb2896c8c678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:00.022129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96d322-8817-48d9-a875-fb2896c8c678 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:00.042047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-bd96d322-8817-48d9-a875-fb2896c8c678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:00.042047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:00.042047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:00.042047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:00.042047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:00.042047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:00.042047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:00.042047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:00.042047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:00.042047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:00.042047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:00.042047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:00.042047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:00.042047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:00.042047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:00.043211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:00.043211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:00.043211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:00.043211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:00.043211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:00.043211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:00.043211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:00.043211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:00.043211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:00.043211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:00.043211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:00.043211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:00.043211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:00.043211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:00.043211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:00.043211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:00.043211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:00.044095 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:00.044095 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:00.044095 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:00.044095 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:00.047042 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 256/525] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:00.048245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96d322-8817-48d9-a875-fb2896c8c678 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:00.076674 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327db4af-5788-4eee-9389-fe374e5d0333 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:00.116171 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b7204-bc4f-47f7-bc49-c0dfea8dc741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:00.117336 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b7204-bc4f-47f7-bc49-c0dfea8dc741 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:00.118341 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b7204-bc4f-47f7-bc49-c0dfea8dc741 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:00.118867 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b7204-bc4f-47f7-bc49-c0dfea8dc741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:00.155022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96d322-8817-48d9-a875-fb2896c8c678 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:00.192095 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a10e7-85aa-4d8c-9895-7929af515296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:00.192776 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a10e7-85aa-4d8c-9895-7929af515296 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:00.193063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a10e7-85aa-4d8c-9895-7929af515296 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:00.193347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a10e7-85aa-4d8c-9895-7929af515296 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:00.194087 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a10e7-85aa-4d8c-9895-7929af515296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:00.194399 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a10e7-85aa-4d8c-9895-7929af515296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:00.194811 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b7204-bc4f-47f7-bc49-c0dfea8dc741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:00.196310 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a10e7-85aa-4d8c-9895-7929af515296 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:00.197070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b7204-bc4f-47f7-bc49-c0dfea8dc741 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:00.208912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 257/526] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:00.209866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a10e7-85aa-4d8c-9895-7929af515296 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:00.297949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 270/527] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:01:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:02:00.299666 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b7204-bc4f-47f7-bc49-c0dfea8dc741 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:00.310504 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a10e7-85aa-4d8c-9895-7929af515296 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:00.348501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cec892-c021-4d2a-9615-33f93328ea09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:00.349200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cec892-c021-4d2a-9615-33f93328ea09 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:00.349490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cec892-c021-4d2a-9615-33f93328ea09 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:00.349941 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cec892-c021-4d2a-9615-33f93328ea09 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:00.350590 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cec892-c021-4d2a-9615-33f93328ea09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:00.350907 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cec892-c021-4d2a-9615-33f93328ea09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:00.352596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cec892-c021-4d2a-9615-33f93328ea09 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:00.371262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 258/528] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:00.372500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cec892-c021-4d2a-9615-33f93328ea09 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:00.401947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b7204-bc4f-47f7-bc49-c0dfea8dc741 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:00.436639 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dde39-8788-4e9a-8f50-8981fea55adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:00.437303 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dde39-8788-4e9a-8f50-8981fea55adb None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:00.437607 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dde39-8788-4e9a-8f50-8981fea55adb None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:00.437938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dde39-8788-4e9a-8f50-8981fea55adb None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:00.438698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563dde39-8788-4e9a-8f50-8981fea55adb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:00.439010 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563dde39-8788-4e9a-8f50-8981fea55adb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:00.440376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563dde39-8788-4e9a-8f50-8981fea55adb None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:00.451921 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 271/529] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:00.452722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dde39-8788-4e9a-8f50-8981fea55adb None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:00.479964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cec892-c021-4d2a-9615-33f93328ea09 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:00.513783 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e310e59-2bc7-4974-83ca-d2eace5a9a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:00.514703 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e310e59-2bc7-4974-83ca-d2eace5a9a8d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:00.515063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e310e59-2bc7-4974-83ca-d2eace5a9a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:00.515350 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e310e59-2bc7-4974-83ca-d2eace5a9a8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:00.522479 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e310e59-2bc7-4974-83ca-d2eace5a9a8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:00.523519 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e310e59-2bc7-4974-83ca-d2eace5a9a8d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:00.538969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-4e310e59-2bc7-4974-83ca-d2eace5a9a8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:00.538969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:00.538969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:00.538969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:00.538969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:00.538969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:00.538969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:00.538969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:00.538969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:00.538969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:00.538969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:00.538969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:00.538969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:00.538969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:00.538969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:00.539967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:00.539967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:00.539967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:00.539967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:00.539967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:00.539967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:00.539967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:00.539967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:00.539967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:00.539967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:00.539967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:00.539967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:00.539967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:00.539967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:00.539967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:00.539967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:00.539967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:00.540952 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:00.540952 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:00.540952 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:00.540952 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:00.540952 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:00.540952 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:00.540952 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:00.540952 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:00.545485 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 259/530] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:00.546194 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e310e59-2bc7-4974-83ca-d2eace5a9a8d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:00.554815 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dde39-8788-4e9a-8f50-8981fea55adb None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:00.588548 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f7504-7050-4778-83eb-ddcdef7ff8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:00.589440 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f7504-7050-4778-83eb-ddcdef7ff8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:00.590028 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f7504-7050-4778-83eb-ddcdef7ff8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:00.590134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f7504-7050-4778-83eb-ddcdef7ff8f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:00.600518 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f7504-7050-4778-83eb-ddcdef7ff8f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:00.601931 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f7504-7050-4778-83eb-ddcdef7ff8f9 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:00.619936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-920f7504-7050-4778-83eb-ddcdef7ff8f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:00.619936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:00.619936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:00.619936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:00.619936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:00.619936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:00.619936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:00.619936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:00.619936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:00.619936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:00.619936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:00.619936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:00.619936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:00.619936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:00.619936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:00.621009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:00.621009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:00.621009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:00.621009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:00.621009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:00.621009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:00.621009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:00.621009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:00.621009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:00.621009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:00.621009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:00.621009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:00.621009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:00.621009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:00.621009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:00.621009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:00.621009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:00.622050 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:00.622050 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:00.622050 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:00.622050 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:00.622585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 272/531] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:00.623411 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f7504-7050-4778-83eb-ddcdef7ff8f9 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:00.649027 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e310e59-2bc7-4974-83ca-d2eace5a9a8d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:00.682145 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76894e09-ce3b-458e-b166-354302b2477f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:00.682922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76894e09-ce3b-458e-b166-354302b2477f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:00.683278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76894e09-ce3b-458e-b166-354302b2477f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:00.683624 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76894e09-ce3b-458e-b166-354302b2477f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:00.684526 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76894e09-ce3b-458e-b166-354302b2477f None admin] RBAC: Adding query filter params (role.id=d09c313a1a354ea68cf1013629a4a584, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=aa2b6514779d42fa81d34351607dea27) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:00.684911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76894e09-ce3b-458e-b166-354302b2477f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:00.686412 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76894e09-ce3b-458e-b166-354302b2477f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:00.698808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 260/532] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:02:00 2022] GET /identity/v3/role_assignments?user.id=aa2b6514779d42fa81d34351607dea27&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=d09c313a1a354ea68cf1013629a4a584 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:00.698808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76894e09-ce3b-458e-b166-354302b2477f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:00.729888 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f7504-7050-4778-83eb-ddcdef7ff8f9 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:00.767599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d154f-8d9f-4a6e-b9eb-817fd629c7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:00.768549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d154f-8d9f-4a6e-b9eb-817fd629c7ae None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:00.768890 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d154f-8d9f-4a6e-b9eb-817fd629c7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:00.769231 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d154f-8d9f-4a6e-b9eb-817fd629c7ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:00.776912 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d154f-8d9f-4a6e-b9eb-817fd629c7ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:00.778582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d154f-8d9f-4a6e-b9eb-817fd629c7ae None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:00.797224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-e66d154f-8d9f-4a6e-b9eb-817fd629c7ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:00.797224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:00.797224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:00.797224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:00.797224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:00.797224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:00.797224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:00.797224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:00.797224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:00.797224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:00.797224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:00.797224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:00.797224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:00.797224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:00.797224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:00.798309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:00.798309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:00.798309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:00.798309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:00.798309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:00.798309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:00.798309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:00.798309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:00.798309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:00.798309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:00.798309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:00.798309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:00.798309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:00.798309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:00.798309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:00.798309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:00.798309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:00.799451 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:00.799451 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:00.799451 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:00.799451 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:00.799451 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:00.799451 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:00.799451 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:00.799451 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:00.804348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 273/533] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:00.806056 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d154f-8d9f-4a6e-b9eb-817fd629c7ae None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:00.816343 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76894e09-ce3b-458e-b166-354302b2477f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:00.863430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd08cc-56bd-425c-8d0c-da946b5f918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:00.864667 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd08cc-56bd-425c-8d0c-da946b5f918b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:00.865077 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd08cc-56bd-425c-8d0c-da946b5f918b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:00.865459 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd08cc-56bd-425c-8d0c-da946b5f918b None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:00.866391 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd08cc-56bd-425c-8d0c-da946b5f918b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:00.866838 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd08cc-56bd-425c-8d0c-da946b5f918b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:00.870144 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd08cc-56bd-425c-8d0c-da946b5f918b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:00.894161 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 261/534] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:00.895266 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd08cc-56bd-425c-8d0c-da946b5f918b None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:00.931932 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d154f-8d9f-4a6e-b9eb-817fd629c7ae None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:00.973032 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef15f5f-1da4-4511-b8b9-a3bae0a0b1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:00.974194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef15f5f-1da4-4511-b8b9-a3bae0a0b1db None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:00.974661 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef15f5f-1da4-4511-b8b9-a3bae0a0b1db None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:00.975075 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef15f5f-1da4-4511-b8b9-a3bae0a0b1db None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:00.975929 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef15f5f-1da4-4511-b8b9-a3bae0a0b1db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:00.976504 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef15f5f-1da4-4511-b8b9-a3bae0a0b1db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:00.979614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef15f5f-1da4-4511-b8b9-a3bae0a0b1db None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:00.994246 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 274/535] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:00.995450 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef15f5f-1da4-4511-b8b9-a3bae0a0b1db None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:01.019697 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd08cc-56bd-425c-8d0c-da946b5f918b None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:01.063519 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65909b1-b32f-41d0-a0e6-21c4153bbfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:01.064664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65909b1-b32f-41d0-a0e6-21c4153bbfc1 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:01.065094 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65909b1-b32f-41d0-a0e6-21c4153bbfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:01.065515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65909b1-b32f-41d0-a0e6-21c4153bbfc1 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:01.066475 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65909b1-b32f-41d0-a0e6-21c4153bbfc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:01.067072 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65909b1-b32f-41d0-a0e6-21c4153bbfc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:01.069432 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65909b1-b32f-41d0-a0e6-21c4153bbfc1 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:01.085119 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 262/536] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:01.086766 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65909b1-b32f-41d0-a0e6-21c4153bbfc1 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:01.107896 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef15f5f-1da4-4511-b8b9-a3bae0a0b1db None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:01.150640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efde16-c424-465a-98cc-3fea10b87c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:01.151905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efde16-c424-465a-98cc-3fea10b87c54 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:01.152805 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efde16-c424-465a-98cc-3fea10b87c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:01.153306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efde16-c424-465a-98cc-3fea10b87c54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:01.154630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efde16-c424-465a-98cc-3fea10b87c54 None admin] RBAC: Adding query filter params (role.id=d09c313a1a354ea68cf1013629a4a584, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=c4c16a3b07c64a22bfc3df2a5a90c3f3) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:01.155288 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efde16-c424-465a-98cc-3fea10b87c54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:01.157596 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efde16-c424-465a-98cc-3fea10b87c54 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:01.173298 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 275/537] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:02:00 2022] GET /identity/v3/role_assignments?user.id=c4c16a3b07c64a22bfc3df2a5a90c3f3&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=d09c313a1a354ea68cf1013629a4a584 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:01.173298 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efde16-c424-465a-98cc-3fea10b87c54 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:01.232740 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65909b1-b32f-41d0-a0e6-21c4153bbfc1 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:01.297284 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0afa2-e7a0-40e7-a6ed-d0938c59b21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:01.298095 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0afa2-e7a0-40e7-a6ed-d0938c59b21e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:01.298384 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0afa2-e7a0-40e7-a6ed-d0938c59b21e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:01.298887 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0afa2-e7a0-40e7-a6ed-d0938c59b21e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:01.313146 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0afa2-e7a0-40e7-a6ed-d0938c59b21e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:01.314700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0afa2-e7a0-40e7-a6ed-d0938c59b21e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:01.341334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-f6b0afa2-e7a0-40e7-a6ed-d0938c59b21e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:01.341334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:01.341334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:01.341334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:01.341334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:01.341334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:01.341334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:01.341334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:01.341334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:01.341334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:01.341334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:01.341334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:01.341334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:01.341334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:01.341334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:01.342268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:01.342268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:01.342268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:01.342268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:01.342268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:01.342268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:01.342268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:01.342268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:01.342268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:01.342268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:01.342268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:01.342268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:01.342268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:01.342268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:01.342268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:01.342268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:01.342268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:01.343179 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:01.343179 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:01.343179 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:01.343179 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:01.343179 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:01.343179 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:01.343179 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:01.343179 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:01.344688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 263/538] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:01.354587 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0afa2-e7a0-40e7-a6ed-d0938c59b21e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:01.379312 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efde16-c424-465a-98cc-3fea10b87c54 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:01.414887 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b247134-86ae-4614-ab1b-d8c4a5b8404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:01.415917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b247134-86ae-4614-ab1b-d8c4a5b8404b None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:01.416414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b247134-86ae-4614-ab1b-d8c4a5b8404b None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:01.416883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b247134-86ae-4614-ab1b-d8c4a5b8404b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:01.417908 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b247134-86ae-4614-ab1b-d8c4a5b8404b None admin] RBAC: Adding query filter params (role.id=d09c313a1a354ea68cf1013629a4a584, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=c4dfa98f420c4c4c845262a78ae75ae8) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:01.418412 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b247134-86ae-4614-ab1b-d8c4a5b8404b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:01.420060 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b247134-86ae-4614-ab1b-d8c4a5b8404b None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:01.427735 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 276/539] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:02:01 2022] GET /identity/v3/role_assignments?user.id=c4dfa98f420c4c4c845262a78ae75ae8&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=d09c313a1a354ea68cf1013629a4a584 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:01.486954 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0afa2-e7a0-40e7-a6ed-d0938c59b21e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:01.530317 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26e320-f8dd-4376-946b-96503f2b9ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:01.531106 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26e320-f8dd-4376-946b-96503f2b9ccf None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:01.531295 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26e320-f8dd-4376-946b-96503f2b9ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:01.531571 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26e320-f8dd-4376-946b-96503f2b9ccf None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:01.532400 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26e320-f8dd-4376-946b-96503f2b9ccf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:01.532710 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26e320-f8dd-4376-946b-96503f2b9ccf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:01.534204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26e320-f8dd-4376-946b-96503f2b9ccf None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:01.547838 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 264/540] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:01.553251 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b247134-86ae-4614-ab1b-d8c4a5b8404b None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:01.660320 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b247134-86ae-4614-ab1b-d8c4a5b8404b None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:01.698009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d8fbc-514f-4055-a07c-a2ccf954c9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:01.698694 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d8fbc-514f-4055-a07c-a2ccf954c9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:01.698980 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d8fbc-514f-4055-a07c-a2ccf954c9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:01.699257 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d8fbc-514f-4055-a07c-a2ccf954c9c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:01.700095 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d8fbc-514f-4055-a07c-a2ccf954c9c3 None admin] RBAC: Adding query filter params (role.id=d09c313a1a354ea68cf1013629a4a584, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=2fa7da0ccf954be1a582411cdc617b0f) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:01.700408 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d8fbc-514f-4055-a07c-a2ccf954c9c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:01.701905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d8fbc-514f-4055-a07c-a2ccf954c9c3 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:01.707761 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 277/541] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:02:01 2022] GET /identity/v3/role_assignments?user.id=2fa7da0ccf954be1a582411cdc617b0f&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=d09c313a1a354ea68cf1013629a4a584 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:02.457939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd168e1c-e1aa-4cf1-a95f-6e1c0da767f8 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:02.458661 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd168e1c-e1aa-4cf1-a95f-6e1c0da767f8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:02.459152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd168e1c-e1aa-4cf1-a95f-6e1c0da767f8 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:02.460984 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 265/542] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:02.465885 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40bd0c-d9db-4971-99a7-8e6cc13791b6 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:02.466415 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40bd0c-d9db-4971-99a7-8e6cc13791b6 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:02.466912 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40bd0c-d9db-4971-99a7-8e6cc13791b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:02.487050 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-3d40bd0c-d9db-4971-99a7-8e6cc13791b6 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:02.488518 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-3d40bd0c-d9db-4971-99a7-8e6cc13791b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:02.567939 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 278/543] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:02:02.608722 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd168e1c-e1aa-4cf1-a95f-6e1c0da767f8 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:02.736636 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd168e1c-e1aa-4cf1-a95f-6e1c0da767f8 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:02.785461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80908666-a54e-4ae9-b67c-ca80087ee32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:02.786670 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80908666-a54e-4ae9-b67c-ca80087ee32a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:02.787177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80908666-a54e-4ae9-b67c-ca80087ee32a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:02.787651 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80908666-a54e-4ae9-b67c-ca80087ee32a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:02.808650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80908666-a54e-4ae9-b67c-ca80087ee32a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:02.816806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-80908666-a54e-4ae9-b67c-ca80087ee32a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:02.816806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:02.816806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:02.816806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:02.816806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:02.816806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:02.816806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:02.816806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:02.816806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:02.816806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:02.816806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:02.816806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:02.816806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:02.816806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:02.816806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:02.816806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:02.817690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:02.817690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:02.817690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:02.817690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:02.817690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:02.817690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:02.817690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:02.817690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:02.817690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:02.817690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:02.817690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:02.817690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:02.817690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:02.817690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:02.817690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:02.817690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:02.822634 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:02.822634 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:02.822634 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:02.822634 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:02.822634 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:02.822634 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:02.822634 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:02.822634 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:02.822634 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:02.822634 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:02.822634 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:02.822634 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:02.824462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 266/544] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:02:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:02.829888 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40bd0c-d9db-4971-99a7-8e6cc13791b6 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:02.938117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40bd0c-d9db-4971-99a7-8e6cc13791b6 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:02.984184 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e97b2-18d3-4a39-823e-423cd7a173c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:02.984865 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e97b2-18d3-4a39-823e-423cd7a173c1 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:02.985149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e97b2-18d3-4a39-823e-423cd7a173c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:02.985426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e97b2-18d3-4a39-823e-423cd7a173c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:02.986178 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e97b2-18d3-4a39-823e-423cd7a173c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:02.986502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e97b2-18d3-4a39-823e-423cd7a173c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:02.987914 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e97b2-18d3-4a39-823e-423cd7a173c1 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:02.997917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 279/545] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:02:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:03.003136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80908666-a54e-4ae9-b67c-ca80087ee32a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:03.157643 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80908666-a54e-4ae9-b67c-ca80087ee32a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:03.207116 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b6cdc-d3d5-4b8b-8c46-44a15e8e3577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:03.207922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b6cdc-d3d5-4b8b-8c46-44a15e8e3577 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:03.208207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b6cdc-d3d5-4b8b-8c46-44a15e8e3577 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:03.208480 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b6cdc-d3d5-4b8b-8c46-44a15e8e3577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:03.220019 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b6cdc-d3d5-4b8b-8c46-44a15e8e3577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:03.221501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b6cdc-d3d5-4b8b-8c46-44a15e8e3577 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:03.243511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-010b6cdc-d3d5-4b8b-8c46-44a15e8e3577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:03.243511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:03.243511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:03.243511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:03.243511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:03.243511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:03.243511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:03.243511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:03.243511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:03.243511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:03.243511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:03.243511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:03.243511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:03.243511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:03.243511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:03.244467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:03.244467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:03.244467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:03.244467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:03.244467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:03.244467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:03.244467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:03.244467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:03.244467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:03.244467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:03.244467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:03.244467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:03.244467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:03.244467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:03.244467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:03.244467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:03.244467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:03.245338 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:03.245338 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:03.245338 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:03.245338 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:03.245338 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 267/546] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:03.250356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e97b2-18d3-4a39-823e-423cd7a173c1 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:03.262681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73f432-5066-4642-81a1-834c26ce6149 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:03.262974 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73f432-5066-4642-81a1-834c26ce6149 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:03.263239 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73f432-5066-4642-81a1-834c26ce6149 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:03.264887 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 268/547] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:02:03.271453 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf94670-624b-4f2d-9b1a-d190428f3d18 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:03.271736 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf94670-624b-4f2d-9b1a-d190428f3d18 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:03.272015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf94670-624b-4f2d-9b1a-d190428f3d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:03.299245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-ccf94670-624b-4f2d-9b1a-d190428f3d18 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:03.300422 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ccf94670-624b-4f2d-9b1a-d190428f3d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:03.393718 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e97b2-18d3-4a39-823e-423cd7a173c1 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:03.430521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613fafe-7e4b-402c-97e1-8c60e28844ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:03.431546 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613fafe-7e4b-402c-97e1-8c60e28844ff None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:03.432037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613fafe-7e4b-402c-97e1-8c60e28844ff None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:03.432520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613fafe-7e4b-402c-97e1-8c60e28844ff None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:03.433497 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613fafe-7e4b-402c-97e1-8c60e28844ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:03.434075 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613fafe-7e4b-402c-97e1-8c60e28844ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:03.434781 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 269/548] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 10 21:02:03.442511 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613fafe-7e4b-402c-97e1-8c60e28844ff None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:03.449506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 280/549] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:03.454633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf94670-624b-4f2d-9b1a-d190428f3d18 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:03.462822 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613fafe-7e4b-402c-97e1-8c60e28844ff None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:03.561151 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf94670-624b-4f2d-9b1a-d190428f3d18 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:03.564361 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613fafe-7e4b-402c-97e1-8c60e28844ff None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:03.605379 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a305881-22bc-42ba-bd69-b0957b320664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:03.606188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a305881-22bc-42ba-bd69-b0957b320664 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:03.606824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a305881-22bc-42ba-bd69-b0957b320664 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:03.607109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a305881-22bc-42ba-bd69-b0957b320664 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:03.608886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ead296-f474-406c-b22c-aab0420750f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:03.609675 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ead296-f474-406c-b22c-aab0420750f8 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:03.609956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ead296-f474-406c-b22c-aab0420750f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:03.610227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ead296-f474-406c-b22c-aab0420750f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:03.623413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a305881-22bc-42ba-bd69-b0957b320664 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:03.624852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a305881-22bc-42ba-bd69-b0957b320664 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:03.631198 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ead296-f474-406c-b22c-aab0420750f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:03.639613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-40ead296-f474-406c-b22c-aab0420750f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:03.639613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:03.639613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:03.639613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:03.639613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:03.639613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:03.639613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:03.639613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:03.639613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:03.639613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:03.639613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:03.639613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:03.639613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:03.639613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:03.639613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:03.639613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:03.640509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:03.640509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:03.640509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:03.640509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:03.640509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:03.640509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:03.640509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:03.640509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:03.640509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:03.640509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:03.640509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:03.640509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:03.640509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:03.640509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:03.640509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:03.640509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:03.641325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:03.641325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:03.641325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:03.641325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:03.641325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:03.641325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:03.641325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:03.641325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:03.641325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:03.641325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:03.641325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:03.641325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:03.641325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 281/550] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:02:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:03.654125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-8a305881-22bc-42ba-bd69-b0957b320664 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 21:02:03.654125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:03.654125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:03.654125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:03.654125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:03.654125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:03.654125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:03.654125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:03.654125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:03.654125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:03.654125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:03.654125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:03.654125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:03.654125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:03.654125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:03.654125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:03.656307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:03.656307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:03.656307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:03.656307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:03.656307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:03.656307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:03.656307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:03.656307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:03.656307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:03.656307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:03.656307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:03.656307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:03.656307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:03.656307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:03.656307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:03.656307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:03.656307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:03.656307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:03.658259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:03.658259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:03.658259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:03.658259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:03.658259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:03.658259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:03.658259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:03.658259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:03.658259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 21:02:03.658259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:03.658259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 270/551] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:02:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:03.659057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ead296-f474-406c-b22c-aab0420750f8 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:03.661600 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a305881-22bc-42ba-bd69-b0957b320664 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:03.762159 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ead296-f474-406c-b22c-aab0420750f8 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:03.804625 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d7e2f-0b61-43a1-9768-a9191978c45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:03.805810 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d7e2f-0b61-43a1-9768-a9191978c45c None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:03.806102 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d7e2f-0b61-43a1-9768-a9191978c45c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:03.806381 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d7e2f-0b61-43a1-9768-a9191978c45c None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:03.807167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d7e2f-0b61-43a1-9768-a9191978c45c None admin] RBAC: Adding query filter params (name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:03.807477 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d7e2f-0b61-43a1-9768-a9191978c45c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:03.808846 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d7e2f-0b61-43a1-9768-a9191978c45c None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:03.822800 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a305881-22bc-42ba-bd69-b0957b320664 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:03.826198 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 282/552] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:02:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:03.831303 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d7e2f-0b61-43a1-9768-a9191978c45c None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:03.872331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d69807-4f6b-44db-9804-a0933561af43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:03.873354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d69807-4f6b-44db-9804-a0933561af43 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:03.873830 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d69807-4f6b-44db-9804-a0933561af43 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:03.874248 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d69807-4f6b-44db-9804-a0933561af43 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:03.875345 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d69807-4f6b-44db-9804-a0933561af43 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:03.875818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d69807-4f6b-44db-9804-a0933561af43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:03.877396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d69807-4f6b-44db-9804-a0933561af43 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:03.915121 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 271/553] 10.222.0.25 () {56 vars in 1135 bytes} [Tue May 10 21:02:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:03.920212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d69807-4f6b-44db-9804-a0933561af43 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:03.956735 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d7e2f-0b61-43a1-9768-a9191978c45c None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:03.998465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d45f1b-c9c0-4dec-a11f-348f02c9e4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:03.998465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d45f1b-c9c0-4dec-a11f-348f02c9e4ba None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:03.998465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d45f1b-c9c0-4dec-a11f-348f02c9e4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:03.998465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d45f1b-c9c0-4dec-a11f-348f02c9e4ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:04.002997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d45f1b-c9c0-4dec-a11f-348f02c9e4ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:04.004815 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d45f1b-c9c0-4dec-a11f-348f02c9e4ba None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:04.022342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-a2d45f1b-c9c0-4dec-a11f-348f02c9e4ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:04.022342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:04.022342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:04.022342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:04.022342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:04.022342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:04.022342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:04.022342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:04.022342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:04.022342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:04.022342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:04.022342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:04.022342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:04.022342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:04.022342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:04.027307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:04.027307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:04.027307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:04.027307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:04.027307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:04.027307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:04.027307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:04.027307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:04.027307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:04.027307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:04.027307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:04.027307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:04.027307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:04.027307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:04.027307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:04.027307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:04.027307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:04.028170 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:04.028170 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:04.028170 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:04.028170 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:04.028170 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 283/554] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:04.030786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d45f1b-c9c0-4dec-a11f-348f02c9e4ba None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:04.122114 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d69807-4f6b-44db-9804-a0933561af43 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:04.142880 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d45f1b-c9c0-4dec-a11f-348f02c9e4ba None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:04.156609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac95888-54e0-424f-9b3f-fc7e4aeb9f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:04.157266 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac95888-54e0-424f-9b3f-fc7e4aeb9f8f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:04.157551 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac95888-54e0-424f-9b3f-fc7e4aeb9f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:04.157826 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac95888-54e0-424f-9b3f-fc7e4aeb9f8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:04.177656 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff9a30-364b-4479-a491-8a5e17088334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:04.178322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff9a30-364b-4479-a491-8a5e17088334 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:04.178632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff9a30-364b-4479-a491-8a5e17088334 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:04.178904 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff9a30-364b-4479-a491-8a5e17088334 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:04.179620 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff9a30-364b-4479-a491-8a5e17088334 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:04.180014 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff9a30-364b-4479-a491-8a5e17088334 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:04.181485 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff9a30-364b-4479-a491-8a5e17088334 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:04.193898 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 284/555] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:04.195347 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698d77-8a1d-48db-bca2-870061017192 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:04.196208 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698d77-8a1d-48db-bca2-870061017192 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:04.196497 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698d77-8a1d-48db-bca2-870061017192 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:04.197958 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 285/556] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:04.200509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5698d77-8a1d-48db-bca2-870061017192 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:04.235125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac95888-54e0-424f-9b3f-fc7e4aeb9f8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:04.236743 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac95888-54e0-424f-9b3f-fc7e4aeb9f8f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:04.309314 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5698d77-8a1d-48db-bca2-870061017192 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:04.348248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8d0d9-1b94-46c3-ba1f-8e838ffa6a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:04.349052 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8d0d9-1b94-46c3-ba1f-8e838ffa6a5b None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:04.349567 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 272/557] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:02:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 21:02:04.350891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16311fd-cf17-48a4-a65d-f53bae822a7c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:04.351183 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16311fd-cf17-48a4-a65d-f53bae822a7c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:04.351464 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16311fd-cf17-48a4-a65d-f53bae822a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:04.354221 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8d0d9-1b94-46c3-ba1f-8e838ffa6a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:04.354556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8d0d9-1b94-46c3-ba1f-8e838ffa6a5b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:04.362079 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8d0d9-1b94-46c3-ba1f-8e838ffa6a5b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:04.363598 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8d0d9-1b94-46c3-ba1f-8e838ffa6a5b None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:04.370252 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-e16311fd-cf17-48a4-a65d-f53bae822a7c None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:04.371584 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e16311fd-cf17-48a4-a65d-f53bae822a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:04.378588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-c1c8d0d9-1b94-46c3-ba1f-8e838ffa6a5b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 21:02:04.378588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:04.378588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:04.378588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:04.378588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:04.378588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:04.378588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:04.378588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:04.378588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:04.378588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:04.378588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:04.378588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:04.378588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:04.378588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:04.378588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:04.378588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:04.379740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:04.379740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:04.379740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:04.379740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:04.379740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:04.379740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:04.379740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:04.379740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:04.379740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:04.379740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:04.379740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:04.379740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:04.379740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:04.379740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:04.379740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:04.379740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:04.379740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:04.379740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:04.381122 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:04.381122 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:04.381122 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:04.381122 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:04.381122 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:04.381122 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:04.381122 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:04.381122 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:04.381122 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 21:02:04.381122 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:04.381122 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 286/558] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:02:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:04.381731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aedf9-5191-4618-aece-6472b6eecb1b None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:04.382017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aedf9-5191-4618-aece-6472b6eecb1b None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:04.382170 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aedf9-5191-4618-aece-6472b6eecb1b None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:04.387708 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 287/559] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:04.387708 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471aedf9-5191-4618-aece-6472b6eecb1b None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:04.453608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 273/560] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:02:04.463498 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16311fd-cf17-48a4-a65d-f53bae822a7c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:04.488724 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471aedf9-5191-4618-aece-6472b6eecb1b None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:04.521826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76560cf0-5ed7-494e-a968-38f79fef1b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:04.522666 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76560cf0-5ed7-494e-a968-38f79fef1b79 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:04.522969 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76560cf0-5ed7-494e-a968-38f79fef1b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:04.523254 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76560cf0-5ed7-494e-a968-38f79fef1b79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:04.533961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76560cf0-5ed7-494e-a968-38f79fef1b79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:04.535484 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76560cf0-5ed7-494e-a968-38f79fef1b79 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:04.555800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-76560cf0-5ed7-494e-a968-38f79fef1b79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:04.555800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:04.555800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:04.555800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:04.555800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:04.555800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:04.555800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:04.555800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:04.555800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:04.555800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:04.555800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:04.555800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:04.555800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:04.555800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:04.555800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:04.556739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:04.556739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:04.556739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:04.556739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:04.556739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:04.556739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:04.556739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:04.556739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:04.556739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:04.556739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:04.556739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:04.556739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:04.556739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:04.556739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:04.556739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:04.556739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:04.556739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:04.558036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:04.558036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:04.558036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:04.558036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:04.558036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 288/561] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:04.558761 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62c0f4-4b84-4340-b883-b41ec8efbc41 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:04.559267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62c0f4-4b84-4340-b883-b41ec8efbc41 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:04.559421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62c0f4-4b84-4340-b883-b41ec8efbc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:04.574317 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16311fd-cf17-48a4-a65d-f53bae822a7c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:04.576579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-bf62c0f4-4b84-4340-b883-b41ec8efbc41 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:04.577761 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-bf62c0f4-4b84-4340-b883-b41ec8efbc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:04.608244 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ca829-c305-4996-aaf8-a50b08dec265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:04.608917 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ca829-c305-4996-aaf8-a50b08dec265 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:04.609206 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ca829-c305-4996-aaf8-a50b08dec265 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:04.609487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ca829-c305-4996-aaf8-a50b08dec265 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:04.610332 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ca829-c305-4996-aaf8-a50b08dec265 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:04.610675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ca829-c305-4996-aaf8-a50b08dec265 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:04.612103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ca829-c305-4996-aaf8-a50b08dec265 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:04.634072 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 274/562] 10.222.0.25 () {56 vars in 1137 bytes} [Tue May 10 21:02:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:04.634072 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ca829-c305-4996-aaf8-a50b08dec265 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:04.644527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 289/563] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:02:04.645695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62c0f4-4b84-4340-b883-b41ec8efbc41 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:04.742105 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ca829-c305-4996-aaf8-a50b08dec265 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:04.744466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62c0f4-4b84-4340-b883-b41ec8efbc41 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:04.776244 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d693057-8dc1-4f99-b177-3fcb31f82819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:04.776741 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11b08d-dc1c-47e8-9fb0-fafe7b3db91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:04.777043 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d693057-8dc1-4f99-b177-3fcb31f82819 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:04.777330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d693057-8dc1-4f99-b177-3fcb31f82819 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:04.777419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11b08d-dc1c-47e8-9fb0-fafe7b3db91f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:04.777607 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d693057-8dc1-4f99-b177-3fcb31f82819 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:04.777695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11b08d-dc1c-47e8-9fb0-fafe7b3db91f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:04.777926 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11b08d-dc1c-47e8-9fb0-fafe7b3db91f None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:04.778681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11b08d-dc1c-47e8-9fb0-fafe7b3db91f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:04.778987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11b08d-dc1c-47e8-9fb0-fafe7b3db91f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:04.780351 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11b08d-dc1c-47e8-9fb0-fafe7b3db91f None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:04.787750 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d693057-8dc1-4f99-b177-3fcb31f82819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:04.791094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 290/564] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:04.791891 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11b08d-dc1c-47e8-9fb0-fafe7b3db91f None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:04.795580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-3d693057-8dc1-4f99-b177-3fcb31f82819 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:04.795580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:04.795580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:04.795580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:04.795580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:04.795580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:04.795580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:04.795580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:04.795580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:04.795580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:04.795580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:04.795580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:04.795580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:04.795580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:04.795580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:04.795580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:04.796939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:04.796939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:04.796939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:04.796939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:04.796939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:04.796939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:04.796939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:04.796939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:04.796939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:04.796939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:04.796939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:04.796939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:04.796939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:04.796939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:04.796939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:04.796939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:04.797767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:04.797767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:04.797767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:04.797767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:04.797767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:04.797767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:04.797767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:04.797767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:04.797767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:04.797767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:04.797767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:04.797767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:04.797767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 275/565] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:02:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:04.797767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d693057-8dc1-4f99-b177-3fcb31f82819 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:04.887904 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11b08d-dc1c-47e8-9fb0-fafe7b3db91f None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:04.895317 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d693057-8dc1-4f99-b177-3fcb31f82819 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:04.919093 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61e812-9c85-4ac5-a101-f599c3904fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:04.919872 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61e812-9c85-4ac5-a101-f599c3904fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:04.920149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61e812-9c85-4ac5-a101-f599c3904fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:04.920421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61e812-9c85-4ac5-a101-f599c3904fd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:04.927304 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338df13-cbc2-4597-bcaf-a68a73ee7a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:04.928088 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338df13-cbc2-4597-bcaf-a68a73ee7a70 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:04.928373 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338df13-cbc2-4597-bcaf-a68a73ee7a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:04.928657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338df13-cbc2-4597-bcaf-a68a73ee7a70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:04.930608 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61e812-9c85-4ac5-a101-f599c3904fd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:04.932037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61e812-9c85-4ac5-a101-f599c3904fd4 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:04.938425 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338df13-cbc2-4597-bcaf-a68a73ee7a70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:04.946824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-e338df13-cbc2-4597-bcaf-a68a73ee7a70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:04.946824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:04.946824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:04.946824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:04.946824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:04.946824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:04.946824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:04.946824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:04.946824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:04.946824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:04.946824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:04.946824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:04.946824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:04.946824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:04.946824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:04.946824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:04.947770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:04.947770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:04.947770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:04.947770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:04.947770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:04.947770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:04.947770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:04.947770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:04.947770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:04.947770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:04.947770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:04.947770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:04.947770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:04.947770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:04.947770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:04.947770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:04.948609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:04.948609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:04.948609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:04.948609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:04.948609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:04.948609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:04.948609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:04.948609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:04.948609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:04.948609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:04.948609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:04.948609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:04.948609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 276/566] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:02:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:04.949292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-2b61e812-9c85-4ac5-a101-f599c3904fd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:04.949292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:04.949292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:04.949292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:04.949292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:04.949292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:04.949292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:04.949292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:04.949292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:04.949292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:04.949292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:04.949292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:04.949292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:04.949292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:04.949292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:04.950149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:04.950149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:04.950149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:04.950149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:04.950149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:04.950149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:04.950149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:04.950149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:04.950149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:04.950149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:04.950149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:04.950149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:04.950149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:04.950149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:04.950149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:04.950149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:04.950149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:04.951049 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:04.951049 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:04.951049 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:04.951049 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:04.951281 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9ead7-7f3c-428f-a2ec-c751c59ba6e4 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:04.951281 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9ead7-7f3c-428f-a2ec-c751c59ba6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:04.952141 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 291/567] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:04.952141 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61e812-9c85-4ac5-a101-f599c3904fd4 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:04.953010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9ead7-7f3c-428f-a2ec-c751c59ba6e4 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:04.955254 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 277/568] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:04.955254 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9ead7-7f3c-428f-a2ec-c751c59ba6e4 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:05.046755 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61e812-9c85-4ac5-a101-f599c3904fd4 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:05.052203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9ead7-7f3c-428f-a2ec-c751c59ba6e4 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:05.077771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a767cb-7d47-4e08-8b1b-c04b37d322de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:05.078581 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a767cb-7d47-4e08-8b1b-c04b37d322de None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:05.078861 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a767cb-7d47-4e08-8b1b-c04b37d322de None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:05.079128 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a767cb-7d47-4e08-8b1b-c04b37d322de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:05.084154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3fbc2-c155-4f7b-80bc-f837f01e70a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:05.084822 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3fbc2-c155-4f7b-80bc-f837f01e70a0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:05.085107 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3fbc2-c155-4f7b-80bc-f837f01e70a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:05.085382 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3fbc2-c155-4f7b-80bc-f837f01e70a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:05.085605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a767cb-7d47-4e08-8b1b-c04b37d322de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:05.086747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3fbc2-c155-4f7b-80bc-f837f01e70a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:05.087060 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3fbc2-c155-4f7b-80bc-f837f01e70a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:05.087633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a767cb-7d47-4e08-8b1b-c04b37d322de None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:05.088391 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3fbc2-c155-4f7b-80bc-f837f01e70a0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:05.095970 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 278/569] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:02:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:05.096746 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3fbc2-c155-4f7b-80bc-f837f01e70a0 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:05.101357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-13a767cb-7d47-4e08-8b1b-c04b37d322de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:05.101357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:05.101357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:05.101357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:05.101357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:05.101357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:05.101357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:05.101357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:05.101357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:05.101357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:05.101357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:05.101357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:05.101357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:05.101357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:05.101357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:05.103147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:05.103147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:05.103147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:05.103147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:05.103147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:05.103147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:05.103147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:05.103147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:05.103147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:05.103147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:05.103147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:05.103147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:05.103147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:05.103147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:05.103147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:05.103147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:05.103147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:05.104026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:05.104026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:05.104026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:05.104026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:05.104026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:05.104026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:05.104026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:05.104026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:05.104026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 292/570] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:05.104979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a767cb-7d47-4e08-8b1b-c04b37d322de None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:05.190690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3fbc2-c155-4f7b-80bc-f837f01e70a0 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:05.200078 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a767cb-7d47-4e08-8b1b-c04b37d322de None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:05.221524 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430ad6a-88d6-4046-9494-660121c5168b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:05.222180 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430ad6a-88d6-4046-9494-660121c5168b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:05.222484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430ad6a-88d6-4046-9494-660121c5168b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:05.222763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430ad6a-88d6-4046-9494-660121c5168b None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:05.223499 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430ad6a-88d6-4046-9494-660121c5168b None admin] RBAC: Adding query filter params (name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:05.223802 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430ad6a-88d6-4046-9494-660121c5168b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:05.225136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430ad6a-88d6-4046-9494-660121c5168b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:05.232747 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558ab99-ad19-4d8c-8f88-d30d64a10dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:05.233234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 279/571] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:02:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:05.234402 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e19c13-364f-4c7c-a327-ec835057787b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:05.234552 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558ab99-ad19-4d8c-8f88-d30d64a10dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:05.234738 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e19c13-364f-4c7c-a327-ec835057787b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:05.234836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558ab99-ad19-4d8c-8f88-d30d64a10dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:05.234984 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e19c13-364f-4c7c-a327-ec835057787b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:05.235078 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558ab99-ad19-4d8c-8f88-d30d64a10dd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:05.235827 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558ab99-ad19-4d8c-8f88-d30d64a10dd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:05.236205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558ab99-ad19-4d8c-8f88-d30d64a10dd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:05.237489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558ab99-ad19-4d8c-8f88-d30d64a10dd9 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:05.249125 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 293/572] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:05.249907 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558ab99-ad19-4d8c-8f88-d30d64a10dd9 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:05.254271 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-96e19c13-364f-4c7c-a327-ec835057787b None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:05.255473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-96e19c13-364f-4c7c-a327-ec835057787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:05.318212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 280/573] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:02:05.319071 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e19c13-364f-4c7c-a327-ec835057787b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:05.350427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558ab99-ad19-4d8c-8f88-d30d64a10dd9 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:05.383665 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979463c-69d6-4103-ad05-ff3f7d1f6c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:05.384493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979463c-69d6-4103-ad05-ff3f7d1f6c93 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:05.384784 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979463c-69d6-4103-ad05-ff3f7d1f6c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:05.385063 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979463c-69d6-4103-ad05-ff3f7d1f6c93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:05.395277 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f979463c-69d6-4103-ad05-ff3f7d1f6c93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:05.396742 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f979463c-69d6-4103-ad05-ff3f7d1f6c93 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:05.412219 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e19c13-364f-4c7c-a327-ec835057787b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:05.414344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-f979463c-69d6-4103-ad05-ff3f7d1f6c93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:05.414344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:05.414344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:05.414344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:05.414344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:05.414344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:05.414344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:05.414344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:05.414344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:05.414344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:05.414344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:05.414344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:05.414344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:05.414344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:05.414344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:05.415284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:05.415284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:05.415284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:05.415284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:05.415284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:05.415284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:05.415284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:05.415284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:05.415284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:05.415284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:05.415284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:05.415284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:05.415284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:05.415284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:05.415284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:05.415284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:05.415284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:05.416201 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:05.416201 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:05.416201 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:05.416201 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:05.416201 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 294/574] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:05.416884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979463c-69d6-4103-ad05-ff3f7d1f6c93 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:05.445017 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30ff55-b3b9-4879-b727-e02b94ee1342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:05.446272 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30ff55-b3b9-4879-b727-e02b94ee1342 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:05.446595 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30ff55-b3b9-4879-b727-e02b94ee1342 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:05.446874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30ff55-b3b9-4879-b727-e02b94ee1342 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:05.447662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30ff55-b3b9-4879-b727-e02b94ee1342 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:05.447971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30ff55-b3b9-4879-b727-e02b94ee1342 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:05.449380 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30ff55-b3b9-4879-b727-e02b94ee1342 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:05.460314 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 281/575] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:05.461656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30ff55-b3b9-4879-b727-e02b94ee1342 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:05.513542 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979463c-69d6-4103-ad05-ff3f7d1f6c93 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:05.545249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880b89d-82c9-4540-915c-b5fb67c93956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:05.546031 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880b89d-82c9-4540-915c-b5fb67c93956 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:05.546606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880b89d-82c9-4540-915c-b5fb67c93956 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:05.546883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880b89d-82c9-4540-915c-b5fb67c93956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:05.554069 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30ff55-b3b9-4879-b727-e02b94ee1342 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:05.557030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880b89d-82c9-4540-915c-b5fb67c93956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:05.558504 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880b89d-82c9-4540-915c-b5fb67c93956 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:05.575602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-5880b89d-82c9-4540-915c-b5fb67c93956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:05.575602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:05.575602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:05.575602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:05.575602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:05.575602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:05.575602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:05.575602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:05.575602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:05.575602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:05.575602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:05.575602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:05.575602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:05.575602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:05.575602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:05.576711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:05.576711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:05.576711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:05.576711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:05.576711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:05.576711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:05.576711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:05.576711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:05.576711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:05.576711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:05.576711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:05.576711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:05.576711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:05.576711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:05.576711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:05.576711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:05.576711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:05.577611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:05.577611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:05.577611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:05.577611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:05.577611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 295/576] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:05.577611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880b89d-82c9-4540-915c-b5fb67c93956 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:05.585795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b611f-9839-4d2b-a9de-b4cbf833fbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:05.587336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b611f-9839-4d2b-a9de-b4cbf833fbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:05.587640 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b611f-9839-4d2b-a9de-b4cbf833fbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:05.587918 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b611f-9839-4d2b-a9de-b4cbf833fbd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:05.594550 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b611f-9839-4d2b-a9de-b4cbf833fbd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:05.595970 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b611f-9839-4d2b-a9de-b4cbf833fbd5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:05.609854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-573b611f-9839-4d2b-a9de-b4cbf833fbd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:05.609854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:05.609854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:05.609854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:05.609854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:05.609854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:05.609854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:05.609854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:05.609854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:05.609854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:05.609854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:05.609854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:05.609854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:05.609854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:05.609854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:05.610993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:05.610993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:05.610993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:05.610993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:05.610993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:05.610993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:05.610993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:05.610993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:05.610993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:05.610993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:05.610993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:05.610993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:05.610993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:05.610993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:05.610993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:05.610993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:05.610993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:05.611964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:05.611964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:05.611964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:05.611964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:05.611964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:05.611964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:05.611964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:05.611964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:05.612399 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 282/577] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:05.612954 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b611f-9839-4d2b-a9de-b4cbf833fbd5 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:05.672496 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880b89d-82c9-4540-915c-b5fb67c93956 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:05.704396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7844f-7703-4ca6-a97e-e02a2f03cc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:05.705117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7844f-7703-4ca6-a97e-e02a2f03cc9c None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:05.705404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7844f-7703-4ca6-a97e-e02a2f03cc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:05.705685 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7844f-7703-4ca6-a97e-e02a2f03cc9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:05.706387 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b611f-9839-4d2b-a9de-b4cbf833fbd5 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:05.715714 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7844f-7703-4ca6-a97e-e02a2f03cc9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:05.723449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-4ac7844f-7703-4ca6-a97e-e02a2f03cc9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:05.723449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:05.723449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:05.723449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:05.723449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:05.723449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:05.723449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:05.723449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:05.723449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:05.723449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:05.723449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:05.723449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:05.723449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:05.723449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:05.723449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:05.723449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:05.724363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:05.724363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:05.724363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:05.724363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:05.724363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:05.724363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:05.724363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:05.724363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:05.724363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:05.724363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:05.724363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:05.724363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:05.724363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:05.724363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:05.724363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:05.724363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:05.725212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:05.725212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:05.725212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:05.725212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:05.725212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:05.725212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:05.725212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:05.725212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:05.725212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:05.725212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:05.725212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:05.725212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:05.725212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 296/578] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:02:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:05.725904 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7844f-7703-4ca6-a97e-e02a2f03cc9c None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:05.739305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6f28d-ab89-4ec5-a99e-f03f0b3f746f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:05.739967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6f28d-ab89-4ec5-a99e-f03f0b3f746f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:05.740250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6f28d-ab89-4ec5-a99e-f03f0b3f746f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:05.740528 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6f28d-ab89-4ec5-a99e-f03f0b3f746f None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:05.741251 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6f28d-ab89-4ec5-a99e-f03f0b3f746f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:05.741561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6f28d-ab89-4ec5-a99e-f03f0b3f746f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:05.743489 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6f28d-ab89-4ec5-a99e-f03f0b3f746f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:05.754206 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 283/579] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:05.755011 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6f28d-ab89-4ec5-a99e-f03f0b3f746f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:05.822132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7844f-7703-4ca6-a97e-e02a2f03cc9c None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:05.854975 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6f28d-ab89-4ec5-a99e-f03f0b3f746f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:05.856741 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce62e7-eace-4aa5-a6dc-09b4b351ebd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:05.857400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce62e7-eace-4aa5-a6dc-09b4b351ebd7 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:05.857686 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce62e7-eace-4aa5-a6dc-09b4b351ebd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:05.857965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce62e7-eace-4aa5-a6dc-09b4b351ebd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:05.858850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce62e7-eace-4aa5-a6dc-09b4b351ebd7 None admin] RBAC: Adding query filter params (role.id=d09c313a1a354ea68cf1013629a4a584, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=76040882d4374087bb7458fd8b5c1d8d) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:05.859166 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce62e7-eace-4aa5-a6dc-09b4b351ebd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:05.860624 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce62e7-eace-4aa5-a6dc-09b4b351ebd7 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:05.866178 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 297/580] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:02:05 2022] GET /identity/v3/role_assignments?user.id=76040882d4374087bb7458fd8b5c1d8d&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=d09c313a1a354ea68cf1013629a4a584 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:05.866994 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce62e7-eace-4aa5-a6dc-09b4b351ebd7 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:05.891671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a841f-eda7-40e9-8eb1-396ad9fb51ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:05.892363 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a841f-eda7-40e9-8eb1-396ad9fb51ab None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:05.892650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a841f-eda7-40e9-8eb1-396ad9fb51ab None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:05.892932 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a841f-eda7-40e9-8eb1-396ad9fb51ab None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:05.893676 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a841f-eda7-40e9-8eb1-396ad9fb51ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:05.893988 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a841f-eda7-40e9-8eb1-396ad9fb51ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:05.895445 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a841f-eda7-40e9-8eb1-396ad9fb51ab None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:05.908219 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 284/581] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:05.908219 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a841f-eda7-40e9-8eb1-396ad9fb51ab None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:05.978383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce62e7-eace-4aa5-a6dc-09b4b351ebd7 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:06.013942 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4ee39-9cad-4632-ba26-735459ed6ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:06.014644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4ee39-9cad-4632-ba26-735459ed6ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:06.014935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4ee39-9cad-4632-ba26-735459ed6ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:06.015214 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4ee39-9cad-4632-ba26-735459ed6ef6 None admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:06.016020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4ee39-9cad-4632-ba26-735459ed6ef6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:06.016331 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4ee39-9cad-4632-ba26-735459ed6ef6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:06.017799 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4ee39-9cad-4632-ba26-735459ed6ef6 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:06.021351 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a841f-eda7-40e9-8eb1-396ad9fb51ab None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:06.041168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 298/582] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:06.041168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4ee39-9cad-4632-ba26-735459ed6ef6 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:06.059244 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5fb18-4127-45c9-90d9-37c5e3d3c0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:06.059923 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5fb18-4127-45c9-90d9-37c5e3d3c0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:06.060208 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5fb18-4127-45c9-90d9-37c5e3d3c0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:06.060484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5fb18-4127-45c9-90d9-37c5e3d3c0b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:06.061233 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5fb18-4127-45c9-90d9-37c5e3d3c0b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:06.061817 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5fb18-4127-45c9-90d9-37c5e3d3c0b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:06.063021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5fb18-4127-45c9-90d9-37c5e3d3c0b5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:06.076921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 285/583] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:02:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:06.076921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5fb18-4127-45c9-90d9-37c5e3d3c0b5 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:06.137893 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4ee39-9cad-4632-ba26-735459ed6ef6 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:06.172927 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ae463-7451-42b5-a19b-00279ee391c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:06.173740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ae463-7451-42b5-a19b-00279ee391c6 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:06.174182 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ae463-7451-42b5-a19b-00279ee391c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:06.174503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ae463-7451-42b5-a19b-00279ee391c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:06.180910 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5fb18-4127-45c9-90d9-37c5e3d3c0b5 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:06.182175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ae463-7451-42b5-a19b-00279ee391c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:06.183640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ae463-7451-42b5-a19b-00279ee391c6 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:06.198895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-a01ae463-7451-42b5-a19b-00279ee391c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 21:02:06.198895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:06.198895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:06.198895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:06.198895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:06.198895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:06.198895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:06.198895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:06.198895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:06.198895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:06.198895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:06.198895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:06.198895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:06.198895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:06.198895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:06.198895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:06.199897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:06.199897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:06.199897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:06.199897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:06.199897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:06.199897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:06.199897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:06.199897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:06.199897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:06.199897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:06.199897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:06.199897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:06.199897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:06.199897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:06.199897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:06.199897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:06.199897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:06.199897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:06.200844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:06.200844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:06.200844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:06.200844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:06.200844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:06.200844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:06.200844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:06.200844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:06.200844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 21:02:06.200844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:06.200844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 299/584] 10.222.0.25 () {56 vars in 1093 bytes} [Tue May 10 21:02:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:06.200844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ae463-7451-42b5-a19b-00279ee391c6 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:06.220001 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b96cf-7471-4aaf-b614-2845a15b27d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:06.221084 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b96cf-7471-4aaf-b614-2845a15b27d0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:06.221553 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b96cf-7471-4aaf-b614-2845a15b27d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:06.221988 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b96cf-7471-4aaf-b614-2845a15b27d0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:06.230371 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b96cf-7471-4aaf-b614-2845a15b27d0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:06.231805 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b96cf-7471-4aaf-b614-2845a15b27d0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:06.246229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-1e5b96cf-7471-4aaf-b614-2845a15b27d0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 21:02:06.246229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:06.246229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:06.246229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:06.246229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:06.246229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:06.246229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:06.246229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:06.246229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:06.246229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:06.246229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:06.246229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:06.246229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:06.246229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:06.246229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:06.246229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:06.247396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:06.247396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:06.247396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:06.247396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:06.247396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:06.247396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:06.247396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:06.247396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:06.247396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:06.247396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:06.247396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:06.247396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:06.247396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:06.247396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:06.247396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:06.247396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:06.247396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:06.247396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:06.248330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:06.248330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:06.248330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:06.248330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:06.248330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:06.248330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:06.248330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:06.248330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:06.248330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 21:02:06.248330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:06.248330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 286/585] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:02:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:06.248330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b96cf-7471-4aaf-b614-2845a15b27d0 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:06.311539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ae463-7451-42b5-a19b-00279ee391c6 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:06.349325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2443c8-1777-4a64-8dc3-bfb8683777f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:06.349325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2443c8-1777-4a64-8dc3-bfb8683777f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:06.349325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2443c8-1777-4a64-8dc3-bfb8683777f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:06.349325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2443c8-1777-4a64-8dc3-bfb8683777f6 None admin] PATH_INFO: `/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/aa2b6514779d42fa81d34351607dea27/roles/d09c313a1a354ea68cf1013629a4a584` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:06.359615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b96cf-7471-4aaf-b614-2845a15b27d0 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:06.366210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2443c8-1777-4a64-8dc3-bfb8683777f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=385eeb55a9ae42eba674de1e83d96e0d, user_id=aa2b6514779d42fa81d34351607dea27, role_id=d09c313a1a354ea68cf1013629a4a584)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:06.368301 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2443c8-1777-4a64-8dc3-bfb8683777f6 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:06.393732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f2f78-fc83-4b30-a416-a5e96f4dcb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:06.394562 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f2f78-fc83-4b30-a416-a5e96f4dcb27 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:06.394851 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f2f78-fc83-4b30-a416-a5e96f4dcb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:06.395128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f2f78-fc83-4b30-a416-a5e96f4dcb27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:06.405765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f2f78-fc83-4b30-a416-a5e96f4dcb27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:06.407242 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f2f78-fc83-4b30-a416-a5e96f4dcb27 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:06.430269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 300/586] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:02:06 2022] PUT /identity/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/aa2b6514779d42fa81d34351607dea27/roles/d09c313a1a354ea68cf1013629a4a584 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:02:06.430269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2443c8-1777-4a64-8dc3-bfb8683777f6 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:06.430671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-de0f2f78-fc83-4b30-a416-a5e96f4dcb27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:06.430671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:06.430671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:06.430671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:06.430671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:06.430671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:06.430671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:06.430671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:06.430671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:06.430671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:06.430671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:06.430671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:06.430671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:06.430671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:06.430671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:06.431717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:06.431717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:06.431717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:06.431717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:06.431717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:06.431717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:06.431717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:06.431717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:06.431717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:06.431717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:06.431717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:06.431717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:06.431717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:06.431717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:06.431717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:06.431717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:06.431717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:06.432812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:06.432812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:06.432812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:06.432812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:06.432812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 287/587] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:06.432812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f2f78-fc83-4b30-a416-a5e96f4dcb27 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:06.551724 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2443c8-1777-4a64-8dc3-bfb8683777f6 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:06.553522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f2f78-fc83-4b30-a416-a5e96f4dcb27 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:06.589890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81302752-fad7-4385-adb7-004aab2bc4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:06.590657 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816e924-fb85-4ee2-b1fd-97b67ecc7983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:06.590789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81302752-fad7-4385-adb7-004aab2bc4de None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:06.591123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81302752-fad7-4385-adb7-004aab2bc4de None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:06.591468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81302752-fad7-4385-adb7-004aab2bc4de None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:06.591585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816e924-fb85-4ee2-b1fd-97b67ecc7983 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:06.591938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816e924-fb85-4ee2-b1fd-97b67ecc7983 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:06.592287 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816e924-fb85-4ee2-b1fd-97b67ecc7983 None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:06.592564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81302752-fad7-4385-adb7-004aab2bc4de None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:06.592940 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81302752-fad7-4385-adb7-004aab2bc4de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:06.593375 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816e924-fb85-4ee2-b1fd-97b67ecc7983 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:06.593764 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816e924-fb85-4ee2-b1fd-97b67ecc7983 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:06.594736 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81302752-fad7-4385-adb7-004aab2bc4de None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:06.595463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816e924-fb85-4ee2-b1fd-97b67ecc7983 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:06.614932 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 288/588] 10.222.0.25 () {56 vars in 1137 bytes} [Tue May 10 21:02:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:06.615931 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81302752-fad7-4385-adb7-004aab2bc4de None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:06.619095 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 301/589] 10.222.0.25 () {56 vars in 1133 bytes} [Tue May 10 21:02:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:06.624477 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816e924-fb85-4ee2-b1fd-97b67ecc7983 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:06.718258 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81302752-fad7-4385-adb7-004aab2bc4de None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:06.725691 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816e924-fb85-4ee2-b1fd-97b67ecc7983 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:06.753494 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce8d7f-b6c7-4c8f-9bea-3076df29cd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:06.754523 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce8d7f-b6c7-4c8f-9bea-3076df29cd15 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:06.755021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce8d7f-b6c7-4c8f-9bea-3076df29cd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:06.755505 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce8d7f-b6c7-4c8f-9bea-3076df29cd15 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:06.756568 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce8d7f-b6c7-4c8f-9bea-3076df29cd15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:06.757137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce8d7f-b6c7-4c8f-9bea-3076df29cd15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:06.759833 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce8d7f-b6c7-4c8f-9bea-3076df29cd15 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:06.760651 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee86046-b849-494c-aec9-34cd9264b6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:06.761594 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee86046-b849-494c-aec9-34cd9264b6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:06.761958 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee86046-b849-494c-aec9-34cd9264b6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:06.762331 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee86046-b849-494c-aec9-34cd9264b6d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:06.772713 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 289/590] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:06.773956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce8d7f-b6c7-4c8f-9bea-3076df29cd15 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:06.779174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee86046-b849-494c-aec9-34cd9264b6d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:06.780047 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee86046-b849-494c-aec9-34cd9264b6d8 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:06.800632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-9ee86046-b849-494c-aec9-34cd9264b6d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:06.800632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:06.800632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:06.800632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:06.800632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:06.800632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:06.800632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:06.800632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:06.800632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:06.800632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:06.800632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:06.800632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:06.800632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:06.800632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:06.800632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:06.802168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:06.802168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:06.802168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:06.802168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:06.802168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:06.802168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:06.802168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:06.802168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:06.802168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:06.802168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:06.802168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:06.802168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:06.802168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:06.802168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:06.802168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:06.802168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:06.802168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:06.803312 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:06.803312 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:06.803312 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:06.803312 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:06.809114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 302/591] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:06.809114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee86046-b849-494c-aec9-34cd9264b6d8 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:06.890427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce8d7f-b6c7-4c8f-9bea-3076df29cd15 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:06.909876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee86046-b849-494c-aec9-34cd9264b6d8 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:06.925098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e27f8-406e-418d-ba65-5c4246e28b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:06.926248 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e27f8-406e-418d-ba65-5c4246e28b38 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:06.926778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e27f8-406e-418d-ba65-5c4246e28b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:06.927277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e27f8-406e-418d-ba65-5c4246e28b38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:06.939024 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e27f8-406e-418d-ba65-5c4246e28b38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:06.940877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e27f8-406e-418d-ba65-5c4246e28b38 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:06.946253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6636ec-1d21-414d-a4ff-fa937386de2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:06.947154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6636ec-1d21-414d-a4ff-fa937386de2d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:06.947439 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6636ec-1d21-414d-a4ff-fa937386de2d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:06.947715 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6636ec-1d21-414d-a4ff-fa937386de2d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:06.955168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6636ec-1d21-414d-a4ff-fa937386de2d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:06.956708 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6636ec-1d21-414d-a4ff-fa937386de2d None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:06.962468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-c45e27f8-406e-418d-ba65-5c4246e28b38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:06.962468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:06.962468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:06.962468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:06.962468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:06.962468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:06.962468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:06.962468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:06.962468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:06.962468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:06.962468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:06.962468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:06.962468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:06.962468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:06.962468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:06.963376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:06.963376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:06.963376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:06.963376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:06.963376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:06.963376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:06.963376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:06.963376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:06.963376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:06.963376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:06.963376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:06.963376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:06.963376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:06.963376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:06.963376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:06.963376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:06.963376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:06.964386 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:06.964386 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:06.964386 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:06.964386 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:06.971106 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 290/592] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:06.972285 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e27f8-406e-418d-ba65-5c4246e28b38 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:06.972495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-4b6636ec-1d21-414d-a4ff-fa937386de2d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 21:02:06.972495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:06.972495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:06.972495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:06.972495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:06.972495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:06.972495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:06.972495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:06.972495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:06.972495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:06.972495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:06.972495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:06.972495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:06.972495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:06.972495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:06.972495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:06.973400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:06.973400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:06.973400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:06.973400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:06.973400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:06.973400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:06.973400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:06.973400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:06.973400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:06.973400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:06.973400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:06.973400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:06.973400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:06.973400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:06.973400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:06.973400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:06.973400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:06.973400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:06.974360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:06.974360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:06.974360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:06.974360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:06.974360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:06.974360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:06.974360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:06.974360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:06.974360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 21:02:06.974360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:06.977974 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 303/593] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:02:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:06.978926 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6636ec-1d21-414d-a4ff-fa937386de2d None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:07.086657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e27f8-406e-418d-ba65-5c4246e28b38 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:07.100781 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6636ec-1d21-414d-a4ff-fa937386de2d None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:07.129579 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95071936-b090-4a28-a912-fcb56ca8168f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:07.130787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95071936-b090-4a28-a912-fcb56ca8168f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:07.131564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95071936-b090-4a28-a912-fcb56ca8168f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:07.132295 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95071936-b090-4a28-a912-fcb56ca8168f None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:07.134213 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95071936-b090-4a28-a912-fcb56ca8168f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:07.134842 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95071936-b090-4a28-a912-fcb56ca8168f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:07.136606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfa154-f897-4c62-a425-7c48173b4c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:07.136946 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95071936-b090-4a28-a912-fcb56ca8168f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:07.137399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfa154-f897-4c62-a425-7c48173b4c6d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:07.137750 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfa154-f897-4c62-a425-7c48173b4c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:07.138113 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfa154-f897-4c62-a425-7c48173b4c6d None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:07.138946 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfa154-f897-4c62-a425-7c48173b4c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:07.139324 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfa154-f897-4c62-a425-7c48173b4c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:07.140829 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfa154-f897-4c62-a425-7c48173b4c6d None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:07.157187 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 304/594] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:07.157187 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfa154-f897-4c62-a425-7c48173b4c6d None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:07.157463 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 291/595] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:07.158769 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95071936-b090-4a28-a912-fcb56ca8168f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:07.257688 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfa154-f897-4c62-a425-7c48173b4c6d None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:07.287121 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95071936-b090-4a28-a912-fcb56ca8168f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:07.292243 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb385fb9-2d6c-4345-97c7-1e8a506a3880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:07.293167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb385fb9-2d6c-4345-97c7-1e8a506a3880 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:07.293648 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb385fb9-2d6c-4345-97c7-1e8a506a3880 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:07.294126 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb385fb9-2d6c-4345-97c7-1e8a506a3880 None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:07.295185 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb385fb9-2d6c-4345-97c7-1e8a506a3880 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:07.295695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb385fb9-2d6c-4345-97c7-1e8a506a3880 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:07.297975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb385fb9-2d6c-4345-97c7-1e8a506a3880 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:07.322827 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 305/596] 10.222.0.25 () {56 vars in 1139 bytes} [Tue May 10 21:02:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:07.323972 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb385fb9-2d6c-4345-97c7-1e8a506a3880 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:07.325021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20d5e4-fa05-4088-990b-2da04bedbe34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:07.326067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20d5e4-fa05-4088-990b-2da04bedbe34 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:07.326558 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20d5e4-fa05-4088-990b-2da04bedbe34 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:07.327035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20d5e4-fa05-4088-990b-2da04bedbe34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:07.336563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20d5e4-fa05-4088-990b-2da04bedbe34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:07.338812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20d5e4-fa05-4088-990b-2da04bedbe34 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:07.357448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-0b20d5e4-fa05-4088-990b-2da04bedbe34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:07.357448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:07.357448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:07.357448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:07.357448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:07.357448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:07.357448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:07.357448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:07.357448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:07.357448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:07.357448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:07.357448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:07.357448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:07.357448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:07.357448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:07.358381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:07.358381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:07.358381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:07.358381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:07.358381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:07.358381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:07.358381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:07.358381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:07.358381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:07.358381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:07.358381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:07.358381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:07.358381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:07.358381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:07.358381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:07.358381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:07.358381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:07.359336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:07.359336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:07.359336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:07.359336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:07.359336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:07.359336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:07.359336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:07.359336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:07.365151 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 292/597] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:07.365151 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20d5e4-fa05-4088-990b-2da04bedbe34 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:07.461352 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb385fb9-2d6c-4345-97c7-1e8a506a3880 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:07.467469 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20d5e4-fa05-4088-990b-2da04bedbe34 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:07.501766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd1055-8140-43ad-8129-77cfd04f77aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:07.502623 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd1055-8140-43ad-8129-77cfd04f77aa None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:07.502995 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd1055-8140-43ad-8129-77cfd04f77aa None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:07.503282 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd1055-8140-43ad-8129-77cfd04f77aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:07.506946 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9833e00-23f2-4510-b6ac-93bdde7484ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:07.508650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9833e00-23f2-4510-b6ac-93bdde7484ed None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:07.509165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9833e00-23f2-4510-b6ac-93bdde7484ed None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:07.509662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9833e00-23f2-4510-b6ac-93bdde7484ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:07.511428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd1055-8140-43ad-8129-77cfd04f77aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:07.512873 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd1055-8140-43ad-8129-77cfd04f77aa None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:07.521984 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9833e00-23f2-4510-b6ac-93bdde7484ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:07.523870 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9833e00-23f2-4510-b6ac-93bdde7484ed None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:07.527802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-f7bd1055-8140-43ad-8129-77cfd04f77aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:07.527802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:07.527802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:07.527802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:07.527802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:07.527802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:07.527802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:07.527802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:07.527802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:07.527802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:07.527802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:07.527802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:07.527802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:07.527802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:07.527802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:07.528698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:07.528698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:07.528698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:07.528698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:07.528698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:07.528698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:07.528698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:07.528698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:07.528698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:07.528698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:07.528698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:07.528698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:07.528698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:07.528698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:07.528698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:07.528698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:07.528698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:07.529586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:07.529586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:07.529586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:07.529586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:07.529586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:07.529586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:07.529586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:07.529586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:07.533857 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 306/598] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:07.535079 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd1055-8140-43ad-8129-77cfd04f77aa None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:07.548481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-b9833e00-23f2-4510-b6ac-93bdde7484ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:07.548481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:07.548481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:07.548481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:07.548481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:07.548481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:07.548481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:07.548481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:07.548481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:07.548481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:07.548481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:07.548481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:07.548481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:07.548481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:07.548481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:07.549420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:07.549420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:07.549420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:07.549420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:07.549420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:07.549420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:07.549420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:07.549420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:07.549420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:07.549420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:07.549420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:07.549420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:07.549420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:07.549420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:07.549420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:07.549420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:07.549420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:07.550342 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:07.550342 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:07.550342 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:07.550342 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:07.551906 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 293/599] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:07.557533 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9833e00-23f2-4510-b6ac-93bdde7484ed None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:07.651022 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd1055-8140-43ad-8129-77cfd04f77aa None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:07.688320 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9833e00-23f2-4510-b6ac-93bdde7484ed None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:07.689260 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b8b7a-2581-4abc-a63d-0f0d185adb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:07.690039 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b8b7a-2581-4abc-a63d-0f0d185adb1a None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:07.690625 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b8b7a-2581-4abc-a63d-0f0d185adb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:07.691030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b8b7a-2581-4abc-a63d-0f0d185adb1a None admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:07.692804 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b8b7a-2581-4abc-a63d-0f0d185adb1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:07.693228 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b8b7a-2581-4abc-a63d-0f0d185adb1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:07.694810 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b8b7a-2581-4abc-a63d-0f0d185adb1a None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:07.715348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 307/600] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:07.715348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b8b7a-2581-4abc-a63d-0f0d185adb1a None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:07.740729 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249adba3-adf8-4001-8924-1d8bd72b2e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:07.743274 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249adba3-adf8-4001-8924-1d8bd72b2e02 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:07.743822 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249adba3-adf8-4001-8924-1d8bd72b2e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:07.744480 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249adba3-adf8-4001-8924-1d8bd72b2e02 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:07.745876 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249adba3-adf8-4001-8924-1d8bd72b2e02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:07.746683 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249adba3-adf8-4001-8924-1d8bd72b2e02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:07.748838 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249adba3-adf8-4001-8924-1d8bd72b2e02 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:07.764681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 294/601] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:07.766159 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249adba3-adf8-4001-8924-1d8bd72b2e02 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:07.828504 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b8b7a-2581-4abc-a63d-0f0d185adb1a None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:07.876586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb256060-f448-4ac5-a9b7-8e8d367db8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:07.877833 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb256060-f448-4ac5-a9b7-8e8d367db8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:07.878473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb256060-f448-4ac5-a9b7-8e8d367db8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:07.878958 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb256060-f448-4ac5-a9b7-8e8d367db8c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:07.880411 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb256060-f448-4ac5-a9b7-8e8d367db8c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:07.880919 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb256060-f448-4ac5-a9b7-8e8d367db8c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:07.882090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249adba3-adf8-4001-8924-1d8bd72b2e02 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:07.882736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb256060-f448-4ac5-a9b7-8e8d367db8c2 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:07.901929 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 308/602] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:07.901929 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb256060-f448-4ac5-a9b7-8e8d367db8c2 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:07.926504 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ae763-540b-4884-9cec-777f3f28ee93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:07.928314 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ae763-540b-4884-9cec-777f3f28ee93 None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:07.928918 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ae763-540b-4884-9cec-777f3f28ee93 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:07.929408 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ae763-540b-4884-9cec-777f3f28ee93 None admin] PATH_INFO: `/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/c4dfa98f420c4c4c845262a78ae75ae8/roles/d09c313a1a354ea68cf1013629a4a584` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:07.951286 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ae763-540b-4884-9cec-777f3f28ee93 None admin] RBAC: Authorizing `identity:create_grant(project_id=385eeb55a9ae42eba674de1e83d96e0d, user_id=c4dfa98f420c4c4c845262a78ae75ae8, role_id=d09c313a1a354ea68cf1013629a4a584)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:07.953447 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ae763-540b-4884-9cec-777f3f28ee93 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:08.009423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb256060-f448-4ac5-a9b7-8e8d367db8c2 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:08.038654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 295/603] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:02:07 2022] PUT /identity/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/c4dfa98f420c4c4c845262a78ae75ae8/roles/d09c313a1a354ea68cf1013629a4a584 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:02:08.041144 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ae763-540b-4884-9cec-777f3f28ee93 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:08.057625 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc82217-1eab-45ca-8dd2-62a1d49a3770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:08.058638 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc82217-1eab-45ca-8dd2-62a1d49a3770 None admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:08.058977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc82217-1eab-45ca-8dd2-62a1d49a3770 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:08.059311 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc82217-1eab-45ca-8dd2-62a1d49a3770 None admin] PATH_INFO: `/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/c4c16a3b07c64a22bfc3df2a5a90c3f3/roles/d09c313a1a354ea68cf1013629a4a584` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:08.096631 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc82217-1eab-45ca-8dd2-62a1d49a3770 None admin] RBAC: Authorizing `identity:create_grant(project_id=385eeb55a9ae42eba674de1e83d96e0d, user_id=c4c16a3b07c64a22bfc3df2a5a90c3f3, role_id=d09c313a1a354ea68cf1013629a4a584)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:08.098105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc82217-1eab-45ca-8dd2-62a1d49a3770 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:08.188663 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ae763-540b-4884-9cec-777f3f28ee93 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:08.212406 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 309/604] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:02:07 2022] PUT /identity/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/c4c16a3b07c64a22bfc3df2a5a90c3f3/roles/d09c313a1a354ea68cf1013629a4a584 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:02:08.213854 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2594ec4-9ec3-4118-a3a8-67516fc9d05c None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:08.214154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2594ec4-9ec3-4118-a3a8-67516fc9d05c None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:08.214459 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2594ec4-9ec3-4118-a3a8-67516fc9d05c None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:08.221392 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 310/605] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:08.223896 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12949a2-b640-434e-86ab-149b67083045 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:08.224217 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12949a2-b640-434e-86ab-149b67083045 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:08.224527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12949a2-b640-434e-86ab-149b67083045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:08.236300 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36562e7c-5a14-406d-af70-1b2cf8337418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:08.237518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36562e7c-5a14-406d-af70-1b2cf8337418 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:08.237976 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36562e7c-5a14-406d-af70-1b2cf8337418 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:08.238253 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36562e7c-5a14-406d-af70-1b2cf8337418 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:08.247958 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36562e7c-5a14-406d-af70-1b2cf8337418 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:08.249188 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-e12949a2-b640-434e-86ab-149b67083045 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:08.249419 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36562e7c-5a14-406d-af70-1b2cf8337418 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:08.250586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e12949a2-b640-434e-86ab-149b67083045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:08.267915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-36562e7c-5a14-406d-af70-1b2cf8337418 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:08.267915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:08.267915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:08.267915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:08.267915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:08.267915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:08.267915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:08.267915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:08.267915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:08.267915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:08.267915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:08.267915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:08.267915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:08.267915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:08.267915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:08.268891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:08.268891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:08.268891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:08.268891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:08.268891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:08.268891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:08.268891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:08.268891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:08.268891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:08.268891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:08.268891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:08.268891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:08.268891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:08.268891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:08.268891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:08.268891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:08.268891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:08.269843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:08.269843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:08.269843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:08.269843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:08.269843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:08.269843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:08.269843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:08.269843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:08.270279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 296/606] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:08.276861 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36562e7c-5a14-406d-af70-1b2cf8337418 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:08.345864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 311/607] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:02:08.394141 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12949a2-b640-434e-86ab-149b67083045 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:08.439761 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36562e7c-5a14-406d-af70-1b2cf8337418 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:08.499575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaddfe2-c681-44f8-82a4-632ef45a6203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:08.500280 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaddfe2-c681-44f8-82a4-632ef45a6203 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:08.500562 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaddfe2-c681-44f8-82a4-632ef45a6203 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:08.500841 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaddfe2-c681-44f8-82a4-632ef45a6203 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:08.502052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaddfe2-c681-44f8-82a4-632ef45a6203 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:08.502374 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaddfe2-c681-44f8-82a4-632ef45a6203 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:08.504322 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaddfe2-c681-44f8-82a4-632ef45a6203 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:08.520670 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 297/608] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:08.526460 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaddfe2-c681-44f8-82a4-632ef45a6203 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:08.542358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12949a2-b640-434e-86ab-149b67083045 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:08.579128 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de881592-44c8-45e3-82de-ce92db7133fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:08.579939 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de881592-44c8-45e3-82de-ce92db7133fe None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:08.580227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de881592-44c8-45e3-82de-ce92db7133fe None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:08.580502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de881592-44c8-45e3-82de-ce92db7133fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:08.591698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de881592-44c8-45e3-82de-ce92db7133fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:08.599614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-de881592-44c8-45e3-82de-ce92db7133fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:08.599614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:08.599614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:08.599614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:08.599614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:08.599614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:08.599614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:08.599614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:08.599614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:08.599614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:08.599614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:08.599614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:08.599614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:08.599614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:08.599614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:08.599614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:08.602124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:08.602124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:08.602124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:08.602124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:08.602124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:08.602124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:08.602124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:08.602124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:08.602124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:08.602124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:08.602124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:08.602124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:08.602124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:08.602124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:08.602124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:08.602124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:08.603473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:08.603473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:08.603473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:08.603473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:08.603473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:08.603473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:08.603473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:08.603473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:08.603473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:08.603473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:08.603473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:08.603473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:08.603473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 312/609] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:02:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:08.615586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de881592-44c8-45e3-82de-ce92db7133fe None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:08.631392 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaddfe2-c681-44f8-82a4-632ef45a6203 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:08.666199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfedd8a-0a58-4555-bcb5-cd053bf532a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:08.667106 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfedd8a-0a58-4555-bcb5-cd053bf532a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:08.667383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfedd8a-0a58-4555-bcb5-cd053bf532a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:08.667654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfedd8a-0a58-4555-bcb5-cd053bf532a1 None admin] PATH_INFO: `/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/2fa7da0ccf954be1a582411cdc617b0f/roles/d09c313a1a354ea68cf1013629a4a584` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:08.683235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfedd8a-0a58-4555-bcb5-cd053bf532a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=385eeb55a9ae42eba674de1e83d96e0d, user_id=2fa7da0ccf954be1a582411cdc617b0f, role_id=d09c313a1a354ea68cf1013629a4a584)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:08.684662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfedd8a-0a58-4555-bcb5-cd053bf532a1 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:08.772754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de881592-44c8-45e3-82de-ce92db7133fe None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:08.782244 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 298/610] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:02:08 2022] PUT /identity/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/2fa7da0ccf954be1a582411cdc617b0f/roles/d09c313a1a354ea68cf1013629a4a584 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:02:08.831633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d0136-3086-4cc3-b25d-5430bc1fcd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:08.832306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d0136-3086-4cc3-b25d-5430bc1fcd68 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:08.832590 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d0136-3086-4cc3-b25d-5430bc1fcd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:08.832864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d0136-3086-4cc3-b25d-5430bc1fcd68 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:08.833714 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d0136-3086-4cc3-b25d-5430bc1fcd68 None admin] RBAC: Adding query filter params (name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:08.834020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d0136-3086-4cc3-b25d-5430bc1fcd68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:08.841586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d0136-3086-4cc3-b25d-5430bc1fcd68 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:08.850632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 313/611] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:02:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:08.859101 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfedd8a-0a58-4555-bcb5-cd053bf532a1 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:08.972142 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3043b04-b5d6-4c74-9605-04770c8719b5 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:08.972142 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3043b04-b5d6-4c74-9605-04770c8719b5 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:08.972142 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3043b04-b5d6-4c74-9605-04770c8719b5 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:08.973894 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 314/612] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:08.994485 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15238347-1757-44c8-ab75-ccfa30f0dbfa None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:08.994485 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15238347-1757-44c8-ab75-ccfa30f0dbfa None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:08.994485 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15238347-1757-44c8-ab75-ccfa30f0dbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:09.013491 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfedd8a-0a58-4555-bcb5-cd053bf532a1 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:09.014125 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-15238347-1757-44c8-ab75-ccfa30f0dbfa None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:09.015548 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-15238347-1757-44c8-ab75-ccfa30f0dbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:09.084973 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821eabd5-f835-4b39-ab8e-db8d582ca083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:09.091999 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821eabd5-f835-4b39-ab8e-db8d582ca083 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:09.092723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821eabd5-f835-4b39-ab8e-db8d582ca083 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:09.093166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821eabd5-f835-4b39-ab8e-db8d582ca083 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:09.110923 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821eabd5-f835-4b39-ab8e-db8d582ca083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:09.113454 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821eabd5-f835-4b39-ab8e-db8d582ca083 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:09.142305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-821eabd5-f835-4b39-ab8e-db8d582ca083 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:09.142305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:09.142305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:09.142305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:09.142305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:09.142305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:09.142305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:09.142305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:09.142305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:09.142305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:09.142305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:09.142305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:09.142305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:09.142305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:09.142305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:09.143470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:09.143470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:09.143470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:09.143470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:09.143470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:09.143470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:09.143470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:09.143470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:09.143470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:09.143470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:09.143470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:09.143470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:09.143470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:09.143470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:09.143470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:09.143470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:09.143470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:09.145443 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:09.145443 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:09.145443 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:09.145443 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:09.145443 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 299/613] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:09.145790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 315/614] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:02:09.149637 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821eabd5-f835-4b39-ab8e-db8d582ca083 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:09.172590 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15238347-1757-44c8-ab75-ccfa30f0dbfa None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:09.251741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821eabd5-f835-4b39-ab8e-db8d582ca083 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:09.285450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0852df-242e-4610-8f86-4eadfa18d789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:09.286488 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0852df-242e-4610-8f86-4eadfa18d789 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:09.286952 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0852df-242e-4610-8f86-4eadfa18d789 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:09.287473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0852df-242e-4610-8f86-4eadfa18d789 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:09.288033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15238347-1757-44c8-ab75-ccfa30f0dbfa None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:09.288561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0852df-242e-4610-8f86-4eadfa18d789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:09.289603 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0852df-242e-4610-8f86-4eadfa18d789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:09.291206 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0852df-242e-4610-8f86-4eadfa18d789 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:09.303739 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 300/615] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:09.310061 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0852df-242e-4610-8f86-4eadfa18d789 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:09.324223 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ec9e6-bfce-430e-a320-ecf905115416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:09.325034 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ec9e6-bfce-430e-a320-ecf905115416 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:09.325322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ec9e6-bfce-430e-a320-ecf905115416 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:09.325602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ec9e6-bfce-430e-a320-ecf905115416 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:09.336044 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ec9e6-bfce-430e-a320-ecf905115416 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:09.343836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-a22ec9e6-bfce-430e-a320-ecf905115416 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:09.343836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:09.343836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:09.343836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:09.343836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:09.343836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:09.343836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:09.343836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:09.343836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:09.343836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:09.343836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:09.343836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:09.343836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:09.343836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:09.343836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:09.343836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:09.344812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:09.344812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:09.344812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:09.344812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:09.344812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:09.344812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:09.344812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:09.344812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:09.344812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:09.344812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:09.344812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:09.344812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:09.344812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:09.344812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:09.344812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:09.344812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:09.345649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:09.345649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:09.345649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:09.345649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:09.345649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:09.345649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:09.345649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:09.345649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:09.345649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:09.345649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:09.345649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:09.345649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:09.345649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 316/616] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:02:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:09.350835 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ec9e6-bfce-430e-a320-ecf905115416 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:09.418128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0852df-242e-4610-8f86-4eadfa18d789 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:09.491689 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ec9e6-bfce-430e-a320-ecf905115416 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:09.520116 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366708d2-d854-43c8-bcca-1fa82133c2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:09.520943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366708d2-d854-43c8-bcca-1fa82133c2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:09.521233 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366708d2-d854-43c8-bcca-1fa82133c2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:09.521516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366708d2-d854-43c8-bcca-1fa82133c2a8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:09.529799 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366708d2-d854-43c8-bcca-1fa82133c2a8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:09.531257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366708d2-d854-43c8-bcca-1fa82133c2a8 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:09.537259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b217968-7fe6-4ff1-8364-779179d3afe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:09.538280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b217968-7fe6-4ff1-8364-779179d3afe7 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:09.538633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b217968-7fe6-4ff1-8364-779179d3afe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:09.539700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b217968-7fe6-4ff1-8364-779179d3afe7 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:09.540604 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b217968-7fe6-4ff1-8364-779179d3afe7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:09.540919 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b217968-7fe6-4ff1-8364-779179d3afe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:09.542288 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b217968-7fe6-4ff1-8364-779179d3afe7 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:09.547138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-366708d2-d854-43c8-bcca-1fa82133c2a8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 21:02:09.547138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:09.547138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:09.547138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:09.547138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:09.547138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:09.547138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:09.547138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:09.547138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:09.547138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:09.547138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:09.547138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:09.547138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:09.547138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:09.547138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:09.547138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:09.548056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:09.548056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:09.548056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:09.548056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:09.548056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:09.548056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:09.548056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:09.548056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:09.548056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:09.548056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:09.548056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:09.548056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:09.548056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:09.548056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:09.548056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:09.548056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:09.548056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:09.548056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:09.549003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:09.549003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:09.549003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:09.549003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:09.549003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:09.549003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:09.549003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:09.549003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:09.549003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 21:02:09.549003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:09.549003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 301/617] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:02:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:09.556602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366708d2-d854-43c8-bcca-1fa82133c2a8 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:09.571465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 317/618] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:02:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:09.576523 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b217968-7fe6-4ff1-8364-779179d3afe7 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:09.702653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366708d2-d854-43c8-bcca-1fa82133c2a8 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:09.737242 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2715d-081b-4583-9332-b10af173f318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:09.737915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2715d-081b-4583-9332-b10af173f318 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:09.738199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2715d-081b-4583-9332-b10af173f318 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:09.738497 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2715d-081b-4583-9332-b10af173f318 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:09.739337 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2715d-081b-4583-9332-b10af173f318 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:09.739642 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2715d-081b-4583-9332-b10af173f318 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:09.741171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2715d-081b-4583-9332-b10af173f318 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:09.758667 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 302/619] 10.222.0.25 () {56 vars in 1135 bytes} [Tue May 10 21:02:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:09.763922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2715d-081b-4583-9332-b10af173f318 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:09.797248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b217968-7fe6-4ff1-8364-779179d3afe7 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:09.887163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c483a-d598-4460-9a44-999a2c876697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:09.887973 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c483a-d598-4460-9a44-999a2c876697 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:09.888261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c483a-d598-4460-9a44-999a2c876697 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:09.888539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c483a-d598-4460-9a44-999a2c876697 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:09.890581 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2715d-081b-4583-9332-b10af173f318 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:09.911573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c483a-d598-4460-9a44-999a2c876697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:09.913041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c483a-d598-4460-9a44-999a2c876697 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:09.928447 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324a0a3-8be9-454b-b947-667dbe0d3915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:09.929242 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324a0a3-8be9-454b-b947-667dbe0d3915 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:09.930080 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324a0a3-8be9-454b-b947-667dbe0d3915 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:09.930354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324a0a3-8be9-454b-b947-667dbe0d3915 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:09.948138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-850c483a-d598-4460-9a44-999a2c876697 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:09.948138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:09.948138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:09.948138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:09.948138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:09.948138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:09.948138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:09.948138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:09.948138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:09.948138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:09.948138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:09.948138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:09.948138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:09.948138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:09.948138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:09.949059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:09.949059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:09.949059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:09.949059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:09.949059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:09.949059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:09.949059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:09.949059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:09.949059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:09.949059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:09.949059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:09.949059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:09.949059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:09.949059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:09.949059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:09.949059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:09.949059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:09.951573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:09.951573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:09.951573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:09.951573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:09.951573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 318/620] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:09.953814 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324a0a3-8be9-454b-b947-667dbe0d3915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:09.954694 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324a0a3-8be9-454b-b947-667dbe0d3915 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:09.955919 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c483a-d598-4460-9a44-999a2c876697 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:09.974352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-0324a0a3-8be9-454b-b947-667dbe0d3915 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:09.974352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:09.974352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:09.974352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:09.974352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:09.974352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:09.974352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:09.974352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:09.974352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:09.974352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:09.974352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:09.974352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:09.974352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:09.974352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:09.974352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:09.976216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:09.976216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:09.976216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:09.976216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:09.976216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:09.976216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:09.976216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:09.976216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:09.976216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:09.976216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:09.976216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:09.976216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:09.976216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:09.976216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:09.976216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:09.976216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:09.976216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:09.977437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:09.977437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:09.977437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:09.977437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:09.977437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 303/621] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:09.983101 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324a0a3-8be9-454b-b947-667dbe0d3915 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:10.090611 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324a0a3-8be9-454b-b947-667dbe0d3915 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:10.126722 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f3a07-3176-42d5-b877-7147c9ce8e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:10.127394 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f3a07-3176-42d5-b877-7147c9ce8e53 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:10.127676 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f3a07-3176-42d5-b877-7147c9ce8e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:10.127952 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f3a07-3176-42d5-b877-7147c9ce8e53 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:10.128671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f3a07-3176-42d5-b877-7147c9ce8e53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:10.130164 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f3a07-3176-42d5-b877-7147c9ce8e53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:10.130334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f3a07-3176-42d5-b877-7147c9ce8e53 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:10.145575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 304/622] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:10.156219 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f3a07-3176-42d5-b877-7147c9ce8e53 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:10.197622 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c483a-d598-4460-9a44-999a2c876697 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:10.263833 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25421f1e-889e-4e81-83cf-46b0ba960ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:10.265346 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25421f1e-889e-4e81-83cf-46b0ba960ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:10.265925 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25421f1e-889e-4e81-83cf-46b0ba960ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:10.267350 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25421f1e-889e-4e81-83cf-46b0ba960ec4 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:10.268269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25421f1e-889e-4e81-83cf-46b0ba960ec4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:10.269348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25421f1e-889e-4e81-83cf-46b0ba960ec4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:10.271399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25421f1e-889e-4e81-83cf-46b0ba960ec4 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:10.285563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 319/623] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:10.295459 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25421f1e-889e-4e81-83cf-46b0ba960ec4 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:10.318459 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f3a07-3176-42d5-b877-7147c9ce8e53 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:10.360353 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c43b4-fbd4-42dc-92eb-b6a89a05f24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:10.361552 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c43b4-fbd4-42dc-92eb-b6a89a05f24f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:10.362032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c43b4-fbd4-42dc-92eb-b6a89a05f24f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:10.362529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c43b4-fbd4-42dc-92eb-b6a89a05f24f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:10.384263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c43b4-fbd4-42dc-92eb-b6a89a05f24f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:10.385753 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c43b4-fbd4-42dc-92eb-b6a89a05f24f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:10.407085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-9f7c43b4-fbd4-42dc-92eb-b6a89a05f24f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:10.407085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:10.407085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:10.407085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:10.407085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:10.407085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:10.407085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:10.407085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:10.407085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:10.407085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:10.407085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:10.407085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:10.407085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:10.407085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:10.407085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:10.408062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:10.408062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:10.408062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:10.408062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:10.408062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:10.408062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:10.408062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:10.408062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:10.408062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:10.408062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:10.408062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:10.408062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:10.408062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:10.408062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:10.408062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:10.408062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:10.408062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:10.408961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:10.408961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:10.408961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:10.408961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:10.408961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:10.408961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:10.408961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:10.408961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:10.408961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 305/624] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:10.419536 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c43b4-fbd4-42dc-92eb-b6a89a05f24f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:10.442148 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25421f1e-889e-4e81-83cf-46b0ba960ec4 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:10.484844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d741d-6101-49a6-bdd6-eef244283ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:10.485999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d741d-6101-49a6-bdd6-eef244283ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:10.486786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d741d-6101-49a6-bdd6-eef244283ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:10.488293 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d741d-6101-49a6-bdd6-eef244283ce8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:10.508496 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d741d-6101-49a6-bdd6-eef244283ce8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:10.509463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d741d-6101-49a6-bdd6-eef244283ce8 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:10.547329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-b47d741d-6101-49a6-bdd6-eef244283ce8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 21:02:10.547329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:10.547329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:10.547329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:10.547329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:10.547329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:10.547329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:10.547329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:10.547329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:10.547329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:10.547329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:10.547329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:10.547329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:10.547329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:10.547329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:10.547329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:10.548319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:10.548319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:10.548319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:10.548319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:10.548319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:10.548319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:10.548319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:10.548319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:10.548319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:10.548319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:10.548319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:10.548319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:10.548319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:10.548319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:10.548319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:10.548319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:10.548319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:10.548319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:10.549248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:10.549248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:10.549248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:10.549248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:10.549248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:10.549248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:10.549248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:10.549248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:10.549248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 21:02:10.549248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:10.549248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 320/625] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:02:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:10.554127 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d741d-6101-49a6-bdd6-eef244283ce8 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:10.586192 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c43b4-fbd4-42dc-92eb-b6a89a05f24f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:10.623876 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aaf49b-a025-4f4d-90ec-fe3faaec37f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:10.624928 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaf49b-a025-4f4d-90ec-fe3faaec37f0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:10.625410 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaf49b-a025-4f4d-90ec-fe3faaec37f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:10.625882 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaf49b-a025-4f4d-90ec-fe3faaec37f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:10.627442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aaf49b-a025-4f4d-90ec-fe3faaec37f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:10.627951 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aaf49b-a025-4f4d-90ec-fe3faaec37f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:10.629835 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aaf49b-a025-4f4d-90ec-fe3faaec37f0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:10.643242 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 306/626] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:10.654466 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aaf49b-a025-4f4d-90ec-fe3faaec37f0 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:10.782181 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d741d-6101-49a6-bdd6-eef244283ce8 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:10.794235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aaf49b-a025-4f4d-90ec-fe3faaec37f0 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:10.831985 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1335f3-142e-4cb6-a79d-68aeff1fc121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:10.833422 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1335f3-142e-4cb6-a79d-68aeff1fc121 None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:10.834016 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1335f3-142e-4cb6-a79d-68aeff1fc121 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:10.834521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1335f3-142e-4cb6-a79d-68aeff1fc121 None admin] PATH_INFO: `/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/76040882d4374087bb7458fd8b5c1d8d/roles/d09c313a1a354ea68cf1013629a4a584` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:10.836377 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e100f5c-173c-443f-aa43-81267801dfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:10.837061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e100f5c-173c-443f-aa43-81267801dfcd None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:10.837343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e100f5c-173c-443f-aa43-81267801dfcd None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:10.837617 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e100f5c-173c-443f-aa43-81267801dfcd None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:10.838703 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e100f5c-173c-443f-aa43-81267801dfcd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:10.839015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e100f5c-173c-443f-aa43-81267801dfcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:10.841618 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e100f5c-173c-443f-aa43-81267801dfcd None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:10.857606 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1335f3-142e-4cb6-a79d-68aeff1fc121 None admin] RBAC: Authorizing `identity:create_grant(project_id=385eeb55a9ae42eba674de1e83d96e0d, user_id=76040882d4374087bb7458fd8b5c1d8d, role_id=d09c313a1a354ea68cf1013629a4a584)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:10.859984 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1335f3-142e-4cb6-a79d-68aeff1fc121 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:10.862928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 321/627] 10.222.0.25 () {56 vars in 1137 bytes} [Tue May 10 21:02:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:10.864906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f75a2c-7a8c-443a-8895-67a1eb2fc3e2 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:10.865181 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f75a2c-7a8c-443a-8895-67a1eb2fc3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:10.865463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f75a2c-7a8c-443a-8895-67a1eb2fc3e2 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:10.872096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 322/628] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:10.872096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f75a2c-7a8c-443a-8895-67a1eb2fc3e2 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:10.924070 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 307/629] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:02:10 2022] PUT /identity/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/76040882d4374087bb7458fd8b5c1d8d/roles/d09c313a1a354ea68cf1013629a4a584 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:02:10.925582 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98770659-8d41-49a0-9571-41c0c1f5200e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:10.925949 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98770659-8d41-49a0-9571-41c0c1f5200e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:10.926304 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98770659-8d41-49a0-9571-41c0c1f5200e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:10.957008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-98770659-8d41-49a0-9571-41c0c1f5200e None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:10.957972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-98770659-8d41-49a0-9571-41c0c1f5200e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:10.984188 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f75a2c-7a8c-443a-8895-67a1eb2fc3e2 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:11.022985 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642a716-02fa-469f-aa21-5e1bc3266219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:11.025002 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642a716-02fa-469f-aa21-5e1bc3266219 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:11.025362 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642a716-02fa-469f-aa21-5e1bc3266219 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:11.025710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642a716-02fa-469f-aa21-5e1bc3266219 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:11.048070 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 308/630] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:02:11.049942 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef86ee-b016-4b30-9a18-59ee9fd4b077 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:11.050457 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef86ee-b016-4b30-9a18-59ee9fd4b077 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:11.050911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef86ee-b016-4b30-9a18-59ee9fd4b077 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:11.052766 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 309/631] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:11.064333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f0828-600d-45b6-94b5-19ce11b95997 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:11.064954 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f0828-600d-45b6-94b5-19ce11b95997 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:11.065474 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f0828-600d-45b6-94b5-19ce11b95997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:11.089840 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7c8f0828-600d-45b6-94b5-19ce11b95997 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:11.091367 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7c8f0828-600d-45b6-94b5-19ce11b95997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:11.136403 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642a716-02fa-469f-aa21-5e1bc3266219 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:11.137928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642a716-02fa-469f-aa21-5e1bc3266219 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:11.173195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 310/632] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:02:11.175098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f0828-600d-45b6-94b5-19ce11b95997 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:11.260975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 323/633] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:02:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:02:11.266713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642a716-02fa-469f-aa21-5e1bc3266219 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:11.299294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f0828-600d-45b6-94b5-19ce11b95997 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:11.334893 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143b9eb-987c-4388-8cb6-ba5fba6c1e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:11.336049 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143b9eb-987c-4388-8cb6-ba5fba6c1e97 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:11.337294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143b9eb-987c-4388-8cb6-ba5fba6c1e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:11.337294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143b9eb-987c-4388-8cb6-ba5fba6c1e97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:11.347830 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143b9eb-987c-4388-8cb6-ba5fba6c1e97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:11.356968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-a143b9eb-987c-4388-8cb6-ba5fba6c1e97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:11.356968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:11.356968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:11.356968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:11.356968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:11.356968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:11.356968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:11.356968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:11.356968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:11.356968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:11.356968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:11.356968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:11.356968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:11.356968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:11.356968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:11.356968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:11.357989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:11.357989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:11.357989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:11.357989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:11.357989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:11.357989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:11.357989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:11.357989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:11.357989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:11.357989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:11.357989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:11.357989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:11.357989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:11.357989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:11.357989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:11.357989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:11.358884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:11.358884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:11.358884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:11.358884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:11.358884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:11.358884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:11.358884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:11.358884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:11.358884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:11.358884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:11.358884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:11.358884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:11.363414 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 311/634] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:02:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:11.364506 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143b9eb-987c-4388-8cb6-ba5fba6c1e97 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:11.373349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642a716-02fa-469f-aa21-5e1bc3266219 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:11.411513 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7df636-8d69-452c-acd3-88dfe57dc5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:11.412644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7df636-8d69-452c-acd3-88dfe57dc5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:11.413111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7df636-8d69-452c-acd3-88dfe57dc5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:11.413555 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7df636-8d69-452c-acd3-88dfe57dc5f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:11.425004 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7df636-8d69-452c-acd3-88dfe57dc5f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:11.433563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-5c7df636-8d69-452c-acd3-88dfe57dc5f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:11.433563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:11.433563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:11.433563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:11.433563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:11.433563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:11.433563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:11.433563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:11.433563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:11.433563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:11.433563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:11.433563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:11.433563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:11.433563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:11.433563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:11.433563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:11.434532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:11.434532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:11.434532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:11.434532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:11.434532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:11.434532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:11.434532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:11.434532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:11.434532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:11.434532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:11.434532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:11.434532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:11.434532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:11.434532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:11.434532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:11.434532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:11.435376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:11.435376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:11.435376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:11.435376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:11.435376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:11.435376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:11.435376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:11.435376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:11.435376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:11.435376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:11.435376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:11.435376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:11.438129 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 324/635] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:02:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:11.439253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7df636-8d69-452c-acd3-88dfe57dc5f7 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:11.479584 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143b9eb-987c-4388-8cb6-ba5fba6c1e97 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:11.514679 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda677d6-8018-4fd9-b175-00556c6fda12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:11.515628 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda677d6-8018-4fd9-b175-00556c6fda12 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:11.515985 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda677d6-8018-4fd9-b175-00556c6fda12 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:11.516335 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda677d6-8018-4fd9-b175-00556c6fda12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:11.528646 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda677d6-8018-4fd9-b175-00556c6fda12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:11.530348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda677d6-8018-4fd9-b175-00556c6fda12 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:11.550067 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7df636-8d69-452c-acd3-88dfe57dc5f7 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:11.553339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-bda677d6-8018-4fd9-b175-00556c6fda12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:11.553339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:11.553339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:11.553339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:11.553339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:11.553339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:11.553339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:11.553339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:11.553339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:11.553339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:11.553339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:11.553339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:11.553339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:11.553339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:11.553339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:11.554262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:11.554262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:11.554262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:11.554262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:11.554262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:11.554262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:11.554262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:11.554262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:11.554262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:11.554262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:11.554262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:11.554262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:11.554262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:11.554262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:11.554262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:11.554262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:11.554262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:11.555731 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:11.555731 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:11.555731 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:11.555731 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:11.558971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 312/636] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:11.559896 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda677d6-8018-4fd9-b175-00556c6fda12 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:11.590482 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e654279-512f-4812-8e37-087bf6b8f780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:11.591158 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e654279-512f-4812-8e37-087bf6b8f780 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:11.591445 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e654279-512f-4812-8e37-087bf6b8f780 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:11.591721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e654279-512f-4812-8e37-087bf6b8f780 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:11.592463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e654279-512f-4812-8e37-087bf6b8f780 None admin] RBAC: Adding query filter params (name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:11.592767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e654279-512f-4812-8e37-087bf6b8f780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:11.594132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e654279-512f-4812-8e37-087bf6b8f780 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:11.607273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 325/637] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:02:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:11.607273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52481acb-f146-4051-9fdc-b8373377a054 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:11.607273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52481acb-f146-4051-9fdc-b8373377a054 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:11.607273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52481acb-f146-4051-9fdc-b8373377a054 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:11.607273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 326/638] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:11.607273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52481acb-f146-4051-9fdc-b8373377a054 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:11.665866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda677d6-8018-4fd9-b175-00556c6fda12 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:11.699107 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3b62f-5b8f-4965-a3fc-2e00198e123b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:11.699784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3b62f-5b8f-4965-a3fc-2e00198e123b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:11.700069 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3b62f-5b8f-4965-a3fc-2e00198e123b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:11.700349 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3b62f-5b8f-4965-a3fc-2e00198e123b None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:11.701097 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3b62f-5b8f-4965-a3fc-2e00198e123b None admin] RBAC: Adding query filter params (name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:11.701405 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3b62f-5b8f-4965-a3fc-2e00198e123b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:11.702807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3b62f-5b8f-4965-a3fc-2e00198e123b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:11.705987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52481acb-f146-4051-9fdc-b8373377a054 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:11.711569 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 313/639] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:02:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:11.712269 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3b62f-5b8f-4965-a3fc-2e00198e123b None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:11.740422 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba62b7-10ba-4538-b23a-960de079cda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:11.741082 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba62b7-10ba-4538-b23a-960de079cda3 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:11.741366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba62b7-10ba-4538-b23a-960de079cda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:11.741634 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba62b7-10ba-4538-b23a-960de079cda3 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:11.742490 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba62b7-10ba-4538-b23a-960de079cda3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:11.742809 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba62b7-10ba-4538-b23a-960de079cda3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:11.744288 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba62b7-10ba-4538-b23a-960de079cda3 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:11.760300 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 327/640] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:11.760300 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3a3ad-0ce3-4eee-ab2d-ac43f2618c21 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:11.760300 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3a3ad-0ce3-4eee-ab2d-ac43f2618c21 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:11.760300 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3a3ad-0ce3-4eee-ab2d-ac43f2618c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:11.775349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-6be3a3ad-0ce3-4eee-ab2d-ac43f2618c21 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:11.776540 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-6be3a3ad-0ce3-4eee-ab2d-ac43f2618c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:11.817563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3b62f-5b8f-4965-a3fc-2e00198e123b None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:11.854513 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 328/641] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:02:11.854513 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3a3ad-0ce3-4eee-ab2d-ac43f2618c21 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:11.870531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd0adf-9e98-4d94-87f9-6fd2e849c380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:11.870531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd0adf-9e98-4d94-87f9-6fd2e849c380 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:11.870531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd0adf-9e98-4d94-87f9-6fd2e849c380 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:11.870531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd0adf-9e98-4d94-87f9-6fd2e849c380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:11.881731 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd0adf-9e98-4d94-87f9-6fd2e849c380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:11.884007 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd0adf-9e98-4d94-87f9-6fd2e849c380 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:11.900559 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-e0dd0adf-9e98-4d94-87f9-6fd2e849c380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:11.900559 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:11.900559 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:11.900559 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:11.900559 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:11.900559 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:11.900559 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:11.900559 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:11.900559 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:11.900559 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:11.900559 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:11.900559 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:11.900559 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:11.900559 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:11.900559 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:11.901461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:11.901461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:11.901461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:11.901461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:11.901461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:11.901461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:11.901461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:11.901461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:11.901461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:11.901461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:11.901461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:11.901461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:11.901461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:11.901461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:11.901461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:11.901461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:11.901461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:11.902387 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:11.902387 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:11.902387 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:11.902387 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:11.906234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 314/642] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:11.907113 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd0adf-9e98-4d94-87f9-6fd2e849c380 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:11.948221 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3a3ad-0ce3-4eee-ab2d-ac43f2618c21 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:11.982303 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863eae22-521f-4f06-b14d-8e9e2096884c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:11.983241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863eae22-521f-4f06-b14d-8e9e2096884c None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:11.983522 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863eae22-521f-4f06-b14d-8e9e2096884c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:11.983797 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863eae22-521f-4f06-b14d-8e9e2096884c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:11.994387 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863eae22-521f-4f06-b14d-8e9e2096884c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:11.995863 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863eae22-521f-4f06-b14d-8e9e2096884c None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:12.002079 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd0adf-9e98-4d94-87f9-6fd2e849c380 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:12.013405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-863eae22-521f-4f06-b14d-8e9e2096884c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:12.013405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:12.013405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:12.013405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:12.013405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:12.013405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:12.013405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:12.013405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:12.013405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:12.013405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:12.013405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:12.013405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:12.013405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:12.013405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:12.013405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:12.018614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:12.018614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:12.018614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:12.018614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:12.018614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:12.018614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:12.018614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:12.018614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:12.018614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:12.018614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:12.018614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:12.018614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:12.018614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:12.018614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:12.018614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:12.018614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:12.018614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:12.019647 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:12.019647 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:12.019647 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:12.019647 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:12.019647 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 329/643] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:12.019647 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863eae22-521f-4f06-b14d-8e9e2096884c None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:12.042285 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6dc56-518c-4942-9581-36fa30cfa918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:12.043121 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6dc56-518c-4942-9581-36fa30cfa918 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:12.043411 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6dc56-518c-4942-9581-36fa30cfa918 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:12.043698 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6dc56-518c-4942-9581-36fa30cfa918 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:12.050476 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a6dc56-518c-4942-9581-36fa30cfa918 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:12.051914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a6dc56-518c-4942-9581-36fa30cfa918 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:12.066874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-76a6dc56-518c-4942-9581-36fa30cfa918 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:12.066874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:12.066874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:12.066874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:12.066874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:12.066874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:12.066874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:12.066874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:12.066874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:12.066874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:12.066874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:12.066874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:12.066874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:12.066874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:12.066874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:12.067852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:12.067852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:12.067852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:12.067852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:12.067852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:12.067852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:12.067852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:12.067852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:12.067852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:12.067852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:12.067852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:12.067852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:12.067852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:12.067852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:12.067852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:12.067852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:12.067852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:12.068825 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:12.068825 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:12.068825 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:12.068825 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:12.068825 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:12.068825 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:12.068825 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:12.068825 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:12.068825 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 315/644] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:12.068825 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6dc56-518c-4942-9581-36fa30cfa918 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:12.120104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863eae22-521f-4f06-b14d-8e9e2096884c None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:12.156781 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061995e5-cce5-4df7-b9a8-dd577c8ad70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:12.157862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061995e5-cce5-4df7-b9a8-dd577c8ad70a None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:12.158364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061995e5-cce5-4df7-b9a8-dd577c8ad70a None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:12.158744 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061995e5-cce5-4df7-b9a8-dd577c8ad70a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:12.168540 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6dc56-518c-4942-9581-36fa30cfa918 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:12.169890 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061995e5-cce5-4df7-b9a8-dd577c8ad70a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:12.177713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-061995e5-cce5-4df7-b9a8-dd577c8ad70a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:12.177713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:12.177713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:12.177713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:12.177713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:12.177713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:12.177713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:12.177713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:12.177713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:12.177713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:12.177713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:12.177713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:12.177713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:12.177713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:12.177713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:12.177713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:12.178987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:12.178987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:12.178987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:12.178987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:12.178987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:12.178987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:12.178987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:12.178987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:12.178987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:12.178987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:12.178987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:12.178987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:12.178987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:12.178987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:12.178987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:12.178987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:12.180423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:12.180423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:12.180423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:12.180423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:12.180423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:12.180423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:12.180423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:12.180423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:12.180423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:12.180423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:12.180423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:12.180423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:12.180423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 330/645] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:02:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:12.181123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061995e5-cce5-4df7-b9a8-dd577c8ad70a None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:12.207897 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37fc9a-ab72-4f6c-9f5e-003786f7fbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:12.208567 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37fc9a-ab72-4f6c-9f5e-003786f7fbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:12.208857 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37fc9a-ab72-4f6c-9f5e-003786f7fbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:12.209141 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37fc9a-ab72-4f6c-9f5e-003786f7fbe2 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:12.209872 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37fc9a-ab72-4f6c-9f5e-003786f7fbe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:12.210180 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37fc9a-ab72-4f6c-9f5e-003786f7fbe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:12.211796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37fc9a-ab72-4f6c-9f5e-003786f7fbe2 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:12.228366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 316/646] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:12.228366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37fc9a-ab72-4f6c-9f5e-003786f7fbe2 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:12.290496 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061995e5-cce5-4df7-b9a8-dd577c8ad70a None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:12.324093 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751b6fc-d2ec-4232-91e7-dfd9caffd6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:12.324760 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751b6fc-d2ec-4232-91e7-dfd9caffd6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:12.325045 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751b6fc-d2ec-4232-91e7-dfd9caffd6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:12.325322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751b6fc-d2ec-4232-91e7-dfd9caffd6d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:12.325420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37fc9a-ab72-4f6c-9f5e-003786f7fbe2 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:12.326050 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751b6fc-d2ec-4232-91e7-dfd9caffd6d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:12.326358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751b6fc-d2ec-4232-91e7-dfd9caffd6d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:12.327762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751b6fc-d2ec-4232-91e7-dfd9caffd6d8 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:12.339196 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 331/647] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:12.340008 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751b6fc-d2ec-4232-91e7-dfd9caffd6d8 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:12.365830 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37610b-8630-47fd-a43b-deefa164928c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:12.366521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37610b-8630-47fd-a43b-deefa164928c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:12.367386 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37610b-8630-47fd-a43b-deefa164928c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:12.367864 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37610b-8630-47fd-a43b-deefa164928c None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:12.368646 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37610b-8630-47fd-a43b-deefa164928c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:12.368956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37610b-8630-47fd-a43b-deefa164928c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:12.370384 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37610b-8630-47fd-a43b-deefa164928c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:12.382020 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 317/648] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:12.382896 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37610b-8630-47fd-a43b-deefa164928c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:12.460146 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751b6fc-d2ec-4232-91e7-dfd9caffd6d8 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:12.482464 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37610b-8630-47fd-a43b-deefa164928c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:12.495178 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455dfea-381b-419c-b7cb-08a86f7a9f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:12.495849 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455dfea-381b-419c-b7cb-08a86f7a9f08 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:12.496132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455dfea-381b-419c-b7cb-08a86f7a9f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:12.496475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455dfea-381b-419c-b7cb-08a86f7a9f08 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:12.497227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455dfea-381b-419c-b7cb-08a86f7a9f08 None admin] RBAC: Adding query filter params (name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:12.497530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455dfea-381b-419c-b7cb-08a86f7a9f08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:12.498938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455dfea-381b-419c-b7cb-08a86f7a9f08 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:12.506682 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 332/649] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:02:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:12.507505 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455dfea-381b-419c-b7cb-08a86f7a9f08 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:12.518102 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c9562-9e0a-40e1-88be-362d0ee3f298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:12.519227 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c9562-9e0a-40e1-88be-362d0ee3f298 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:12.519662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c9562-9e0a-40e1-88be-362d0ee3f298 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:12.520088 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c9562-9e0a-40e1-88be-362d0ee3f298 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:12.528053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c9562-9e0a-40e1-88be-362d0ee3f298 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:12.529651 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c9562-9e0a-40e1-88be-362d0ee3f298 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:12.545409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-dd7c9562-9e0a-40e1-88be-362d0ee3f298 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 21:02:12.545409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:12.545409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:12.545409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:12.545409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:12.545409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:12.545409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:12.545409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:12.545409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:12.545409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:12.545409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:12.545409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:12.545409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:12.545409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:12.545409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:12.545409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:12.546880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:12.546880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:12.546880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:12.546880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:12.546880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:12.546880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:12.546880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:12.546880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:12.546880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:12.546880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:12.546880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:12.546880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:12.546880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:12.546880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:12.546880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:12.546880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:12.546880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:12.546880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:12.547943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:12.547943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:12.547943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:12.547943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:12.547943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:12.547943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:12.547943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:12.547943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:12.547943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 21:02:12.547943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:12.547943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 318/650] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:02:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:12.548560 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c9562-9e0a-40e1-88be-362d0ee3f298 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:12.611153 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455dfea-381b-419c-b7cb-08a86f7a9f08 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:12.644801 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f69ee-dc6e-4f89-b1a1-2316a9e5e568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:12.645015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c9562-9e0a-40e1-88be-362d0ee3f298 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:12.645813 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f69ee-dc6e-4f89-b1a1-2316a9e5e568 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:12.646194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f69ee-dc6e-4f89-b1a1-2316a9e5e568 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:12.646624 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f69ee-dc6e-4f89-b1a1-2316a9e5e568 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:12.655424 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f69ee-dc6e-4f89-b1a1-2316a9e5e568 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:12.656963 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f69ee-dc6e-4f89-b1a1-2316a9e5e568 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:12.671393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-af1f69ee-dc6e-4f89-b1a1-2316a9e5e568 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 21:02:12.671393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:12.671393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:12.671393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:12.671393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:12.671393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:12.671393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:12.671393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:12.671393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:12.671393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:12.671393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:12.671393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:12.671393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:12.671393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:12.671393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:12.671393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:12.672577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:12.672577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:12.672577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:12.672577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:12.672577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:12.672577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:12.672577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:12.672577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:12.672577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:12.672577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:12.672577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:12.672577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:12.672577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:12.672577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:12.672577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:12.672577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:12.672577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:12.672577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:12.673670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:12.673670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:12.673670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:12.673670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:12.673670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:12.673670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:12.673670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:12.673670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:12.673670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 21:02:12.673670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:12.674234 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 333/651] 10.222.0.25 () {56 vars in 1093 bytes} [Tue May 10 21:02:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:12.674990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f69ee-dc6e-4f89-b1a1-2316a9e5e568 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:12.682651 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade4e8e-12fa-4077-a4d8-d8caf1620d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:12.683320 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade4e8e-12fa-4077-a4d8-d8caf1620d1f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:12.683609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade4e8e-12fa-4077-a4d8-d8caf1620d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:12.683885 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade4e8e-12fa-4077-a4d8-d8caf1620d1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:12.684722 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade4e8e-12fa-4077-a4d8-d8caf1620d1f None admin] RBAC: Adding query filter params (role.id=d09c313a1a354ea68cf1013629a4a584, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=aa2b6514779d42fa81d34351607dea27) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:12.685272 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade4e8e-12fa-4077-a4d8-d8caf1620d1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:12.686476 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade4e8e-12fa-4077-a4d8-d8caf1620d1f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:12.692502 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 319/652] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:02:12 2022] GET /identity/v3/role_assignments?user.id=aa2b6514779d42fa81d34351607dea27&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=d09c313a1a354ea68cf1013629a4a584 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:12.693279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade4e8e-12fa-4077-a4d8-d8caf1620d1f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:12.786795 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f69ee-dc6e-4f89-b1a1-2316a9e5e568 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:12.803577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade4e8e-12fa-4077-a4d8-d8caf1620d1f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:12.826963 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79276b-c5dd-4a79-a1df-18c90a28d07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:12.828179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79276b-c5dd-4a79-a1df-18c90a28d07d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:12.828667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79276b-c5dd-4a79-a1df-18c90a28d07d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:12.829162 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79276b-c5dd-4a79-a1df-18c90a28d07d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:12.842028 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79276b-c5dd-4a79-a1df-18c90a28d07d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:12.844101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79276b-c5dd-4a79-a1df-18c90a28d07d None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:12.844473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdd5ad-3409-4548-9b8d-9fca94237dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:12.845404 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdd5ad-3409-4548-9b8d-9fca94237dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:12.845738 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdd5ad-3409-4548-9b8d-9fca94237dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:12.846023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdd5ad-3409-4548-9b8d-9fca94237dc9 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:12.846914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bdd5ad-3409-4548-9b8d-9fca94237dc9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:12.847397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bdd5ad-3409-4548-9b8d-9fca94237dc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:12.848678 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bdd5ad-3409-4548-9b8d-9fca94237dc9 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:12.866475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-3e79276b-c5dd-4a79-a1df-18c90a28d07d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:12.866475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:12.866475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:12.866475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:12.866475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:12.866475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:12.866475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:12.866475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:12.866475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:12.866475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:12.866475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:12.866475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:12.866475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:12.866475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:12.866475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:12.867474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:12.867474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:12.867474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:12.867474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:12.867474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:12.867474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:12.867474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:12.867474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:12.867474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:12.867474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:12.867474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:12.867474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:12.867474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:12.867474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:12.867474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:12.867474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:12.867474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:12.868360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:12.868360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:12.868360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:12.868360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:12.873756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 320/653] 10.222.0.25 () {56 vars in 1137 bytes} [Tue May 10 21:02:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:12.873756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdd5ad-3409-4548-9b8d-9fca94237dc9 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:12.875932 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 334/654] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:12.877126 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79276b-c5dd-4a79-a1df-18c90a28d07d None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:12.986663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79276b-c5dd-4a79-a1df-18c90a28d07d None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:13.000797 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdd5ad-3409-4548-9b8d-9fca94237dc9 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:13.022155 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111f709-d9d4-413c-be2e-d1d500f13ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:13.022834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111f709-d9d4-413c-be2e-d1d500f13ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:13.023683 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111f709-d9d4-413c-be2e-d1d500f13ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:13.023958 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111f709-d9d4-413c-be2e-d1d500f13ad1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:13.039479 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262ea85-ca01-40e7-a9f4-fea989f13c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:13.040719 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262ea85-ca01-40e7-a9f4-fea989f13c34 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:13.041149 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262ea85-ca01-40e7-a9f4-fea989f13c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:13.041575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262ea85-ca01-40e7-a9f4-fea989f13c34 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:13.042584 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262ea85-ca01-40e7-a9f4-fea989f13c34 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:13.043053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262ea85-ca01-40e7-a9f4-fea989f13c34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:13.044666 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262ea85-ca01-40e7-a9f4-fea989f13c34 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:13.062285 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 321/655] 10.222.0.25 () {56 vars in 1133 bytes} [Tue May 10 21:02:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:13.063444 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262ea85-ca01-40e7-a9f4-fea989f13c34 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:13.095553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111f709-d9d4-413c-be2e-d1d500f13ad1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:13.097071 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111f709-d9d4-413c-be2e-d1d500f13ad1 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:13.173173 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262ea85-ca01-40e7-a9f4-fea989f13c34 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:13.202084 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 335/656] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:02:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:02:13.203092 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111f709-d9d4-413c-be2e-d1d500f13ad1 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:13.210043 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf28aa-5772-4b11-bcb8-9996d4be7bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:13.211841 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf28aa-5772-4b11-bcb8-9996d4be7bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:13.212362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf28aa-5772-4b11-bcb8-9996d4be7bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:13.212862 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf28aa-5772-4b11-bcb8-9996d4be7bd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:13.213793 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf28aa-5772-4b11-bcb8-9996d4be7bd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:13.214297 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf28aa-5772-4b11-bcb8-9996d4be7bd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:13.215879 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf28aa-5772-4b11-bcb8-9996d4be7bd5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:13.228057 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 322/657] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:13.229149 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf28aa-5772-4b11-bcb8-9996d4be7bd5 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:13.303793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111f709-d9d4-413c-be2e-d1d500f13ad1 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:13.327595 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf28aa-5772-4b11-bcb8-9996d4be7bd5 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:13.338908 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491d0cd-c8e6-4dce-a1b2-5673cd36893e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:13.339561 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491d0cd-c8e6-4dce-a1b2-5673cd36893e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:13.339848 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491d0cd-c8e6-4dce-a1b2-5673cd36893e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:13.340127 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491d0cd-c8e6-4dce-a1b2-5673cd36893e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:13.361854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da687b7-0e93-4afa-a67d-d305dbb91a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:13.362682 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da687b7-0e93-4afa-a67d-d305dbb91a74 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:13.362970 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da687b7-0e93-4afa-a67d-d305dbb91a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:13.363250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da687b7-0e93-4afa-a67d-d305dbb91a74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:13.375149 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da687b7-0e93-4afa-a67d-d305dbb91a74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:13.376579 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da687b7-0e93-4afa-a67d-d305dbb91a74 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:13.394137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-2da687b7-0e93-4afa-a67d-d305dbb91a74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:13.394137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:13.394137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:13.394137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:13.394137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:13.394137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:13.394137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:13.394137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:13.394137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:13.394137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:13.394137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:13.394137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:13.394137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:13.394137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:13.394137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:13.395181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:13.395181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:13.395181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:13.395181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:13.395181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:13.395181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:13.395181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:13.395181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:13.395181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:13.395181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:13.395181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:13.395181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:13.395181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:13.395181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:13.395181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:13.395181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:13.395181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:13.396164 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:13.396164 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:13.396164 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:13.396164 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:13.396164 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 323/658] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:13.396442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da687b7-0e93-4afa-a67d-d305dbb91a74 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:13.411190 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491d0cd-c8e6-4dce-a1b2-5673cd36893e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:13.412642 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491d0cd-c8e6-4dce-a1b2-5673cd36893e None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:13.493955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da687b7-0e93-4afa-a67d-d305dbb91a74 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:13.517030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 336/659] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:02:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:02:13.518418 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa396e8-f9e8-4055-8cca-f574c79cd25f None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:13.518747 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa396e8-f9e8-4055-8cca-f574c79cd25f None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:13.519042 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa396e8-f9e8-4055-8cca-f574c79cd25f None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:13.524766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 337/660] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:13.524766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa396e8-f9e8-4055-8cca-f574c79cd25f None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:13.531780 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0390d-882f-429e-9d51-2e86862a6443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:13.532587 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0390d-882f-429e-9d51-2e86862a6443 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:13.532873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0390d-882f-429e-9d51-2e86862a6443 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:13.533163 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0390d-882f-429e-9d51-2e86862a6443 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:13.541324 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0390d-882f-429e-9d51-2e86862a6443 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:13.542774 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0390d-882f-429e-9d51-2e86862a6443 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:13.557204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-c9e0390d-882f-429e-9d51-2e86862a6443 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 21:02:13.557204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:13.557204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:13.557204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:13.557204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:13.557204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:13.557204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:13.557204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:13.557204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:13.557204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:13.557204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:13.557204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:13.557204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:13.557204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:13.557204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:13.557204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:13.558157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:13.558157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:13.558157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:13.558157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:13.558157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:13.558157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:13.558157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:13.558157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:13.558157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:13.558157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:13.558157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:13.558157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:13.558157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:13.558157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:13.558157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:13.558157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:13.558157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:13.558157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:13.559158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:13.559158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:13.559158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:13.559158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:13.559158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:13.559158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:13.559158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:13.559158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:13.559158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 21:02:13.559158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:13.562822 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 324/661] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:02:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:13.563526 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0390d-882f-429e-9d51-2e86862a6443 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:13.621821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa396e8-f9e8-4055-8cca-f574c79cd25f None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:13.655970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71bb2b5-e150-49d3-aa59-294f31674a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:13.656858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bb2b5-e150-49d3-aa59-294f31674a1b None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:13.657242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bb2b5-e150-49d3-aa59-294f31674a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:13.657620 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bb2b5-e150-49d3-aa59-294f31674a1b None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:13.658473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71bb2b5-e150-49d3-aa59-294f31674a1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:13.658885 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71bb2b5-e150-49d3-aa59-294f31674a1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:13.660349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71bb2b5-e150-49d3-aa59-294f31674a1b None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:13.661992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0390d-882f-429e-9d51-2e86862a6443 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:13.672419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 338/662] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:13.673860 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d885d8-6f17-4e67-a672-e25deba5c226 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:13.674282 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d885d8-6f17-4e67-a672-e25deba5c226 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:13.674732 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d885d8-6f17-4e67-a672-e25deba5c226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:13.691114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-93d885d8-6f17-4e67-a672-e25deba5c226 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:13.692315 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-93d885d8-6f17-4e67-a672-e25deba5c226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:13.695965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade41063-3c52-48f5-b400-0689d36de6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:13.696929 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade41063-3c52-48f5-b400-0689d36de6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:13.697355 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade41063-3c52-48f5-b400-0689d36de6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:13.697792 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade41063-3c52-48f5-b400-0689d36de6c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:13.709206 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade41063-3c52-48f5-b400-0689d36de6c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:13.711232 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade41063-3c52-48f5-b400-0689d36de6c7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:13.727622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-ade41063-3c52-48f5-b400-0689d36de6c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:13.727622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:13.727622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:13.727622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:13.727622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:13.727622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:13.727622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:13.727622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:13.727622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:13.727622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:13.727622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:13.727622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:13.727622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:13.727622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:13.727622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:13.728538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:13.728538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:13.728538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:13.728538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:13.728538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:13.728538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:13.728538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:13.728538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:13.728538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:13.728538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:13.728538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:13.728538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:13.728538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:13.728538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:13.728538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:13.728538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:13.728538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:13.729441 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:13.729441 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:13.729441 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:13.729441 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:13.733369 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 325/663] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:13.734056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade41063-3c52-48f5-b400-0689d36de6c7 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:13.767554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 339/664] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:02:13.767554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d885d8-6f17-4e67-a672-e25deba5c226 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:13.839254 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade41063-3c52-48f5-b400-0689d36de6c7 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:13.855054 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d885d8-6f17-4e67-a672-e25deba5c226 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:13.875583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3a23c-2de1-4fb4-b68e-bb522346fed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:13.876257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3a23c-2de1-4fb4-b68e-bb522346fed7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:13.876542 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3a23c-2de1-4fb4-b68e-bb522346fed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:13.876817 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3a23c-2de1-4fb4-b68e-bb522346fed7 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:13.877653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a3a23c-2de1-4fb4-b68e-bb522346fed7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:13.877960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a3a23c-2de1-4fb4-b68e-bb522346fed7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:13.879405 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a3a23c-2de1-4fb4-b68e-bb522346fed7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:13.889228 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d5738-3f54-4377-b256-969356c7abc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:13.890018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d5738-3f54-4377-b256-969356c7abc0 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:13.890303 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d5738-3f54-4377-b256-969356c7abc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:13.890614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d5738-3f54-4377-b256-969356c7abc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:13.901575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 326/665] 10.222.0.25 () {56 vars in 1139 bytes} [Tue May 10 21:02:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:13.901752 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d5738-3f54-4377-b256-969356c7abc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:13.901835 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3a23c-2de1-4fb4-b68e-bb522346fed7 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:13.901908 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d5738-3f54-4377-b256-969356c7abc0 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:13.915876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-c68d5738-3f54-4377-b256-969356c7abc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:13.915876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:13.915876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:13.915876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:13.915876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:13.915876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:13.915876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:13.915876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:13.915876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:13.915876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:13.915876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:13.915876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:13.915876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:13.915876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:13.915876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:13.916773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:13.916773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:13.916773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:13.916773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:13.916773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:13.916773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:13.916773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:13.916773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:13.916773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:13.916773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:13.916773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:13.916773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:13.916773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:13.916773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:13.916773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:13.916773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:13.916773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:13.917645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:13.917645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:13.917645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:13.917645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:13.917645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:13.917645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:13.917645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:13.917645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:13.919531 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 340/666] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:13.920502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d5738-3f54-4377-b256-969356c7abc0 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:14.005245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3a23c-2de1-4fb4-b68e-bb522346fed7 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:14.020284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d5738-3f54-4377-b256-969356c7abc0 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:14.041630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b22e42-0436-4050-831f-a3d156cf390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:14.042306 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b22e42-0436-4050-831f-a3d156cf390f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:14.042625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b22e42-0436-4050-831f-a3d156cf390f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:14.042904 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b22e42-0436-4050-831f-a3d156cf390f None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:14.043641 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b22e42-0436-4050-831f-a3d156cf390f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:14.043950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b22e42-0436-4050-831f-a3d156cf390f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:14.045300 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b22e42-0436-4050-831f-a3d156cf390f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:14.055176 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17981220-75e7-448b-8155-674c557dac1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:14.056140 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981220-75e7-448b-8155-674c557dac1f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:14.056423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981220-75e7-448b-8155-674c557dac1f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:14.056695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981220-75e7-448b-8155-674c557dac1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:14.062054 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 327/667] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:14.062054 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b22e42-0436-4050-831f-a3d156cf390f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:14.067646 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17981220-75e7-448b-8155-674c557dac1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:14.075975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-17981220-75e7-448b-8155-674c557dac1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:14.075975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:14.075975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:14.075975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:14.075975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:14.075975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:14.075975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:14.075975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:14.075975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:14.075975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:14.075975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:14.075975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:14.075975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:14.075975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:14.075975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:14.075975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:14.077106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:14.077106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:14.077106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:14.077106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:14.077106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:14.077106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:14.077106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:14.077106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:14.077106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:14.077106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:14.077106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:14.077106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:14.077106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:14.077106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:14.077106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:14.077106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:14.078249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:14.078249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:14.078249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:14.078249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:14.078249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:14.078249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:14.078249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:14.078249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:14.078249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:14.078249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:14.078249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:14.078249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:14.082158 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 341/668] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:02:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:14.082809 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17981220-75e7-448b-8155-674c557dac1f None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:14.166250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b22e42-0436-4050-831f-a3d156cf390f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:14.183257 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17981220-75e7-448b-8155-674c557dac1f None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:14.204568 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72349b-e252-441a-9874-7a097dbaf2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:14.205216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72349b-e252-441a-9874-7a097dbaf2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:14.205500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72349b-e252-441a-9874-7a097dbaf2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:14.205778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72349b-e252-441a-9874-7a097dbaf2f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:14.218737 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a2e06-077d-4280-8e54-0d613a3c1179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:14.219395 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a2e06-077d-4280-8e54-0d613a3c1179 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:14.219684 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a2e06-077d-4280-8e54-0d613a3c1179 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:14.219968 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a2e06-077d-4280-8e54-0d613a3c1179 None admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:14.220763 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a2e06-077d-4280-8e54-0d613a3c1179 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:14.221072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a2e06-077d-4280-8e54-0d613a3c1179 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:14.222517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a2e06-077d-4280-8e54-0d613a3c1179 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:14.234567 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 342/669] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:14.235351 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a2e06-077d-4280-8e54-0d613a3c1179 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:14.276531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72349b-e252-441a-9874-7a097dbaf2f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:14.277960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72349b-e252-441a-9874-7a097dbaf2f5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:14.332717 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a2e06-077d-4280-8e54-0d613a3c1179 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:14.369309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c498c03-b755-4fb7-be42-0fd44663e7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:14.373206 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c498c03-b755-4fb7-be42-0fd44663e7df None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:14.373206 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c498c03-b755-4fb7-be42-0fd44663e7df None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:14.373206 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c498c03-b755-4fb7-be42-0fd44663e7df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:14.377888 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c498c03-b755-4fb7-be42-0fd44663e7df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:14.379351 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c498c03-b755-4fb7-be42-0fd44663e7df None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:14.393140 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 328/670] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:02:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:02:14.393140 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72349b-e252-441a-9874-7a097dbaf2f5 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:14.393997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-9c498c03-b755-4fb7-be42-0fd44663e7df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:14.393997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:14.393997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:14.393997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:14.393997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:14.393997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:14.393997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:14.393997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:14.393997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:14.393997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:14.393997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:14.393997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:14.393997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:14.393997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:14.393997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:14.395163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:14.395163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:14.395163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:14.395163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:14.395163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:14.395163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:14.395163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:14.395163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:14.395163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:14.395163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:14.395163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:14.395163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:14.395163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:14.395163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:14.395163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:14.395163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:14.395163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:14.396504 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:14.396504 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:14.396504 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:14.396504 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:14.396504 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:14.396504 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:14.396504 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:14.396504 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:14.396504 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 343/671] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:14.396504 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c498c03-b755-4fb7-be42-0fd44663e7df None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:14.495384 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72349b-e252-441a-9874-7a097dbaf2f5 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:14.503803 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c498c03-b755-4fb7-be42-0fd44663e7df None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:14.529420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cce14d-c6b8-4378-9314-03aa252e0dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:14.530091 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cce14d-c6b8-4378-9314-03aa252e0dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:14.530378 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cce14d-c6b8-4378-9314-03aa252e0dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:14.530683 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cce14d-c6b8-4378-9314-03aa252e0dc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:14.531437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cce14d-c6b8-4378-9314-03aa252e0dc7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:14.531746 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cce14d-c6b8-4378-9314-03aa252e0dc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:14.533159 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cce14d-c6b8-4378-9314-03aa252e0dc7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:14.536387 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067cb46-668d-4341-a8f7-70735c499cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:14.537042 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067cb46-668d-4341-a8f7-70735c499cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:14.537328 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067cb46-668d-4341-a8f7-70735c499cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:14.537611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067cb46-668d-4341-a8f7-70735c499cc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:14.538991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067cb46-668d-4341-a8f7-70735c499cc4 None admin] RBAC: Adding query filter params (role.id=d09c313a1a354ea68cf1013629a4a584, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=c4dfa98f420c4c4c845262a78ae75ae8) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:14.539531 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067cb46-668d-4341-a8f7-70735c499cc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:14.541013 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067cb46-668d-4341-a8f7-70735c499cc4 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:14.558469 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 329/672] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:02:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:14.558469 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cce14d-c6b8-4378-9314-03aa252e0dc7 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:14.558770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 344/673] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:02:14 2022] GET /identity/v3/role_assignments?user.id=c4dfa98f420c4c4c845262a78ae75ae8&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=d09c313a1a354ea68cf1013629a4a584 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:14.558770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067cb46-668d-4341-a8f7-70735c499cc4 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:14.673570 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067cb46-668d-4341-a8f7-70735c499cc4 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:14.711821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fe06e-fb3b-4f97-a986-5075e9edffa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:14.712561 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fe06e-fb3b-4f97-a986-5075e9edffa1 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:14.712846 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fe06e-fb3b-4f97-a986-5075e9edffa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:14.713123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fe06e-fb3b-4f97-a986-5075e9edffa1 None admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:14.713982 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fe06e-fb3b-4f97-a986-5075e9edffa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:14.714297 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fe06e-fb3b-4f97-a986-5075e9edffa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:14.715845 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fe06e-fb3b-4f97-a986-5075e9edffa1 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:14.730514 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 345/674] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:14.731397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fe06e-fb3b-4f97-a986-5075e9edffa1 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:14.805737 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cce14d-c6b8-4378-9314-03aa252e0dc7 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:14.850740 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f74b6-4300-4ea4-88ed-63c2e6630bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:14.855008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f74b6-4300-4ea4-88ed-63c2e6630bfe None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:14.855289 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f74b6-4300-4ea4-88ed-63c2e6630bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:14.855560 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f74b6-4300-4ea4-88ed-63c2e6630bfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:14.865450 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fe06e-fb3b-4f97-a986-5075e9edffa1 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:14.865893 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f74b6-4300-4ea4-88ed-63c2e6630bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:14.867454 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f74b6-4300-4ea4-88ed-63c2e6630bfe None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:14.885074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-1d6f74b6-4300-4ea4-88ed-63c2e6630bfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:14.885074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:14.885074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:14.885074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:14.885074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:14.885074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:14.885074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:14.885074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:14.885074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:14.885074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:14.885074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:14.885074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:14.885074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:14.885074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:14.885074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:14.886078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:14.886078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:14.886078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:14.886078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:14.886078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:14.886078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:14.886078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:14.886078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:14.886078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:14.886078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:14.886078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:14.886078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:14.886078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:14.886078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:14.886078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:14.886078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:14.886078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:14.887032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:14.887032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:14.887032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:14.887032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:14.887032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 330/675] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:14.887846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f74b6-4300-4ea4-88ed-63c2e6630bfe None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:14.909366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca328709-12fe-4c66-8f08-fa4e3bbd9e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:14.910686 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca328709-12fe-4c66-8f08-fa4e3bbd9e21 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:14.911203 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca328709-12fe-4c66-8f08-fa4e3bbd9e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:14.911688 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca328709-12fe-4c66-8f08-fa4e3bbd9e21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:14.924533 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca328709-12fe-4c66-8f08-fa4e3bbd9e21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:14.926369 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca328709-12fe-4c66-8f08-fa4e3bbd9e21 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:14.946359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-ca328709-12fe-4c66-8f08-fa4e3bbd9e21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:14.946359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:14.946359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:14.946359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:14.946359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:14.946359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:14.946359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:14.946359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:14.946359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:14.946359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:14.946359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:14.946359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:14.946359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:14.946359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:14.946359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:14.947353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:14.947353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:14.947353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:14.947353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:14.947353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:14.947353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:14.947353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:14.947353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:14.947353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:14.947353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:14.947353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:14.947353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:14.947353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:14.947353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:14.947353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:14.947353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:14.947353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:14.948273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:14.948273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:14.948273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:14.948273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:14.950517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 346/676] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:14.951565 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca328709-12fe-4c66-8f08-fa4e3bbd9e21 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:14.990920 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f74b6-4300-4ea4-88ed-63c2e6630bfe None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:15.024616 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637b5f3-3f4f-4c14-b69e-2bc1d481edb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:15.025286 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637b5f3-3f4f-4c14-b69e-2bc1d481edb3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:15.025563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637b5f3-3f4f-4c14-b69e-2bc1d481edb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:15.025839 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637b5f3-3f4f-4c14-b69e-2bc1d481edb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:15.026698 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637b5f3-3f4f-4c14-b69e-2bc1d481edb3 None admin] RBAC: Adding query filter params (role.id=d09c313a1a354ea68cf1013629a4a584, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=c4c16a3b07c64a22bfc3df2a5a90c3f3) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:15.027006 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637b5f3-3f4f-4c14-b69e-2bc1d481edb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:15.028415 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637b5f3-3f4f-4c14-b69e-2bc1d481edb3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:15.034503 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 331/677] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:02:14 2022] GET /identity/v3/role_assignments?user.id=c4c16a3b07c64a22bfc3df2a5a90c3f3&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=d09c313a1a354ea68cf1013629a4a584 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:15.041581 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637b5f3-3f4f-4c14-b69e-2bc1d481edb3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:15.083050 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca328709-12fe-4c66-8f08-fa4e3bbd9e21 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:15.123458 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15805bde-c97e-410f-9217-c84094a9854b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:15.124597 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15805bde-c97e-410f-9217-c84094a9854b None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:15.125111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15805bde-c97e-410f-9217-c84094a9854b None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:15.125603 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15805bde-c97e-410f-9217-c84094a9854b None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:15.126621 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15805bde-c97e-410f-9217-c84094a9854b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:15.127181 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15805bde-c97e-410f-9217-c84094a9854b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:15.128879 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15805bde-c97e-410f-9217-c84094a9854b None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:15.143836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 347/678] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:15.144050 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637b5f3-3f4f-4c14-b69e-2bc1d481edb3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:15.146028 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bba43-b112-40c7-a68e-ef3dbbe06559 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:15.146606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bba43-b112-40c7-a68e-ef3dbbe06559 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:15.147144 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bba43-b112-40c7-a68e-ef3dbbe06559 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:15.149539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 348/679] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:15.150608 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bba43-b112-40c7-a68e-ef3dbbe06559 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:15.187182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e561d4-b310-4186-9847-9af621788320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:15.188808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e561d4-b310-4186-9847-9af621788320 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:15.189624 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e561d4-b310-4186-9847-9af621788320 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:15.190116 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e561d4-b310-4186-9847-9af621788320 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:15.191113 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e561d4-b310-4186-9847-9af621788320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:15.191689 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e561d4-b310-4186-9847-9af621788320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:15.193374 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e561d4-b310-4186-9847-9af621788320 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:15.209764 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 332/680] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:15.212354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfa55e-1ad4-49a5-b791-9ef3ffb6fbea None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:15.212876 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfa55e-1ad4-49a5-b791-9ef3ffb6fbea None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:15.213359 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfa55e-1ad4-49a5-b791-9ef3ffb6fbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:15.236543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-00dfa55e-1ad4-49a5-b791-9ef3ffb6fbea None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:15.238492 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-00dfa55e-1ad4-49a5-b791-9ef3ffb6fbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:15.279770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bba43-b112-40c7-a68e-ef3dbbe06559 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:15.320658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81bca8-3e42-41c6-9ef1-26c6f40bb354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:15.321462 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81bca8-3e42-41c6-9ef1-26c6f40bb354 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:15.321747 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81bca8-3e42-41c6-9ef1-26c6f40bb354 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:15.322023 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81bca8-3e42-41c6-9ef1-26c6f40bb354 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:15.324548 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 333/681] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:02:15.329325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81bca8-3e42-41c6-9ef1-26c6f40bb354 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:15.330843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81bca8-3e42-41c6-9ef1-26c6f40bb354 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:15.331679 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfa55e-1ad4-49a5-b791-9ef3ffb6fbea None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:15.344853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-be81bca8-3e42-41c6-9ef1-26c6f40bb354 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:15.344853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:15.344853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:15.344853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:15.344853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:15.344853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:15.344853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:15.344853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:15.344853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:15.344853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:15.344853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:15.344853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:15.344853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:15.344853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:15.344853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:15.346105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:15.346105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:15.346105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:15.346105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:15.346105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:15.346105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:15.346105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:15.346105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:15.346105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:15.346105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:15.346105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:15.346105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:15.346105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:15.346105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:15.346105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:15.346105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:15.346105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:15.347143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:15.347143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:15.347143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:15.347143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:15.347143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:15.347143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:15.347143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:15.347143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:15.347143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 349/682] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:15.352628 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81bca8-3e42-41c6-9ef1-26c6f40bb354 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:15.447804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfa55e-1ad4-49a5-b791-9ef3ffb6fbea None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:15.474025 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81bca8-3e42-41c6-9ef1-26c6f40bb354 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:15.488410 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f828ce-b502-4aea-a0ab-6568f903ae4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:15.489218 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f828ce-b502-4aea-a0ab-6568f903ae4f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:15.489503 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f828ce-b502-4aea-a0ab-6568f903ae4f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:15.489780 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f828ce-b502-4aea-a0ab-6568f903ae4f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:15.497610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f828ce-b502-4aea-a0ab-6568f903ae4f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:15.499068 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f828ce-b502-4aea-a0ab-6568f903ae4f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:15.515346 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c727e-1a3c-44f4-8ff9-1ea8910fe5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:15.516011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c727e-1a3c-44f4-8ff9-1ea8910fe5ec None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:15.516306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c727e-1a3c-44f4-8ff9-1ea8910fe5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:15.516566 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c727e-1a3c-44f4-8ff9-1ea8910fe5ec None admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:15.517358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c727e-1a3c-44f4-8ff9-1ea8910fe5ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:15.517667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c727e-1a3c-44f4-8ff9-1ea8910fe5ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:15.518148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-64f828ce-b502-4aea-a0ab-6568f903ae4f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 21:02:15.518148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:15.518148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:15.518148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:15.518148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:15.518148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:15.518148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:15.518148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:15.518148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:15.518148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:15.518148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:15.518148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:15.518148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:15.518148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:15.518148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:15.518148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:15.519090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:15.519090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:15.519090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:15.519090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:15.519090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:15.519090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:15.519090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:15.519090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:15.519090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:15.519090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:15.519090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:15.519090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:15.519090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:15.519090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:15.519090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:15.519090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:15.519090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:15.519090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:15.520056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:15.520056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:15.520056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:15.520056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:15.520056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:15.520056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:15.520056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:15.520056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:15.520056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 21:02:15.520056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:15.520602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c727e-1a3c-44f4-8ff9-1ea8910fe5ec None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:15.523794 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 334/683] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:02:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:15.524796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f828ce-b502-4aea-a0ab-6568f903ae4f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:15.542566 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 350/684] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:15.543567 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c727e-1a3c-44f4-8ff9-1ea8910fe5ec None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:15.641693 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f828ce-b502-4aea-a0ab-6568f903ae4f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:15.644736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c727e-1a3c-44f4-8ff9-1ea8910fe5ec None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:15.676699 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06523c-1816-4b10-aeef-9118e544e0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:15.677771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06523c-1816-4b10-aeef-9118e544e0fc None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:15.678266 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06523c-1816-4b10-aeef-9118e544e0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:15.678732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06523c-1816-4b10-aeef-9118e544e0fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:15.680343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69575825-dcf4-430f-aabe-bdb472c8782a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:15.681118 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69575825-dcf4-430f-aabe-bdb472c8782a None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:15.681523 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69575825-dcf4-430f-aabe-bdb472c8782a None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:15.681901 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69575825-dcf4-430f-aabe-bdb472c8782a None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:15.682883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69575825-dcf4-430f-aabe-bdb472c8782a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:15.683295 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69575825-dcf4-430f-aabe-bdb472c8782a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:15.684819 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69575825-dcf4-430f-aabe-bdb472c8782a None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:15.691186 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06523c-1816-4b10-aeef-9118e544e0fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:15.692823 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06523c-1816-4b10-aeef-9118e544e0fc None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:15.707551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 351/685] 10.222.0.25 () {56 vars in 1135 bytes} [Tue May 10 21:02:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:15.708532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69575825-dcf4-430f-aabe-bdb472c8782a None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:15.713478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-2a06523c-1816-4b10-aeef-9118e544e0fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:15.713478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:15.713478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:15.713478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:15.713478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:15.713478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:15.713478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:15.713478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:15.713478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:15.713478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:15.713478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:15.713478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:15.713478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:15.713478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:15.713478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:15.714406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:15.714406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:15.714406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:15.714406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:15.714406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:15.714406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:15.714406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:15.714406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:15.714406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:15.714406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:15.714406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:15.714406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:15.714406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:15.714406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:15.714406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:15.714406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:15.714406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:15.715364 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:15.715364 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:15.715364 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:15.715364 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:15.717820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 335/686] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:15.718810 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06523c-1816-4b10-aeef-9118e544e0fc None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:15.816611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69575825-dcf4-430f-aabe-bdb472c8782a None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:15.824044 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06523c-1816-4b10-aeef-9118e544e0fc None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:15.856831 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e2fdc-0626-44ea-a3eb-5abefd5f2400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:15.857487 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e2fdc-0626-44ea-a3eb-5abefd5f2400 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:15.857768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e2fdc-0626-44ea-a3eb-5abefd5f2400 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:15.858044 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e2fdc-0626-44ea-a3eb-5abefd5f2400 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:15.858913 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e2fdc-0626-44ea-a3eb-5abefd5f2400 None admin] RBAC: Adding query filter params (role.id=d09c313a1a354ea68cf1013629a4a584, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=2fa7da0ccf954be1a582411cdc617b0f) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:15.859225 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e2fdc-0626-44ea-a3eb-5abefd5f2400 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:15.860401 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd342096-317d-4c46-9bf6-94d3e0179c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:15.860691 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e2fdc-0626-44ea-a3eb-5abefd5f2400 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:15.861460 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd342096-317d-4c46-9bf6-94d3e0179c48 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:15.861938 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd342096-317d-4c46-9bf6-94d3e0179c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:15.862398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd342096-317d-4c46-9bf6-94d3e0179c48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:15.867268 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 352/687] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:02:15 2022] GET /identity/v3/role_assignments?user.id=2fa7da0ccf954be1a582411cdc617b0f&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=d09c313a1a354ea68cf1013629a4a584 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:15.868061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e2fdc-0626-44ea-a3eb-5abefd5f2400 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:15.938161 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd342096-317d-4c46-9bf6-94d3e0179c48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:15.940019 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd342096-317d-4c46-9bf6-94d3e0179c48 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:15.973833 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e2fdc-0626-44ea-a3eb-5abefd5f2400 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:16.016652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02538f9-eed3-4027-817a-de43562bdd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:16.017335 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02538f9-eed3-4027-817a-de43562bdd8d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:16.017617 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02538f9-eed3-4027-817a-de43562bdd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:16.017897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02538f9-eed3-4027-817a-de43562bdd8d None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:16.018684 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02538f9-eed3-4027-817a-de43562bdd8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:16.018987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02538f9-eed3-4027-817a-de43562bdd8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:16.020374 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02538f9-eed3-4027-817a-de43562bdd8d None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:16.051118 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 353/688] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:16.057554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02538f9-eed3-4027-817a-de43562bdd8d None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:16.109162 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 336/689] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:02:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:02:16.110637 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd342096-317d-4c46-9bf6-94d3e0179c48 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:16.208907 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02538f9-eed3-4027-817a-de43562bdd8d None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:16.250708 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd342096-317d-4c46-9bf6-94d3e0179c48 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:16.251226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca657392-4f28-47e2-80a2-cf171dfd3e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:16.251650 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca657392-4f28-47e2-80a2-cf171dfd3e74 None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:16.251931 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca657392-4f28-47e2-80a2-cf171dfd3e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:16.252376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca657392-4f28-47e2-80a2-cf171dfd3e74 None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:16.253905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca657392-4f28-47e2-80a2-cf171dfd3e74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:16.255352 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca657392-4f28-47e2-80a2-cf171dfd3e74 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:16.288995 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7a0d6-616e-46f0-8cbd-643bce281531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:16.289784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7a0d6-616e-46f0-8cbd-643bce281531 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:16.293664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7a0d6-616e-46f0-8cbd-643bce281531 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:16.293664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7a0d6-616e-46f0-8cbd-643bce281531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:16.300824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7a0d6-616e-46f0-8cbd-643bce281531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:16.302523 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7a0d6-616e-46f0-8cbd-643bce281531 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:16.325065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-31d7a0d6-616e-46f0-8cbd-643bce281531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:16.325065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:16.325065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:16.325065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:16.325065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:16.325065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:16.325065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:16.325065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:16.325065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:16.325065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:16.325065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:16.325065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:16.325065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:16.325065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:16.325065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:16.330625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:16.330625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:16.330625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:16.330625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:16.330625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:16.330625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:16.330625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:16.330625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:16.330625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:16.330625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:16.330625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:16.330625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:16.330625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:16.330625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:16.330625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:16.330625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:16.330625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:16.331580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:16.331580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:16.331580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:16.331580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:16.331580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 337/690] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:16.333351 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7a0d6-616e-46f0-8cbd-643bce281531 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:16.363508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 354/691] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 10 21:02:16 2022] POST /identity/v3/users => generated 254 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:02:16.455404 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7a0d6-616e-46f0-8cbd-643bce281531 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:16.499064 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33086aa7-f815-4d2a-b617-215386d09aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:16.500158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33086aa7-f815-4d2a-b617-215386d09aaa None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:16.500646 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33086aa7-f815-4d2a-b617-215386d09aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:16.501119 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33086aa7-f815-4d2a-b617-215386d09aaa None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:16.502080 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33086aa7-f815-4d2a-b617-215386d09aaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:16.502624 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33086aa7-f815-4d2a-b617-215386d09aaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:16.504213 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33086aa7-f815-4d2a-b617-215386d09aaa None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:16.519486 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 338/692] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:16.525685 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca657392-4f28-47e2-80a2-cf171dfd3e74 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:16.798521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca657392-4f28-47e2-80a2-cf171dfd3e74 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:16.836002 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142a73f-977d-4992-ad83-9ec64c973ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:16.836802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142a73f-977d-4992-ad83-9ec64c973ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:16.837086 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142a73f-977d-4992-ad83-9ec64c973ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:16.837364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142a73f-977d-4992-ad83-9ec64c973ea7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:16.850041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142a73f-977d-4992-ad83-9ec64c973ea7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:16.851989 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142a73f-977d-4992-ad83-9ec64c973ea7 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:16.865976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-5142a73f-977d-4992-ad83-9ec64c973ea7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:16.865976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:16.865976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:16.865976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:16.865976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:16.865976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:16.865976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:16.865976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:16.865976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:16.865976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:16.865976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:16.865976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:16.865976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:16.865976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:16.865976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:16.867161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:16.867161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:16.867161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:16.867161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:16.867161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:16.867161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:16.867161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:16.867161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:16.867161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:16.867161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:16.867161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:16.867161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:16.867161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:16.867161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:16.867161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:16.867161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:16.867161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:16.868261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:16.868261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:16.868261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:16.868261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:16.868261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:16.868261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:16.868261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:16.868261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:16.870380 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 355/693] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:16.875741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33086aa7-f815-4d2a-b617-215386d09aaa None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:16.984929 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33086aa7-f815-4d2a-b617-215386d09aaa None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:16.999711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaa4a2-b957-4af5-8220-4e1d0e7a01f7 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:17.000353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaa4a2-b957-4af5-8220-4e1d0e7a01f7 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:17.000993 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaa4a2-b957-4af5-8220-4e1d0e7a01f7 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:17.003618 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 356/694] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:17.009211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14435d-f484-4429-a932-c5be8aa9204a None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:17.009772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14435d-f484-4429-a932-c5be8aa9204a None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:17.010259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14435d-f484-4429-a932-c5be8aa9204a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:17.027716 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e2cd9-9649-4f8f-a68d-1e68e394d640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:17.028400 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e2cd9-9649-4f8f-a68d-1e68e394d640 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:17.028688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e2cd9-9649-4f8f-a68d-1e68e394d640 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:17.028967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e2cd9-9649-4f8f-a68d-1e68e394d640 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:17.029766 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e2cd9-9649-4f8f-a68d-1e68e394d640 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:17.030076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e2cd9-9649-4f8f-a68d-1e68e394d640 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:17.030699 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-dd14435d-f484-4429-a932-c5be8aa9204a None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:17.031552 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e2cd9-9649-4f8f-a68d-1e68e394d640 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:17.032349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-dd14435d-f484-4429-a932-c5be8aa9204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:17.050501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 339/695] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:17.056516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e2cd9-9649-4f8f-a68d-1e68e394d640 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:17.139615 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 357/696] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:02:17.161435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e2cd9-9649-4f8f-a68d-1e68e394d640 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:17.173494 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14435d-f484-4429-a932-c5be8aa9204a None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:17.228339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201036c-5bab-473c-8978-eb5d2fe12eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:17.229004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201036c-5bab-473c-8978-eb5d2fe12eee None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:17.229290 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201036c-5bab-473c-8978-eb5d2fe12eee None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:17.229569 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201036c-5bab-473c-8978-eb5d2fe12eee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:17.230415 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201036c-5bab-473c-8978-eb5d2fe12eee None admin] RBAC: Adding query filter params (role.id=d09c313a1a354ea68cf1013629a4a584, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=76040882d4374087bb7458fd8b5c1d8d) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:17.230756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201036c-5bab-473c-8978-eb5d2fe12eee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:17.232193 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201036c-5bab-473c-8978-eb5d2fe12eee None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:17.245847 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 340/697] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:02:17 2022] GET /identity/v3/role_assignments?user.id=76040882d4374087bb7458fd8b5c1d8d&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=d09c313a1a354ea68cf1013629a4a584 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:17.338870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14435d-f484-4429-a932-c5be8aa9204a None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:17.394876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b37ddf-06a3-4941-b76d-ce4cc92f56e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:17.395712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b37ddf-06a3-4941-b76d-ce4cc92f56e9 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:17.395995 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b37ddf-06a3-4941-b76d-ce4cc92f56e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:17.396268 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b37ddf-06a3-4941-b76d-ce4cc92f56e9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:17.397011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b37ddf-06a3-4941-b76d-ce4cc92f56e9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:17.398545 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b37ddf-06a3-4941-b76d-ce4cc92f56e9 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:17.417423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-d3b37ddf-06a3-4941-b76d-ce4cc92f56e9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 21:02:17.417423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:17.417423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:17.417423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:17.417423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:17.417423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:17.417423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:17.417423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:17.417423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 21:02:17.417423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:17.417423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:17.417423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:17.417423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:17.417423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:17.417423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:17.417423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:17.418512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:17.418512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:17.418512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:17.418512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:17.418512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:17.418512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:17.418512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:17.418512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:17.418512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:17.418512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:17.418512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:17.418512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:17.418512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:17.418512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:17.418512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:17.418512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:17.419466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:17.419466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:17.419466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:17.419466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:17.419466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:17.419466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:17.419466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:17.419466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:17.419466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:17.419466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:17.419466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:17.419466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:17.419466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:17.419466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 21:02:17.419466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:17.419466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 358/698] 10.222.0.25 () {56 vars in 1129 bytes} [Tue May 10 21:02:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:17.427019 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201036c-5bab-473c-8978-eb5d2fe12eee None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:17.541070 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201036c-5bab-473c-8978-eb5d2fe12eee None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:17.576995 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef769764-3653-4f53-9dd9-f55975891daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:17.577686 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef769764-3653-4f53-9dd9-f55975891daa None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:17.577968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef769764-3653-4f53-9dd9-f55975891daa None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:17.578248 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef769764-3653-4f53-9dd9-f55975891daa None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:17.579009 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef769764-3653-4f53-9dd9-f55975891daa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:17.579316 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef769764-3653-4f53-9dd9-f55975891daa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:17.580710 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef769764-3653-4f53-9dd9-f55975891daa None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:17.586327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 341/699] 10.222.0.25 () {56 vars in 1124 bytes} [Tue May 10 21:02:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:17.591918 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b37ddf-06a3-4941-b76d-ce4cc92f56e9 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:17.694118 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b37ddf-06a3-4941-b76d-ce4cc92f56e9 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:17.730947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278b5c7-ad62-4a0c-8ed9-95fafe83d199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:17.731624 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278b5c7-ad62-4a0c-8ed9-95fafe83d199 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:17.731903 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278b5c7-ad62-4a0c-8ed9-95fafe83d199 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:17.732175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278b5c7-ad62-4a0c-8ed9-95fafe83d199 None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:17.732888 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278b5c7-ad62-4a0c-8ed9-95fafe83d199 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:17.733192 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278b5c7-ad62-4a0c-8ed9-95fafe83d199 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:17.734650 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278b5c7-ad62-4a0c-8ed9-95fafe83d199 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:17.738470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb997a18-74d0-4770-bd8e-c3364600f5f0 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:17.738470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb997a18-74d0-4770-bd8e-c3364600f5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:17.738470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb997a18-74d0-4770-bd8e-c3364600f5f0 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:17.739304 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 342/700] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:02:17.746517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee31d42-fc86-4129-895f-a682924bbc24 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:17.746808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee31d42-fc86-4129-895f-a682924bbc24 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:17.747086 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee31d42-fc86-4129-895f-a682924bbc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:17.748300 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 359/701] 10.222.0.25 () {56 vars in 1124 bytes} [Tue May 10 21:02:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:17.766595 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6ee31d42-fc86-4129-895f-a682924bbc24 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:17.767812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6ee31d42-fc86-4129-895f-a682924bbc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:17.847377 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 343/702] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 21:02:17.869206 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278b5c7-ad62-4a0c-8ed9-95fafe83d199 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:17.988703 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278b5c7-ad62-4a0c-8ed9-95fafe83d199 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:18.023156 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef863f77-b1ea-4060-8533-a95f310b004b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:18.024274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef863f77-b1ea-4060-8533-a95f310b004b None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:18.024746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef863f77-b1ea-4060-8533-a95f310b004b None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:18.025194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef863f77-b1ea-4060-8533-a95f310b004b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:18.036673 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef863f77-b1ea-4060-8533-a95f310b004b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:18.044676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-ef863f77-b1ea-4060-8533-a95f310b004b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:02:18.044676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:18.044676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:18.044676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:18.044676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:18.044676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:18.044676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:18.044676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:18.044676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:18.044676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:18.044676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:18.044676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:18.044676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:18.044676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:18.044676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:18.044676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:18.045906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:18.045906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:18.045906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:18.045906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:18.045906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:18.045906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:18.045906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:18.045906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:18.045906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:18.045906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:18.045906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:18.045906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:18.045906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:18.045906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:18.045906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:18.045906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:18.046791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:18.046791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:18.046791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:18.046791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:18.046791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:18.046791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:18.046791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:18.046791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:18.046791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:18.046791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:18.046791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:02:18.046791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:18.053490 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 360/703] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:02:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:18.055622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee31d42-fc86-4129-895f-a682924bbc24 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:18.173446 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee31d42-fc86-4129-895f-a682924bbc24 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:18.223764 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798e67e-5dc8-4f24-b26a-5f6034b4cc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:18.224450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798e67e-5dc8-4f24-b26a-5f6034b4cc9d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:18.224738 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798e67e-5dc8-4f24-b26a-5f6034b4cc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:18.225021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798e67e-5dc8-4f24-b26a-5f6034b4cc9d None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:18.226396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798e67e-5dc8-4f24-b26a-5f6034b4cc9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:18.226982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798e67e-5dc8-4f24-b26a-5f6034b4cc9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:18.228737 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798e67e-5dc8-4f24-b26a-5f6034b4cc9d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:18.242411 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 344/704] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:02:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:18.247903 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef863f77-b1ea-4060-8533-a95f310b004b None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:18.414945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef863f77-b1ea-4060-8533-a95f310b004b None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:18.452666 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda231bd-a882-4474-a947-fc94c2101a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:18.453382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda231bd-a882-4474-a947-fc94c2101a1d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:18.453662 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda231bd-a882-4474-a947-fc94c2101a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:18.453933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda231bd-a882-4474-a947-fc94c2101a1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:18.464749 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda231bd-a882-4474-a947-fc94c2101a1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:18.466241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda231bd-a882-4474-a947-fc94c2101a1d None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:18.484376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-dda231bd-a882-4474-a947-fc94c2101a1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:18.484376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:18.484376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:18.484376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:18.484376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:18.484376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:18.484376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:18.484376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:18.484376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:18.484376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:18.484376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:18.484376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:18.484376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:18.484376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:18.484376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:18.485337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:18.485337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:18.485337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:18.485337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:18.485337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:18.485337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:18.485337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:18.485337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:18.485337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:18.485337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:18.485337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:18.485337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:18.485337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:18.485337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:18.485337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:18.485337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:18.485337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:18.486248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:18.486248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:18.486248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:18.486248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:18.486248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 361/705] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:18.492123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798e67e-5dc8-4f24-b26a-5f6034b4cc9d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:18.645267 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798e67e-5dc8-4f24-b26a-5f6034b4cc9d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:18.692311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8391223-8f40-41fe-8785-ed4e164ddaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:18.692987 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8391223-8f40-41fe-8785-ed4e164ddaad None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:18.693274 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8391223-8f40-41fe-8785-ed4e164ddaad None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:18.693560 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8391223-8f40-41fe-8785-ed4e164ddaad None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:18.694285 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8391223-8f40-41fe-8785-ed4e164ddaad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:18.694646 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8391223-8f40-41fe-8785-ed4e164ddaad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:18.696007 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8391223-8f40-41fe-8785-ed4e164ddaad None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:18.709298 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 345/706] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:18.715220 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda231bd-a882-4474-a947-fc94c2101a1d None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:18.857314 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda231bd-a882-4474-a947-fc94c2101a1d None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:18.898918 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c18b1-a127-4ae9-bd02-47ceb403f5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:18.899761 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c18b1-a127-4ae9-bd02-47ceb403f5bf None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:18.900047 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c18b1-a127-4ae9-bd02-47ceb403f5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:18.900326 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c18b1-a127-4ae9-bd02-47ceb403f5bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:18.909341 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c18b1-a127-4ae9-bd02-47ceb403f5bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:18.910874 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c18b1-a127-4ae9-bd02-47ceb403f5bf None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:18.931771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-eb8c18b1-a127-4ae9-bd02-47ceb403f5bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 21:02:18.931771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:18.931771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:18.931771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:18.931771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:18.931771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:18.931771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:18.931771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:18.931771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:18.931771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:18.931771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:18.931771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:18.931771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:18.931771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:18.931771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:18.931771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:18.932807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:18.932807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:18.932807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:18.932807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:18.932807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:18.932807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:18.932807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:18.932807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:18.932807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:18.932807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:18.932807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:18.932807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:18.932807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:18.932807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:18.932807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:18.932807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:18.932807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:18.932807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:18.933767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:18.933767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:18.933767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:18.933767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:18.933767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:18.933767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:18.933767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:18.933767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:18.933767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 21:02:18.933767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:18.938611 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8391223-8f40-41fe-8785-ed4e164ddaad None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:18.938816 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 362/707] 10.222.0.25 () {56 vars in 1093 bytes} [Tue May 10 21:02:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:19.075642 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8391223-8f40-41fe-8785-ed4e164ddaad None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:19.102080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed66ba-f0f2-414d-bc35-6672f77a8aa5 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:19.102408 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed66ba-f0f2-414d-bc35-6672f77a8aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:19.102688 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed66ba-f0f2-414d-bc35-6672f77a8aa5 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:19.104324 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 363/708] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:02:19.110211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7ec25-a5c4-44ab-8151-9483b76a5fa0 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:19.110453 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feccf5e-96fb-4737-9bbc-bce3ffeb9850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:19.110644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7ec25-a5c4-44ab-8151-9483b76a5fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:19.110801 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7ec25-a5c4-44ab-8151-9483b76a5fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:19.111001 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feccf5e-96fb-4737-9bbc-bce3ffeb9850 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:19.111286 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feccf5e-96fb-4737-9bbc-bce3ffeb9850 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:19.111562 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feccf5e-96fb-4737-9bbc-bce3ffeb9850 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:19.112510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feccf5e-96fb-4737-9bbc-bce3ffeb9850 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:19.112819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feccf5e-96fb-4737-9bbc-bce3ffeb9850 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:19.114230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feccf5e-96fb-4737-9bbc-bce3ffeb9850 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:19.133700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 346/709] 10.222.0.25 () {56 vars in 1133 bytes} [Tue May 10 21:02:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:19.141156 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feccf5e-96fb-4737-9bbc-bce3ffeb9850 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:19.141391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-f0d7ec25-a5c4-44ab-8151-9483b76a5fa0 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:19.142531 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-f0d7ec25-a5c4-44ab-8151-9483b76a5fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:19.213043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 364/710] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:02:19.243577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feccf5e-96fb-4737-9bbc-bce3ffeb9850 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:19.246296 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7ec25-a5c4-44ab-8151-9483b76a5fa0 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:19.289318 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7241cf5-5ff6-4a7d-94c0-bfbec354d136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:19.290387 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7241cf5-5ff6-4a7d-94c0-bfbec354d136 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:19.291574 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7241cf5-5ff6-4a7d-94c0-bfbec354d136 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:19.292082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7241cf5-5ff6-4a7d-94c0-bfbec354d136 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:19.419782 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7ec25-a5c4-44ab-8151-9483b76a5fa0 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:19.430462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7241cf5-5ff6-4a7d-94c0-bfbec354d136 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:19.430462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7241cf5-5ff6-4a7d-94c0-bfbec354d136 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:19.503297 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d68ba9-4046-4f48-82b5-f435cde42d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:19.504642 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d68ba9-4046-4f48-82b5-f435cde42d6d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:19.505143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d68ba9-4046-4f48-82b5-f435cde42d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:19.505689 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d68ba9-4046-4f48-82b5-f435cde42d6d None admin] PATH_INFO: `/v3/services/network` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:19.506607 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d68ba9-4046-4f48-82b5-f435cde42d6d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:19.508358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d68ba9-4046-4f48-82b5-f435cde42d6d None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:19.530489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-89d68ba9-4046-4f48-82b5-f435cde42d6d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 21:02:19.530489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:19.530489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:19.530489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:19.530489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:19.530489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:19.530489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:19.530489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:19.530489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 21:02:19.530489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:19.530489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:19.530489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:19.530489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:19.530489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:19.530489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:19.530489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:19.530489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:19.531722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:19.531722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:19.531722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:19.531722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:19.531722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:19.531722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:19.531722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:19.531722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:19.531722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:19.531722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:19.531722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:19.531722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:19.531722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:19.531722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:19.531722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:19.531722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:19.532579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:19.532579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:19.532579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:19.532579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:19.532579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:19.532579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:19.532579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:19.532579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:19.532579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:19.532579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:19.532579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:19.532579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:19.532579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 21:02:19.532579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:19.532579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 365/711] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:19 2022] GET /identity/v3/services/network => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:19.539789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d68ba9-4046-4f48-82b5-f435cde42d6d None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:19.551341 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 347/712] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:02:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 21:02:19.558718 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7241cf5-5ff6-4a7d-94c0-bfbec354d136 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:19.671534 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7241cf5-5ff6-4a7d-94c0-bfbec354d136 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:19.711146 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3157c94-cb59-498a-853a-9d64ce8c7873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:19.712053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3157c94-cb59-498a-853a-9d64ce8c7873 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:19.712334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3157c94-cb59-498a-853a-9d64ce8c7873 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:19.712603 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3157c94-cb59-498a-853a-9d64ce8c7873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:19.725974 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3157c94-cb59-498a-853a-9d64ce8c7873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:19.727541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3157c94-cb59-498a-853a-9d64ce8c7873 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:19.740660 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d68ba9-4046-4f48-82b5-f435cde42d6d None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:19.746005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-b3157c94-cb59-498a-853a-9d64ce8c7873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:19.746005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:19.746005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:19.746005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:19.746005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:19.746005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:19.746005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:19.746005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:19.746005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:19.746005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:19.746005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:19.746005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:19.746005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:19.746005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:19.746005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:19.746960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:19.746960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:19.746960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:19.746960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:19.746960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:19.746960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:19.746960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:19.746960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:19.746960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:19.746960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:19.746960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:19.746960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:19.746960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:19.746960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:19.746960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:19.746960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:19.746960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:19.747868 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:19.747868 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:19.747868 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:19.747868 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:19.751669 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 348/713] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:19.752986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e768d-624a-48a4-83e4-c568e58547cc None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:19.753277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e768d-624a-48a4-83e4-c568e58547cc None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:19.753558 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e768d-624a-48a4-83e4-c568e58547cc None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:19.755521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 349/714] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:19.756274 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e768d-624a-48a4-83e4-c568e58547cc None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:19.780697 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25a736-c91b-441b-a8cf-dde9ea830498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:19.781370 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25a736-c91b-441b-a8cf-dde9ea830498 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:19.781654 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25a736-c91b-441b-a8cf-dde9ea830498 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:19.781935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25a736-c91b-441b-a8cf-dde9ea830498 None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:19.782674 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25a736-c91b-441b-a8cf-dde9ea830498 None admin] RBAC: Adding query filter params (name=network) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:19.782983 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25a736-c91b-441b-a8cf-dde9ea830498 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:19.784342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25a736-c91b-441b-a8cf-dde9ea830498 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:19.790599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 366/715] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 10 21:02:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:19.792566 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedfc0a-ebc4-4e44-b214-d77837118136 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:19.792853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedfc0a-ebc4-4e44-b214-d77837118136 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:19.793130 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedfc0a-ebc4-4e44-b214-d77837118136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:19.820377 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-eeedfc0a-ebc4-4e44-b214-d77837118136 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:19.822429 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-eeedfc0a-ebc4-4e44-b214-d77837118136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:19.865584 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e768d-624a-48a4-83e4-c568e58547cc None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:19.900992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5c859-74dd-4baa-b089-0250aabd7f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:19.901642 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c859-74dd-4baa-b089-0250aabd7f38 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:19.901926 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c859-74dd-4baa-b089-0250aabd7f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:19.902411 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c859-74dd-4baa-b089-0250aabd7f38 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:19.902951 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5c859-74dd-4baa-b089-0250aabd7f38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:19.903298 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5c859-74dd-4baa-b089-0250aabd7f38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:19.904965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5c859-74dd-4baa-b089-0250aabd7f38 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:19.914759 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 367/716] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:02:19.915681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedfc0a-ebc4-4e44-b214-d77837118136 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:19.922129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 350/717] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:19.923573 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5c859-74dd-4baa-b089-0250aabd7f38 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:20.024969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5c859-74dd-4baa-b089-0250aabd7f38 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:20.034561 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedfc0a-ebc4-4e44-b214-d77837118136 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:20.061119 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c571f-c3b4-4c62-ae05-406101dca16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:20.062279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c571f-c3b4-4c62-ae05-406101dca16a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:20.062771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c571f-c3b4-4c62-ae05-406101dca16a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:20.063190 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c571f-c3b4-4c62-ae05-406101dca16a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:20.071770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c571f-c3b4-4c62-ae05-406101dca16a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:20.073596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c571f-c3b4-4c62-ae05-406101dca16a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:20.074695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c0d02-fbe9-4cdb-afc4-edd4995caa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:20.075390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c0d02-fbe9-4cdb-afc4-edd4995caa42 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:20.075679 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c0d02-fbe9-4cdb-afc4-edd4995caa42 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:20.075958 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c0d02-fbe9-4cdb-afc4-edd4995caa42 None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:20.076687 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c0d02-fbe9-4cdb-afc4-edd4995caa42 None admin] RBAC: Adding query filter params (type=network) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:20.076998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c0d02-fbe9-4cdb-afc4-edd4995caa42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:20.078394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c0d02-fbe9-4cdb-afc4-edd4995caa42 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:20.083829 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 368/718] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 10 21:02:19 2022] GET /identity/v3/services?type=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:20.084497 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c0d02-fbe9-4cdb-afc4-edd4995caa42 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:20.092771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-7f1c571f-c3b4-4c62-ae05-406101dca16a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:20.092771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:20.092771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:20.092771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:20.092771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:20.092771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:20.092771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:20.092771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:20.092771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:20.092771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:20.092771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:20.092771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:20.092771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:20.092771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:20.092771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:20.093953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:20.093953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:20.093953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:20.093953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:20.093953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:20.093953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:20.093953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:20.093953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:20.093953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:20.093953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:20.093953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:20.093953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:20.093953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:20.093953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:20.093953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:20.093953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:20.093953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:20.095001 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:20.095001 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:20.095001 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:20.095001 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:20.095001 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:20.095001 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:20.095001 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:20.095001 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:20.101498 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 351/719] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:20.103187 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c571f-c3b4-4c62-ae05-406101dca16a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:20.208679 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c571f-c3b4-4c62-ae05-406101dca16a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:20.246760 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aae21e-45a1-463b-88ad-4f235d012b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:20.247768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aae21e-45a1-463b-88ad-4f235d012b2a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:20.248217 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aae21e-45a1-463b-88ad-4f235d012b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:20.248670 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aae21e-45a1-463b-88ad-4f235d012b2a None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:20.249703 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aae21e-45a1-463b-88ad-4f235d012b2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:20.250198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aae21e-45a1-463b-88ad-4f235d012b2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:20.251862 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aae21e-45a1-463b-88ad-4f235d012b2a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:20.271162 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 352/720] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:20.271162 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c139d-2769-44d8-bf5a-32dc26d0101d None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:20.271162 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c139d-2769-44d8-bf5a-32dc26d0101d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:20.271162 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c139d-2769-44d8-bf5a-32dc26d0101d None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:20.275090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 353/721] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:20.276571 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce5855-6a71-4703-9f16-c408628282ed None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:20.276866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce5855-6a71-4703-9f16-c408628282ed None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:20.277151 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce5855-6a71-4703-9f16-c408628282ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:20.286059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c0d02-fbe9-4cdb-afc4-edd4995caa42 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:20.296461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a4ce5855-6a71-4703-9f16-c408628282ed None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:20.297190 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a4ce5855-6a71-4703-9f16-c408628282ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:20.330202 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844cc04-8aed-4ec2-a307-7df6af3bf31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:20.331559 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844cc04-8aed-4ec2-a307-7df6af3bf31e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:20.332047 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844cc04-8aed-4ec2-a307-7df6af3bf31e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:20.332522 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844cc04-8aed-4ec2-a307-7df6af3bf31e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:20.345263 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844cc04-8aed-4ec2-a307-7df6af3bf31e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:20.354017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-a844cc04-8aed-4ec2-a307-7df6af3bf31e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:20.354017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:20.354017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:20.354017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:20.354017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:20.354017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:20.354017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:20.354017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:20.354017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:20.354017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:20.354017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:20.354017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:20.354017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:20.354017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:20.354017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:20.354017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:20.355098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:20.355098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:20.355098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:20.355098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:20.355098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:20.355098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:20.355098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:20.355098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:20.355098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:20.355098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:20.355098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:20.355098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:20.355098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:20.355098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:20.355098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:20.355098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:20.355953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:20.355953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:20.355953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:20.355953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:20.355953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:20.355953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:20.355953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:20.355953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:20.355953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:20.355953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:20.355953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:20.355953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:20.359601 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 369/722] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:02:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:20.360864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844cc04-8aed-4ec2-a307-7df6af3bf31e None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:20.369700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 354/723] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:02:20.382681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce5855-6a71-4703-9f16-c408628282ed None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:20.482402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844cc04-8aed-4ec2-a307-7df6af3bf31e None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:20.499225 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce5855-6a71-4703-9f16-c408628282ed None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:20.517066 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ef83b-70bf-4ad3-ad9b-ff122d86b5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:20.517729 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ef83b-70bf-4ad3-ad9b-ff122d86b5be None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:20.518012 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ef83b-70bf-4ad3-ad9b-ff122d86b5be None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:20.518290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ef83b-70bf-4ad3-ad9b-ff122d86b5be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:20.519159 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ef83b-70bf-4ad3-ad9b-ff122d86b5be None admin] RBAC: Adding query filter params (role.id=5cd001edc58744738aa57180c0be68a9, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=c4c16a3b07c64a22bfc3df2a5a90c3f3) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:20.519471 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ef83b-70bf-4ad3-ad9b-ff122d86b5be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:20.520933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ef83b-70bf-4ad3-ad9b-ff122d86b5be None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:20.526785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 370/724] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:02:20 2022] GET /identity/v3/role_assignments?user.id=c4c16a3b07c64a22bfc3df2a5a90c3f3&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=5cd001edc58744738aa57180c0be68a9 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:20.527564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ef83b-70bf-4ad3-ad9b-ff122d86b5be None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:20.548126 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b045f-3671-4a73-b263-7ada147022f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:20.549603 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b045f-3671-4a73-b263-7ada147022f3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:20.550061 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b045f-3671-4a73-b263-7ada147022f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:20.550566 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b045f-3671-4a73-b263-7ada147022f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:20.551507 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b045f-3671-4a73-b263-7ada147022f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:20.552440 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b045f-3671-4a73-b263-7ada147022f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:20.555933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b045f-3671-4a73-b263-7ada147022f3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:20.570370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 355/725] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:02:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:20.572054 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f1191-890b-42e8-8c7f-67adfc102878 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:20.572754 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f1191-890b-42e8-8c7f-67adfc102878 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:20.573113 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f1191-890b-42e8-8c7f-67adfc102878 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:20.578731 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 356/726] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:20.578731 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f1191-890b-42e8-8c7f-67adfc102878 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:20.652608 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ef83b-70bf-4ad3-ad9b-ff122d86b5be None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:20.692101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a56f6-72da-4ea8-9aca-b61bd5741991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:20.693305 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a56f6-72da-4ea8-9aca-b61bd5741991 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:20.693820 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a56f6-72da-4ea8-9aca-b61bd5741991 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:20.694301 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a56f6-72da-4ea8-9aca-b61bd5741991 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:20.699419 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f1191-890b-42e8-8c7f-67adfc102878 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:20.707626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a56f6-72da-4ea8-9aca-b61bd5741991 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:20.716259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-bc2a56f6-72da-4ea8-9aca-b61bd5741991 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:02:20.716259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:20.716259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:20.716259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:20.716259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:20.716259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:20.716259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:20.716259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:20.716259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:20.716259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:20.716259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:20.716259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:20.716259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:20.716259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:20.716259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:20.716259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:20.717281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:20.717281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:20.717281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:20.717281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:20.717281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:20.717281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:20.717281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:20.717281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:20.717281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:20.717281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:20.717281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:20.717281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:20.717281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:20.717281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:20.717281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:20.717281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:20.718382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:20.718382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:20.718382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:20.718382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:20.718382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:20.718382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:20.718382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:20.718382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:20.718382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:20.718382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:20.718382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:02:20.718382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:20.718382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 371/727] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:02:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:20.719265 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69feaa-3b85-4fe2-9987-e1755bea4058 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:20.719265 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69feaa-3b85-4fe2-9987-e1755bea4058 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:20.722059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69feaa-3b85-4fe2-9987-e1755bea4058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:20.739596 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-9d69feaa-3b85-4fe2-9987-e1755bea4058 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:20.740924 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-9d69feaa-3b85-4fe2-9987-e1755bea4058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:20.744309 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0f6a8-e1f0-49d8-a95a-7c9d40ef27e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:20.745114 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0f6a8-e1f0-49d8-a95a-7c9d40ef27e2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:20.745401 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0f6a8-e1f0-49d8-a95a-7c9d40ef27e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:20.745679 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0f6a8-e1f0-49d8-a95a-7c9d40ef27e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:20.757071 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0f6a8-e1f0-49d8-a95a-7c9d40ef27e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:20.759195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0f6a8-e1f0-49d8-a95a-7c9d40ef27e2 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:20.778278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-77c0f6a8-e1f0-49d8-a95a-7c9d40ef27e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:20.778278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:20.778278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:20.778278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:20.778278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:20.778278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:20.778278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:20.778278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:20.778278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:20.778278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:20.778278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:20.778278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:20.778278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:20.778278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:20.778278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:20.779250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:20.779250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:20.779250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:20.779250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:20.779250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:20.779250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:20.779250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:20.779250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:20.779250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:20.779250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:20.779250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:20.779250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:20.779250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:20.779250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:20.779250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:20.779250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:20.779250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:20.780192 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:20.780192 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:20.780192 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:20.780192 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:20.784064 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 357/728] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:20.784917 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0f6a8-e1f0-49d8-a95a-7c9d40ef27e2 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:20.843464 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 372/729] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:02:20.844444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69feaa-3b85-4fe2-9987-e1755bea4058 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:20.931351 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0f6a8-e1f0-49d8-a95a-7c9d40ef27e2 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:20.965291 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69feaa-3b85-4fe2-9987-e1755bea4058 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:20.971230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1edc64-0283-4b54-b431-00311c9978a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:20.972077 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1edc64-0283-4b54-b431-00311c9978a2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:20.972507 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1edc64-0283-4b54-b431-00311c9978a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:20.972927 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1edc64-0283-4b54-b431-00311c9978a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:20.973845 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1edc64-0283-4b54-b431-00311c9978a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:20.974298 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1edc64-0283-4b54-b431-00311c9978a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:20.976420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1edc64-0283-4b54-b431-00311c9978a2 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:20.989680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 358/730] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:02:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:20.990871 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1edc64-0283-4b54-b431-00311c9978a2 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:21.005915 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eecff9-4b66-4813-a5a6-38c20a9c9c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:21.006877 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eecff9-4b66-4813-a5a6-38c20a9c9c42 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:21.007834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eecff9-4b66-4813-a5a6-38c20a9c9c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:21.008200 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eecff9-4b66-4813-a5a6-38c20a9c9c42 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:21.009290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eecff9-4b66-4813-a5a6-38c20a9c9c42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:21.009696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eecff9-4b66-4813-a5a6-38c20a9c9c42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:21.011374 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eecff9-4b66-4813-a5a6-38c20a9c9c42 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:21.032175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 373/731] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:21.032175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eecff9-4b66-4813-a5a6-38c20a9c9c42 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:21.104888 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1edc64-0283-4b54-b431-00311c9978a2 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:21.139169 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540893e2-6b56-44d9-80da-e24da59f4180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:21.140174 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540893e2-6b56-44d9-80da-e24da59f4180 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:21.140663 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540893e2-6b56-44d9-80da-e24da59f4180 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:21.141169 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540893e2-6b56-44d9-80da-e24da59f4180 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:21.142106 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540893e2-6b56-44d9-80da-e24da59f4180 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:21.143760 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540893e2-6b56-44d9-80da-e24da59f4180 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:21.156799 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eecff9-4b66-4813-a5a6-38c20a9c9c42 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:21.189027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543fa30-9d4f-4c08-af53-964d66b4b09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:21.189816 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543fa30-9d4f-4c08-af53-964d66b4b09e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:21.190102 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543fa30-9d4f-4c08-af53-964d66b4b09e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:21.190377 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543fa30-9d4f-4c08-af53-964d66b4b09e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:21.201580 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543fa30-9d4f-4c08-af53-964d66b4b09e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:21.203114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543fa30-9d4f-4c08-af53-964d66b4b09e None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:21.220802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-1543fa30-9d4f-4c08-af53-964d66b4b09e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:21.220802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:21.220802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:21.220802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:21.220802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:21.220802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:21.220802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:21.220802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:21.220802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:21.220802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:21.220802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:21.220802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:21.220802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:21.220802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:21.220802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:21.221796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:21.221796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:21.221796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:21.221796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:21.221796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:21.221796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:21.221796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:21.221796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:21.221796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:21.221796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:21.221796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:21.221796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:21.221796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:21.221796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:21.221796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:21.221796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:21.221796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:21.230906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:21.230906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:21.230906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:21.230906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:21.230906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 374/732] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:21.230906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543fa30-9d4f-4c08-af53-964d66b4b09e None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:21.257944 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 359/733] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 10 21:02:20 2022] POST /identity/v3/services => generated 251 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:02:21.259440 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540893e2-6b56-44d9-80da-e24da59f4180 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:21.379547 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540893e2-6b56-44d9-80da-e24da59f4180 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:21.404256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543fa30-9d4f-4c08-af53-964d66b4b09e None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:21.422815 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bbd0d-fce2-4e6b-82ea-118c15366295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:21.423811 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bbd0d-fce2-4e6b-82ea-118c15366295 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:21.424317 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bbd0d-fce2-4e6b-82ea-118c15366295 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:21.424787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bbd0d-fce2-4e6b-82ea-118c15366295 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:21.425707 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bbd0d-fce2-4e6b-82ea-118c15366295 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:21.426196 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bbd0d-fce2-4e6b-82ea-118c15366295 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:21.427775 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bbd0d-fce2-4e6b-82ea-118c15366295 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:21.441488 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 360/734] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:21.448450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bbd0d-fce2-4e6b-82ea-118c15366295 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:21.560251 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb184950-42ec-4898-b780-c83d1d177185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:21.561254 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb184950-42ec-4898-b780-c83d1d177185 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:21.561417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb184950-42ec-4898-b780-c83d1d177185 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:21.561796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb184950-42ec-4898-b780-c83d1d177185 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:21.578222 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bbd0d-fce2-4e6b-82ea-118c15366295 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:21.579692 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb184950-42ec-4898-b780-c83d1d177185 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:21.581144 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb184950-42ec-4898-b780-c83d1d177185 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:21.607205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-eb184950-42ec-4898-b780-c83d1d177185 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 21:02:21.607205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:21.607205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:21.607205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:21.607205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:21.607205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:21.607205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:21.607205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:21.607205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:21.607205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:21.607205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:21.607205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:21.607205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:21.607205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:21.607205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:21.607205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:21.608252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:21.608252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:21.608252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:21.608252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:21.608252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:21.608252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:21.608252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:21.608252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:21.608252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:21.608252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:21.608252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:21.608252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:21.608252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:21.608252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:21.608252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:21.608252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:21.608252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:21.608252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:21.609256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:21.609256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:21.609256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:21.609256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:21.609256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:21.609256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:21.609256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:21.609256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:21.609256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 21:02:21.609256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:21.609256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 375/735] 10.222.0.25 () {56 vars in 1117 bytes} [Tue May 10 21:02:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:21.614343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb184950-42ec-4898-b780-c83d1d177185 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:21.626414 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08172d-2b85-453e-a8b6-80de1c8ec08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:21.627584 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08172d-2b85-453e-a8b6-80de1c8ec08b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:21.628084 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08172d-2b85-453e-a8b6-80de1c8ec08b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:21.628594 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08172d-2b85-453e-a8b6-80de1c8ec08b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:21.637562 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08172d-2b85-453e-a8b6-80de1c8ec08b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:21.639284 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08172d-2b85-453e-a8b6-80de1c8ec08b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:21.654583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-ba08172d-2b85-453e-a8b6-80de1c8ec08b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 21:02:21.654583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:21.654583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:21.654583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:21.654583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:21.654583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:21.654583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:21.654583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:21.654583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:21.654583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:21.654583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:21.654583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:21.654583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:21.654583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:21.654583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:21.654583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:21.655617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:21.655617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:21.655617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:21.655617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:21.655617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:21.655617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:21.655617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:21.655617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:21.655617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:21.655617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:21.655617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:21.655617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:21.655617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:21.655617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:21.655617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:21.655617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:21.655617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:21.655617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:21.656627 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:21.656627 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:21.656627 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:21.656627 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:21.656627 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:21.656627 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:21.656627 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:21.656627 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:21.656627 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 21:02:21.656627 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:21.659377 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 361/736] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:02:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:21.664706 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08172d-2b85-453e-a8b6-80de1c8ec08b None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:21.734501 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb184950-42ec-4898-b780-c83d1d177185 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:21.769492 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d50b02-c896-4352-a255-b1c6b7935878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:21.770275 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d50b02-c896-4352-a255-b1c6b7935878 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:21.770880 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d50b02-c896-4352-a255-b1c6b7935878 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:21.770993 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d50b02-c896-4352-a255-b1c6b7935878 None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:21.771910 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d50b02-c896-4352-a255-b1c6b7935878 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:21.772265 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d50b02-c896-4352-a255-b1c6b7935878 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:21.773859 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d50b02-c896-4352-a255-b1c6b7935878 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:21.774520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08172d-2b85-453e-a8b6-80de1c8ec08b None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:21.792226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 376/737] 10.222.0.25 () {56 vars in 1149 bytes} [Tue May 10 21:02:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:21.797554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d50b02-c896-4352-a255-b1c6b7935878 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:21.810883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf330de4-e839-438d-8083-d66f8dec229c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:21.811811 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf330de4-e839-438d-8083-d66f8dec229c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:21.812248 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf330de4-e839-438d-8083-d66f8dec229c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:21.812725 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf330de4-e839-438d-8083-d66f8dec229c None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:21.813818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf330de4-e839-438d-8083-d66f8dec229c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:21.814326 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf330de4-e839-438d-8083-d66f8dec229c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:21.816074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf330de4-e839-438d-8083-d66f8dec229c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:21.835314 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 362/738] 10.222.0.25 () {56 vars in 1135 bytes} [Tue May 10 21:02:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:21.845415 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf330de4-e839-438d-8083-d66f8dec229c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:21.903012 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d50b02-c896-4352-a255-b1c6b7935878 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:21.938814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d962630-d481-433e-82a1-13076ae0528a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:21.939387 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d962630-d481-433e-82a1-13076ae0528a None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:21.939748 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d962630-d481-433e-82a1-13076ae0528a None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:21.940101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d962630-d481-433e-82a1-13076ae0528a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:21.965060 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf330de4-e839-438d-8083-d66f8dec229c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:22.000801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce8016-cc24-437e-9aa5-a19778da34c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:22.001842 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce8016-cc24-437e-9aa5-a19778da34c3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:22.002359 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce8016-cc24-437e-9aa5-a19778da34c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:22.002845 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce8016-cc24-437e-9aa5-a19778da34c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:22.010525 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d962630-d481-433e-82a1-13076ae0528a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:22.012074 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d962630-d481-433e-82a1-13076ae0528a None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:22.072910 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce8016-cc24-437e-9aa5-a19778da34c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:22.074792 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce8016-cc24-437e-9aa5-a19778da34c3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:22.172566 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 377/739] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:02:21 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 21:02:22.176891 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d962630-d481-433e-82a1-13076ae0528a None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:22.200455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 363/740] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:02:21 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 21:02:22.207540 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce8016-cc24-437e-9aa5-a19778da34c3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:22.313117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d962630-d481-433e-82a1-13076ae0528a None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:22.380530 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce8016-cc24-437e-9aa5-a19778da34c3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:22.387167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82036905-7215-4607-a7cb-80ba9527db10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:22.387977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82036905-7215-4607-a7cb-80ba9527db10 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:22.388267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82036905-7215-4607-a7cb-80ba9527db10 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:22.388551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82036905-7215-4607-a7cb-80ba9527db10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:22.412886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82036905-7215-4607-a7cb-80ba9527db10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:22.414793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82036905-7215-4607-a7cb-80ba9527db10 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:22.430766 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80266a0-4058-4637-b20e-c66a26e030e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:22.431572 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80266a0-4058-4637-b20e-c66a26e030e7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:22.431851 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80266a0-4058-4637-b20e-c66a26e030e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:22.432122 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80266a0-4058-4637-b20e-c66a26e030e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:22.443843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80266a0-4058-4637-b20e-c66a26e030e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:22.446042 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80266a0-4058-4637-b20e-c66a26e030e7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:22.451521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-82036905-7215-4607-a7cb-80ba9527db10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:22.451521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:22.451521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:22.451521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:22.451521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:22.451521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:22.451521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:22.451521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:22.451521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:22.451521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:22.451521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:22.451521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:22.451521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:22.451521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:22.451521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:22.452427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:22.452427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:22.452427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:22.452427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:22.452427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:22.452427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:22.452427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:22.452427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:22.452427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:22.452427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:22.452427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:22.452427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:22.452427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:22.452427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:22.452427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:22.452427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:22.452427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:22.453357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:22.453357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:22.453357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:22.453357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:22.459044 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 378/741] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:22.464514 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82036905-7215-4607-a7cb-80ba9527db10 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:22.464795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-a80266a0-4058-4637-b20e-c66a26e030e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:22.464795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:22.464795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:22.464795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:22.464795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:22.464795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:22.464795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:22.464795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:22.464795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:22.464795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:22.464795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:22.464795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:22.464795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:22.464795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:22.464795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:22.466924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:22.466924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:22.466924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:22.466924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:22.466924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:22.466924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:22.466924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:22.466924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:22.466924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:22.466924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:22.466924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:22.466924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:22.466924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:22.466924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:22.466924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:22.466924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:22.466924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:22.469115 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:22.469115 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:22.469115 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:22.469115 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:22.469115 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 364/742] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:22.472496 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80266a0-4058-4637-b20e-c66a26e030e7 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:22.597268 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82036905-7215-4607-a7cb-80ba9527db10 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:22.636865 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae7ce0-dc02-4dc4-88d0-3d4db37e750e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:22.638577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae7ce0-dc02-4dc4-88d0-3d4db37e750e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:22.643131 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae7ce0-dc02-4dc4-88d0-3d4db37e750e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:22.643668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae7ce0-dc02-4dc4-88d0-3d4db37e750e None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:22.644628 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae7ce0-dc02-4dc4-88d0-3d4db37e750e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:22.645159 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae7ce0-dc02-4dc4-88d0-3d4db37e750e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:22.646764 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae7ce0-dc02-4dc4-88d0-3d4db37e750e None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:22.664318 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 379/743] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:22.671881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae7ce0-dc02-4dc4-88d0-3d4db37e750e None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:22.695524 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80266a0-4058-4637-b20e-c66a26e030e7 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:22.738206 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0dbdf-0207-4016-bb3c-5867090605a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:22.739708 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0dbdf-0207-4016-bb3c-5867090605a7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:22.740212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0dbdf-0207-4016-bb3c-5867090605a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:22.741009 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0dbdf-0207-4016-bb3c-5867090605a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:22.743003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0dbdf-0207-4016-bb3c-5867090605a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:22.743846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0dbdf-0207-4016-bb3c-5867090605a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:22.745845 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0dbdf-0207-4016-bb3c-5867090605a7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:22.762120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 365/744] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:22.763954 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849ea97-ee41-4c53-bd73-702d5502a077 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:22.765110 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849ea97-ee41-4c53-bd73-702d5502a077 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:22.765631 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849ea97-ee41-4c53-bd73-702d5502a077 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:22.768161 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 366/745] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:22.769273 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849ea97-ee41-4c53-bd73-702d5502a077 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:22.803349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae7ce0-dc02-4dc4-88d0-3d4db37e750e None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:22.847068 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94fa6e-63c0-41bb-a78a-a93d8fc18ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:22.848028 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94fa6e-63c0-41bb-a78a-a93d8fc18ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:22.848314 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94fa6e-63c0-41bb-a78a-a93d8fc18ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:22.848589 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94fa6e-63c0-41bb-a78a-a93d8fc18ab2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:22.858346 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94fa6e-63c0-41bb-a78a-a93d8fc18ab2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:22.862052 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94fa6e-63c0-41bb-a78a-a93d8fc18ab2 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:22.884417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-6a94fa6e-63c0-41bb-a78a-a93d8fc18ab2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:22.884417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:22.884417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:22.884417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:22.884417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:22.884417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:22.884417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:22.884417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:22.884417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:22.884417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:22.884417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:22.884417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:22.884417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:22.884417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:22.884417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:22.885397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:22.885397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:22.885397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:22.885397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:22.885397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:22.885397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:22.885397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:22.885397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:22.885397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:22.885397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:22.885397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:22.885397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:22.885397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:22.885397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:22.885397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:22.885397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:22.885397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:22.886316 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:22.886316 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:22.886316 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:22.886316 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:22.886316 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:22.886316 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:22.886316 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:22.886316 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:22.886316 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 380/746] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:22.887364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffb978-66ee-4a56-99bd-7734d42c5cf2 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:22.887566 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffb978-66ee-4a56-99bd-7734d42c5cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:22.887847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffb978-66ee-4a56-99bd-7734d42c5cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:22.899503 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849ea97-ee41-4c53-bd73-702d5502a077 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:22.907106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-04ffb978-66ee-4a56-99bd-7734d42c5cf2 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:22.908278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-04ffb978-66ee-4a56-99bd-7734d42c5cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:22.947970 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db057820-8438-4c63-8525-51181f735f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:22.948771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db057820-8438-4c63-8525-51181f735f35 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:22.949053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db057820-8438-4c63-8525-51181f735f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:22.949324 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db057820-8438-4c63-8525-51181f735f35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:22.957706 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db057820-8438-4c63-8525-51181f735f35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:22.959187 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db057820-8438-4c63-8525-51181f735f35 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:22.972986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-db057820-8438-4c63-8525-51181f735f35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:22.972986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:22.972986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:22.972986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:22.972986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:22.972986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:22.972986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:22.972986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:22.972986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:22.972986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:22.972986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:22.972986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:22.972986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:22.972986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:22.972986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:22.973912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:22.973912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:22.973912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:22.973912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:22.973912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:22.973912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:22.973912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:22.973912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:22.973912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:22.973912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:22.973912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:22.973912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:22.973912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:22.973912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:22.973912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:22.973912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:22.973912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:22.974917 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:22.974917 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:22.974917 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:22.974917 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:22.974917 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:22.974917 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:22.974917 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:22.974917 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:22.974917 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 367/747] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:22.975975 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db057820-8438-4c63-8525-51181f735f35 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:22.992374 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 381/748] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:02:22.993900 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6db0e4-d9f5-4049-80e1-3f0642897bea None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:22.994199 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6db0e4-d9f5-4049-80e1-3f0642897bea None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:22.994503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6db0e4-d9f5-4049-80e1-3f0642897bea None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:23.000103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 382/749] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:23.000103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6db0e4-d9f5-4049-80e1-3f0642897bea None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:23.093161 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db057820-8438-4c63-8525-51181f735f35 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:23.111481 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6db0e4-d9f5-4049-80e1-3f0642897bea None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:23.128262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bcf26-d4e6-4650-a1c6-05e7e6088e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:23.129154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bcf26-d4e6-4650-a1c6-05e7e6088e67 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:23.129607 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bcf26-d4e6-4650-a1c6-05e7e6088e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:23.130097 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bcf26-d4e6-4650-a1c6-05e7e6088e67 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:23.131100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bcf26-d4e6-4650-a1c6-05e7e6088e67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:23.131413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bcf26-d4e6-4650-a1c6-05e7e6088e67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:23.132838 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bcf26-d4e6-4650-a1c6-05e7e6088e67 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:23.144946 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c85a8f-9621-4113-8ed8-c14d6db5b64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:23.145181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 368/750] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:23.145651 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c85a8f-9621-4113-8ed8-c14d6db5b64f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:23.146039 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c85a8f-9621-4113-8ed8-c14d6db5b64f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:23.146420 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c85a8f-9621-4113-8ed8-c14d6db5b64f None admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:23.147199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da08a6-6361-4063-bca3-4e244abe6424 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:23.148021 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c85a8f-9621-4113-8ed8-c14d6db5b64f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:23.148347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da08a6-6361-4063-bca3-4e244abe6424 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:23.148551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c85a8f-9621-4113-8ed8-c14d6db5b64f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:23.148904 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da08a6-6361-4063-bca3-4e244abe6424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:23.150180 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c85a8f-9621-4113-8ed8-c14d6db5b64f None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:23.162025 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 383/751] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:23.163019 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c85a8f-9621-4113-8ed8-c14d6db5b64f None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:23.168395 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f3da08a6-6361-4063-bca3-4e244abe6424 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:23.169718 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f3da08a6-6361-4063-bca3-4e244abe6424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:23.233843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 369/752] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 21:02:23.234902 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da08a6-6361-4063-bca3-4e244abe6424 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:23.263880 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c85a8f-9621-4113-8ed8-c14d6db5b64f None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:23.298311 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7778f2-f7ed-4740-8d46-bccf84ea72da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:23.299214 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7778f2-f7ed-4740-8d46-bccf84ea72da None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:23.299494 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7778f2-f7ed-4740-8d46-bccf84ea72da None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:23.299771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7778f2-f7ed-4740-8d46-bccf84ea72da None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:23.300484 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7778f2-f7ed-4740-8d46-bccf84ea72da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:23.301829 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7778f2-f7ed-4740-8d46-bccf84ea72da None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:23.339118 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da08a6-6361-4063-bca3-4e244abe6424 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:23.371491 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ea8ce-9e18-4b26-abeb-5b8b10010d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:23.372143 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ea8ce-9e18-4b26-abeb-5b8b10010d2c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:23.372428 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ea8ce-9e18-4b26-abeb-5b8b10010d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:23.372702 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ea8ce-9e18-4b26-abeb-5b8b10010d2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:23.373528 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ea8ce-9e18-4b26-abeb-5b8b10010d2c None admin] RBAC: Adding query filter params (role.id=d09c313a1a354ea68cf1013629a4a584, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=c0fc3052af194b48b7ce036ff605ff25) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:23.373894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ea8ce-9e18-4b26-abeb-5b8b10010d2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:23.375339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ea8ce-9e18-4b26-abeb-5b8b10010d2c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:23.380659 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 370/753] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:02:23 2022] GET /identity/v3/role_assignments?user.id=c0fc3052af194b48b7ce036ff605ff25&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=d09c313a1a354ea68cf1013629a4a584 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:23.381420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ea8ce-9e18-4b26-abeb-5b8b10010d2c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:23.411644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 384/754] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 10 21:02:23 2022] POST /identity/v3/services => generated 240 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:02:23.411644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7778f2-f7ed-4740-8d46-bccf84ea72da None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:23.593710 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ea8ce-9e18-4b26-abeb-5b8b10010d2c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:23.630941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7778f2-f7ed-4740-8d46-bccf84ea72da None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:23.639943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106661b-c085-41e2-ae3d-40557fae4feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:23.640951 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106661b-c085-41e2-ae3d-40557fae4feb None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:23.641434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106661b-c085-41e2-ae3d-40557fae4feb None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:23.641907 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106661b-c085-41e2-ae3d-40557fae4feb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:23.643084 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106661b-c085-41e2-ae3d-40557fae4feb None admin] RBAC: Adding query filter params (role.id=5cd001edc58744738aa57180c0be68a9, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=76040882d4374087bb7458fd8b5c1d8d) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:23.643597 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106661b-c085-41e2-ae3d-40557fae4feb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:23.645214 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106661b-c085-41e2-ae3d-40557fae4feb None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:23.652722 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 371/755] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:02:23 2022] GET /identity/v3/role_assignments?user.id=76040882d4374087bb7458fd8b5c1d8d&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=5cd001edc58744738aa57180c0be68a9 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:23.676522 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23589c-d63b-460f-b3bc-e5515bcd40b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:23.677738 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23589c-d63b-460f-b3bc-e5515bcd40b9 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:23.678222 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23589c-d63b-460f-b3bc-e5515bcd40b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:23.678769 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23589c-d63b-460f-b3bc-e5515bcd40b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:23.691053 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23589c-d63b-460f-b3bc-e5515bcd40b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:23.700179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-2b23589c-d63b-460f-b3bc-e5515bcd40b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:02:23.700179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:23.700179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:23.700179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:23.700179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:23.700179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:23.700179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:23.700179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:23.700179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:23.700179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:23.700179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:23.700179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:23.700179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:23.700179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:23.700179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:23.700179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:23.701183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:23.701183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:23.701183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:23.701183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:23.701183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:23.701183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:23.701183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:23.701183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:23.701183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:23.701183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:23.701183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:23.701183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:23.701183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:23.701183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:23.701183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:23.701183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:23.702020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:23.702020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:23.702020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:23.702020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:23.702020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:23.702020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:23.702020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:23.702020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:23.702020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:23.702020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:23.702020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:02:23.702020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:23.704963 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 385/756] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:02:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:23.711256 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106661b-c085-41e2-ae3d-40557fae4feb None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:23.822638 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106661b-c085-41e2-ae3d-40557fae4feb None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:23.871230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba939a-a00c-43ae-a781-dc01b7d8ed05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:23.871907 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba939a-a00c-43ae-a781-dc01b7d8ed05 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:23.872194 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba939a-a00c-43ae-a781-dc01b7d8ed05 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:23.872472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba939a-a00c-43ae-a781-dc01b7d8ed05 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:23.873226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba939a-a00c-43ae-a781-dc01b7d8ed05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:23.873534 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba939a-a00c-43ae-a781-dc01b7d8ed05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:23.874923 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba939a-a00c-43ae-a781-dc01b7d8ed05 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:23.883998 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 372/757] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:02:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:23.890157 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23589c-d63b-460f-b3bc-e5515bcd40b9 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:23.999182 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23589c-d63b-460f-b3bc-e5515bcd40b9 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:24.033540 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52395aae-1037-41b2-a096-4247b4fea70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:24.034660 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52395aae-1037-41b2-a096-4247b4fea70f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:24.035087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52395aae-1037-41b2-a096-4247b4fea70f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:24.035510 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52395aae-1037-41b2-a096-4247b4fea70f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:24.046709 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52395aae-1037-41b2-a096-4247b4fea70f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:24.048387 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52395aae-1037-41b2-a096-4247b4fea70f None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:24.066582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-52395aae-1037-41b2-a096-4247b4fea70f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:24.066582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:24.066582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:24.066582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:24.066582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:24.066582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:24.066582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:24.066582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:24.066582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:24.066582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:24.066582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:24.066582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:24.066582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:24.066582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:24.066582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:24.067711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:24.067711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:24.067711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:24.067711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:24.067711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:24.067711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:24.067711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:24.067711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:24.067711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:24.067711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:24.067711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:24.067711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:24.067711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:24.067711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:24.067711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:24.067711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:24.067711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:24.068803 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:24.068803 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:24.068803 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:24.068803 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:24.071482 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 386/758] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:24.079523 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba939a-a00c-43ae-a781-dc01b7d8ed05 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:24.148578 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ac978-43b3-4d53-a03b-cd5de2dbefcd None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:24.149245 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ac978-43b3-4d53-a03b-cd5de2dbefcd None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:24.150007 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ac978-43b3-4d53-a03b-cd5de2dbefcd None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:24.153493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 387/759] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:02:24.158394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6d9ef-2d1a-4213-b110-994a41c96890 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:24.158950 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6d9ef-2d1a-4213-b110-994a41c96890 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:24.159427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6d9ef-2d1a-4213-b110-994a41c96890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:24.177253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-afc6d9ef-2d1a-4213-b110-994a41c96890 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:24.179376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-afc6d9ef-2d1a-4213-b110-994a41c96890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:24.217600 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba939a-a00c-43ae-a781-dc01b7d8ed05 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:24.254614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 388/760] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:24.256524 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f460dc-ac37-4022-994a-3f2f95a0779b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:24.257661 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f460dc-ac37-4022-994a-3f2f95a0779b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:24.257993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f460dc-ac37-4022-994a-3f2f95a0779b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:24.258275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f460dc-ac37-4022-994a-3f2f95a0779b None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:24.259083 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f460dc-ac37-4022-994a-3f2f95a0779b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:24.259390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f460dc-ac37-4022-994a-3f2f95a0779b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:24.260800 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f460dc-ac37-4022-994a-3f2f95a0779b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:24.273852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 373/761] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:24.274844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6d9ef-2d1a-4213-b110-994a41c96890 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:24.279678 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f460dc-ac37-4022-994a-3f2f95a0779b None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:24.382427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f460dc-ac37-4022-994a-3f2f95a0779b None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:24.418648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f185210-ffc1-49bc-92a3-d5cbb2883a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:24.419822 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f185210-ffc1-49bc-92a3-d5cbb2883a8b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:24.420573 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f185210-ffc1-49bc-92a3-d5cbb2883a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:24.421023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f185210-ffc1-49bc-92a3-d5cbb2883a8b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:24.429358 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f185210-ffc1-49bc-92a3-d5cbb2883a8b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:24.431174 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f185210-ffc1-49bc-92a3-d5cbb2883a8b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:24.445972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-9f185210-ffc1-49bc-92a3-d5cbb2883a8b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 21:02:24.445972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:24.445972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:24.445972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:24.445972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:24.445972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:24.445972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:24.445972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:24.445972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:24.445972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:24.445972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:24.445972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:24.445972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:24.445972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:24.445972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:24.445972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:24.447005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:24.447005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:24.447005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:24.447005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:24.447005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:24.447005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:24.447005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:24.447005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:24.447005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:24.447005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:24.447005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:24.447005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:24.447005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:24.447005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:24.447005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:24.447005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:24.447005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:24.447005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:24.447982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:24.447982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:24.447982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:24.447982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:24.447982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:24.447982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:24.447982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:24.447982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:24.447982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 21:02:24.447982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:24.450217 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 374/762] 10.222.0.25 () {56 vars in 1093 bytes} [Tue May 10 21:02:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:24.455252 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f185210-ffc1-49bc-92a3-d5cbb2883a8b None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:24.532887 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6d9ef-2d1a-4213-b110-994a41c96890 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:24.567015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f185210-ffc1-49bc-92a3-d5cbb2883a8b None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:24.604969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e3017-bbfc-4946-9166-72a308d78df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:24.605956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e3017-bbfc-4946-9166-72a308d78df9 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:24.606386 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e3017-bbfc-4946-9166-72a308d78df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:24.606965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e3017-bbfc-4946-9166-72a308d78df9 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:24.608121 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e3017-bbfc-4946-9166-72a308d78df9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:24.608590 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e3017-bbfc-4946-9166-72a308d78df9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:24.610155 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e3017-bbfc-4946-9166-72a308d78df9 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:24.623734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4678bb-ed78-4981-bb66-061be8804305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:24.624563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4678bb-ed78-4981-bb66-061be8804305 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:24.624849 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4678bb-ed78-4981-bb66-061be8804305 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:24.625127 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4678bb-ed78-4981-bb66-061be8804305 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:24.626040 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4678bb-ed78-4981-bb66-061be8804305 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:24.627214 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4678bb-ed78-4981-bb66-061be8804305 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:24.629754 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 375/763] 10.222.0.25 () {56 vars in 1133 bytes} [Tue May 10 21:02:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:24.635041 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e3017-bbfc-4946-9166-72a308d78df9 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:24.653630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-3d4678bb-ed78-4981-bb66-061be8804305 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 21:02:24.653630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:24.653630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:24.653630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:24.653630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:24.653630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:24.653630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:24.653630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:24.653630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 21:02:24.653630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:24.653630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:24.653630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:24.653630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:24.653630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:24.653630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:24.653630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:24.655134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:24.655134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:24.655134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:24.655134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:24.655134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:24.655134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:24.655134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:24.655134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:24.655134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:24.655134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:24.655134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:24.655134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:24.655134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:24.655134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:24.655134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:24.655134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:24.656091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:24.656091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:24.656091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:24.656091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:24.656091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:24.656091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:24.656091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:24.656091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:24.656091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:24.656091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:24.656091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:24.656091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:24.656091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:24.656091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 21:02:24.656091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:24.661591 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 389/764] 10.222.0.25 () {56 vars in 1129 bytes} [Tue May 10 21:02:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:24.668538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4678bb-ed78-4981-bb66-061be8804305 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:24.783829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e3017-bbfc-4946-9166-72a308d78df9 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:24.825400 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc48e73-195d-4022-8051-a9b51c82406f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:24.825400 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc48e73-195d-4022-8051-a9b51c82406f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:24.825400 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc48e73-195d-4022-8051-a9b51c82406f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:24.825400 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc48e73-195d-4022-8051-a9b51c82406f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:24.861279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc48e73-195d-4022-8051-a9b51c82406f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:24.862762 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc48e73-195d-4022-8051-a9b51c82406f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:24.895437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-1cc48e73-195d-4022-8051-a9b51c82406f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:24.895437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:24.895437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:24.895437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:24.895437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:24.895437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:24.895437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:24.895437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:24.895437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:24.895437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:24.895437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:24.895437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:24.895437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:24.895437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:24.895437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:24.896406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:24.896406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:24.896406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:24.896406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:24.896406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:24.896406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:24.896406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:24.896406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:24.896406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:24.896406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:24.896406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:24.896406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:24.896406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:24.896406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:24.896406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:24.896406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:24.896406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:24.898097 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:24.898097 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:24.898097 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:24.898097 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:24.910233 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 376/765] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:24.910233 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc48e73-195d-4022-8051-a9b51c82406f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:24.912963 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4678bb-ed78-4981-bb66-061be8804305 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:24.980638 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcea8a9-ebe0-4b71-8868-46f6d64969a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:24.981310 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcea8a9-ebe0-4b71-8868-46f6d64969a1 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:24.981596 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcea8a9-ebe0-4b71-8868-46f6d64969a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:24.981870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcea8a9-ebe0-4b71-8868-46f6d64969a1 None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:24.983316 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcea8a9-ebe0-4b71-8868-46f6d64969a1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:24.983697 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcea8a9-ebe0-4b71-8868-46f6d64969a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:24.985074 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcea8a9-ebe0-4b71-8868-46f6d64969a1 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:24.997365 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 390/766] 10.222.0.25 () {56 vars in 1124 bytes} [Tue May 10 21:02:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:25.002909 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcea8a9-ebe0-4b71-8868-46f6d64969a1 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:25.105845 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc48e73-195d-4022-8051-a9b51c82406f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:25.168008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e93c5f-deec-4789-898a-6d78eaa0e82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:25.168684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e93c5f-deec-4789-898a-6d78eaa0e82a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:25.168970 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e93c5f-deec-4789-898a-6d78eaa0e82a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:25.169242 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e93c5f-deec-4789-898a-6d78eaa0e82a None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:25.169973 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e93c5f-deec-4789-898a-6d78eaa0e82a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:25.170566 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e93c5f-deec-4789-898a-6d78eaa0e82a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:25.171928 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e93c5f-deec-4789-898a-6d78eaa0e82a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:25.182362 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcea8a9-ebe0-4b71-8868-46f6d64969a1 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:25.196484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 377/767] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:25.203737 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e93c5f-deec-4789-898a-6d78eaa0e82a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:25.218357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d193481-6a42-459d-9fc9-e4a69370422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:25.219059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d193481-6a42-459d-9fc9-e4a69370422f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:25.219399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d193481-6a42-459d-9fc9-e4a69370422f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:25.219684 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d193481-6a42-459d-9fc9-e4a69370422f None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:25.220400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d193481-6a42-459d-9fc9-e4a69370422f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:25.220707 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d193481-6a42-459d-9fc9-e4a69370422f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:25.222070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d193481-6a42-459d-9fc9-e4a69370422f None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:25.232381 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 391/768] 10.222.0.25 () {56 vars in 1124 bytes} [Tue May 10 21:02:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:25.233443 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d193481-6a42-459d-9fc9-e4a69370422f None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:25.337147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d193481-6a42-459d-9fc9-e4a69370422f None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:25.355373 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e93c5f-deec-4789-898a-6d78eaa0e82a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:25.385452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351fd20-e372-46eb-8f5c-7b803b73d4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:25.385452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351fd20-e372-46eb-8f5c-7b803b73d4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:25.385452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351fd20-e372-46eb-8f5c-7b803b73d4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:25.385452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351fd20-e372-46eb-8f5c-7b803b73d4e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:25.385834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351fd20-e372-46eb-8f5c-7b803b73d4e6 None admin] RBAC: Adding query filter params (interface=public, service_id=009e883ebcca4bd8a365d0c212ea2572, region_id=RegionOne) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:25.385834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351fd20-e372-46eb-8f5c-7b803b73d4e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:25.385834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351fd20-e372-46eb-8f5c-7b803b73d4e6 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:25.385834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 392/769] 10.222.0.25 () {56 vars in 1251 bytes} [Tue May 10 21:02:25 2022] GET /identity/v3/endpoints?service_id=009e883ebcca4bd8a365d0c212ea2572&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:25.390728 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351fd20-e372-46eb-8f5c-7b803b73d4e6 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:25.399199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec330285-a398-4a8f-be80-0a91e952b2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:25.400016 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec330285-a398-4a8f-be80-0a91e952b2ed None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:25.400355 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec330285-a398-4a8f-be80-0a91e952b2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:25.400636 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec330285-a398-4a8f-be80-0a91e952b2ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:25.407894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec330285-a398-4a8f-be80-0a91e952b2ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:25.409326 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec330285-a398-4a8f-be80-0a91e952b2ed None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:25.439712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-ec330285-a398-4a8f-be80-0a91e952b2ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:25.439712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:25.439712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:25.439712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:25.439712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:25.439712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:25.439712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:25.439712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:25.439712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:25.439712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:25.439712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:25.439712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:25.439712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:25.439712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:25.439712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:25.441807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:25.441807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:25.441807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:25.441807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:25.441807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:25.441807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:25.441807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:25.441807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:25.441807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:25.441807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:25.441807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:25.441807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:25.441807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:25.441807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:25.441807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:25.441807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:25.441807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:25.444089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:25.444089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:25.444089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:25.444089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:25.444089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:25.444089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:25.444089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:25.444089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:25.450555 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 378/770] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:25.451467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec330285-a398-4a8f-be80-0a91e952b2ed None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:25.496568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351fd20-e372-46eb-8f5c-7b803b73d4e6 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:25.543307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0322814-3456-4c82-a54d-00c626811891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:25.543985 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0322814-3456-4c82-a54d-00c626811891 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:25.544272 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0322814-3456-4c82-a54d-00c626811891 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:25.544551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0322814-3456-4c82-a54d-00c626811891 None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:25.545502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0322814-3456-4c82-a54d-00c626811891 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:25.546896 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0322814-3456-4c82-a54d-00c626811891 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:25.558942 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 393/771] 10.222.0.25 () {56 vars in 1087 bytes} [Tue May 10 21:02:25 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:25.583134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec330285-a398-4a8f-be80-0a91e952b2ed None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:25.626239 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306a9e6-1284-4b4b-98e6-df52c7e167b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:25.626945 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306a9e6-1284-4b4b-98e6-df52c7e167b7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:25.627289 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306a9e6-1284-4b4b-98e6-df52c7e167b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:25.627632 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306a9e6-1284-4b4b-98e6-df52c7e167b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:25.628439 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306a9e6-1284-4b4b-98e6-df52c7e167b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:25.628802 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306a9e6-1284-4b4b-98e6-df52c7e167b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:25.630309 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306a9e6-1284-4b4b-98e6-df52c7e167b7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:25.649227 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 379/772] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:25.654993 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0322814-3456-4c82-a54d-00c626811891 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:25.794363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0322814-3456-4c82-a54d-00c626811891 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:25.829167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c547c-8ec6-4dfe-b3a2-f78abb5eae11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:25.830071 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c547c-8ec6-4dfe-b3a2-f78abb5eae11 None admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:25.830367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c547c-8ec6-4dfe-b3a2-f78abb5eae11 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:25.830654 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c547c-8ec6-4dfe-b3a2-f78abb5eae11 None admin] PATH_INFO: `/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/c4c16a3b07c64a22bfc3df2a5a90c3f3/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:25.832651 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c547c-8ec6-4dfe-b3a2-f78abb5eae11 None admin] RBAC: Authorizing `identity:create_grant(project_id=385eeb55a9ae42eba674de1e83d96e0d, user_id=c4c16a3b07c64a22bfc3df2a5a90c3f3, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:25.834094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c547c-8ec6-4dfe-b3a2-f78abb5eae11 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:25.935945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 394/773] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:02:25 2022] PUT /identity/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/c4c16a3b07c64a22bfc3df2a5a90c3f3/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:02:26.213680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e4858-2f2f-4308-ae93-d3a992fdb9a6 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:26.214722 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e4858-2f2f-4308-ae93-d3a992fdb9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:26.215218 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e4858-2f2f-4308-ae93-d3a992fdb9a6 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:26.217031 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 380/774] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:26.222537 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e4ec2-9516-49d8-aa51-c20985dfe88c None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:26.223087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e4ec2-9516-49d8-aa51-c20985dfe88c None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:26.223584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e4ec2-9516-49d8-aa51-c20985dfe88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:26.241422 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-bb5e4ec2-9516-49d8-aa51-c20985dfe88c None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:26.242969 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-bb5e4ec2-9516-49d8-aa51-c20985dfe88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:26.311801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a14eb-7f34-4355-af37-4abee506db86 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:26.312133 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a14eb-7f34-4355-af37-4abee506db86 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:26.312374 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a14eb-7f34-4355-af37-4abee506db86 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:26.313971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 381/775] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:26.318874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cf681-4c53-405a-ad46-b946ea26c930 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:26.319206 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cf681-4c53-405a-ad46-b946ea26c930 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:26.319711 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cf681-4c53-405a-ad46-b946ea26c930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:26.320704 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 395/776] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:26.343574 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e4ec2-9516-49d8-aa51-c20985dfe88c None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:26.351487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-068cf681-4c53-405a-ad46-b946ea26c930 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:26.354036 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-068cf681-4c53-405a-ad46-b946ea26c930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:26.463670 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 382/777] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:02:26.465425 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8effa-130d-4362-ae81-62657ab63812 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:26.466374 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8effa-130d-4362-ae81-62657ab63812 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:26.466881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8effa-130d-4362-ae81-62657ab63812 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:26.468994 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 383/778] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:26.478896 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec973a-bcd7-4bb7-8c99-227937b16bd3 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:26.478896 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec973a-bcd7-4bb7-8c99-227937b16bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:26.478896 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec973a-bcd7-4bb7-8c99-227937b16bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:26.490256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e4ec2-9516-49d8-aa51-c20985dfe88c None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:26.498879 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-feec973a-bcd7-4bb7-8c99-227937b16bd3 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:26.500540 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-feec973a-bcd7-4bb7-8c99-227937b16bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:26.536400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87896f2a-7efd-417e-8c19-510e58ec876e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:26.537205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87896f2a-7efd-417e-8c19-510e58ec876e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:26.537489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87896f2a-7efd-417e-8c19-510e58ec876e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:26.537820 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87896f2a-7efd-417e-8c19-510e58ec876e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:26.548994 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87896f2a-7efd-417e-8c19-510e58ec876e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:26.557434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-87896f2a-7efd-417e-8c19-510e58ec876e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:02:26.557434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:26.557434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:26.557434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:26.557434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:26.557434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:26.557434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:26.557434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:26.557434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:26.557434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:26.557434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:26.557434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:26.557434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:26.557434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:26.557434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:26.557434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:26.558396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:26.558396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:26.558396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:26.558396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:26.558396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:26.558396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:26.558396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:26.558396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:26.558396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:26.558396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:26.558396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:26.558396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:26.558396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:26.558396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:26.558396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:26.558396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:26.559278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:26.559278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:26.559278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:26.559278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:26.559278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:26.559278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:26.559278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:26.559278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:26.559278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:26.559278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:26.559278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:02:26.559278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:26.559278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 396/779] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:02:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:26.559966 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87896f2a-7efd-417e-8c19-510e58ec876e None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:26.589704 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 384/780] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:02:26.590681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec973a-bcd7-4bb7-8c99-227937b16bd3 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:26.682853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87896f2a-7efd-417e-8c19-510e58ec876e None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:26.703316 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec973a-bcd7-4bb7-8c99-227937b16bd3 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:26.725032 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aadc86-6a88-459f-9628-a7b998199773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:26.726220 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aadc86-6a88-459f-9628-a7b998199773 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:26.726533 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aadc86-6a88-459f-9628-a7b998199773 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:26.726818 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aadc86-6a88-459f-9628-a7b998199773 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:26.738378 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62f559-12b5-46f5-a0e5-217e716f8fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:26.739086 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62f559-12b5-46f5-a0e5-217e716f8fff None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:26.739277 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aadc86-6a88-459f-9628-a7b998199773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:26.739434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62f559-12b5-46f5-a0e5-217e716f8fff None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:26.739622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62f559-12b5-46f5-a0e5-217e716f8fff None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:26.740360 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62f559-12b5-46f5-a0e5-217e716f8fff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:26.740660 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62f559-12b5-46f5-a0e5-217e716f8fff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:26.742140 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62f559-12b5-46f5-a0e5-217e716f8fff None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:26.748593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-99aadc86-6a88-459f-9628-a7b998199773 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:26.748593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:26.748593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:26.748593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:26.748593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:26.748593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:26.748593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:26.748593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:26.748593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:26.748593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:26.748593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:26.748593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:26.748593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:26.748593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:26.748593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:26.748593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:26.750663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:26.750663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:26.750663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:26.750663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:26.750663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:26.750663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:26.750663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:26.750663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:26.750663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:26.750663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:26.750663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:26.750663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:26.750663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:26.750663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:26.750663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:26.750663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:26.752716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:26.752716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:26.752716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:26.752716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:26.752716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:26.752716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:26.752716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:26.752716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:26.752716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:26.752716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:26.752716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:26.752716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:26.753923 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 385/782] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:02:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:26.753923 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62f559-12b5-46f5-a0e5-217e716f8fff None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:26.759427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 397/782] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:02:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:26.759427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aadc86-6a88-459f-9628-a7b998199773 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:26.870484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62f559-12b5-46f5-a0e5-217e716f8fff None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:26.876397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aadc86-6a88-459f-9628-a7b998199773 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:26.909848 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07b19f-578e-421b-953a-1ddb1e6fbdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:26.911103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07b19f-578e-421b-953a-1ddb1e6fbdd8 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:26.911687 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07b19f-578e-421b-953a-1ddb1e6fbdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:26.911911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0685827-334e-4942-bb3e-dd4cadc31519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:26.912379 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07b19f-578e-421b-953a-1ddb1e6fbdd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:26.912744 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0685827-334e-4942-bb3e-dd4cadc31519 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:26.913030 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0685827-334e-4942-bb3e-dd4cadc31519 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:26.913307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0685827-334e-4942-bb3e-dd4cadc31519 None admin] PATH_INFO: `/v3/services/network` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:26.913965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0685827-334e-4942-bb3e-dd4cadc31519 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:26.914256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07b19f-578e-421b-953a-1ddb1e6fbdd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:26.914781 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07b19f-578e-421b-953a-1ddb1e6fbdd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:26.915348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0685827-334e-4942-bb3e-dd4cadc31519 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:26.916749 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07b19f-578e-421b-953a-1ddb1e6fbdd8 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:26.926739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 398/783] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:02:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:26.927930 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07b19f-578e-421b-953a-1ddb1e6fbdd8 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:26.936354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-a0685827-334e-4942-bb3e-dd4cadc31519 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 21:02:26.936354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:26.936354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:26.936354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:26.936354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:26.936354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:26.936354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:26.936354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:26.936354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 21:02:26.936354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:26.936354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:26.936354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:26.936354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:26.936354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:26.936354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:26.936354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:26.936354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:26.937455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:26.937455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:26.937455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:26.937455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:26.937455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:26.937455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:26.937455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:26.937455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:26.937455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:26.937455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:26.937455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:26.937455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:26.937455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:26.937455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:26.937455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:26.937455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:26.938305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:26.938305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:26.938305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:26.938305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:26.938305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:26.938305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:26.938305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:26.938305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:26.938305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:26.938305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:26.938305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:26.938305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:26.938305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 21:02:26.938305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:26.938305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 386/784] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:26 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:26.940584 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0685827-334e-4942-bb3e-dd4cadc31519 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:27.038725 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07b19f-578e-421b-953a-1ddb1e6fbdd8 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:27.071492 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0685827-334e-4942-bb3e-dd4cadc31519 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:27.073658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da86863-258e-4dc6-add7-95931700e199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:27.074732 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da86863-258e-4dc6-add7-95931700e199 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:27.075228 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da86863-258e-4dc6-add7-95931700e199 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:27.075734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da86863-258e-4dc6-add7-95931700e199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:27.086916 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da86863-258e-4dc6-add7-95931700e199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:27.088648 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da86863-258e-4dc6-add7-95931700e199 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:27.107027 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a9ab1-7fcf-4fa6-92db-2b463ab0260e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:27.108134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a9ab1-7fcf-4fa6-92db-2b463ab0260e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:27.108628 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a9ab1-7fcf-4fa6-92db-2b463ab0260e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:27.109112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a9ab1-7fcf-4fa6-92db-2b463ab0260e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:27.110947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-5da86863-258e-4dc6-add7-95931700e199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:27.110947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:27.110947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:27.110947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:27.110947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:27.110947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:27.110947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:27.110947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:27.110947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:27.110947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:27.110947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:27.110947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:27.110947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:27.110947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:27.110947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:27.111847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:27.111847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:27.111847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:27.111847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:27.111847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:27.111847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:27.111847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:27.111847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:27.111847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:27.111847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:27.111847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:27.111847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:27.111847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:27.111847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:27.111847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:27.111847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:27.111847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:27.112768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:27.112768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:27.112768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:27.112768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:27.112768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 399/785] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:27.113455 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da86863-258e-4dc6-add7-95931700e199 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:27.126379 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a9ab1-7fcf-4fa6-92db-2b463ab0260e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:27.128131 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a9ab1-7fcf-4fa6-92db-2b463ab0260e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:27.151650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-164a9ab1-7fcf-4fa6-92db-2b463ab0260e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:27.151650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:27.151650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:27.151650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:27.151650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:27.151650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:27.151650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:27.151650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:27.151650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:27.151650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:27.151650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:27.151650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:27.151650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:27.151650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:27.151650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:27.152629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:27.152629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:27.152629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:27.152629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:27.152629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:27.152629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:27.152629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:27.152629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:27.152629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:27.152629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:27.152629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:27.152629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:27.152629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:27.152629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:27.152629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:27.152629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:27.152629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:27.153640 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:27.153640 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:27.153640 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:27.153640 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:27.156847 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 387/786] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:27.157844 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a9ab1-7fcf-4fa6-92db-2b463ab0260e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:27.229077 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da86863-258e-4dc6-add7-95931700e199 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:27.262598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a9ab1-7fcf-4fa6-92db-2b463ab0260e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:27.264726 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713203d-cb51-4e3b-93b9-03af4465aa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:27.265622 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713203d-cb51-4e3b-93b9-03af4465aa6d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:27.266114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713203d-cb51-4e3b-93b9-03af4465aa6d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:27.266642 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713203d-cb51-4e3b-93b9-03af4465aa6d None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:27.267586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713203d-cb51-4e3b-93b9-03af4465aa6d None admin] RBAC: Adding query filter params (name=network) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:27.268096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713203d-cb51-4e3b-93b9-03af4465aa6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:27.269659 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713203d-cb51-4e3b-93b9-03af4465aa6d None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:27.274938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 400/787] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 10 21:02:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:27.275982 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713203d-cb51-4e3b-93b9-03af4465aa6d None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:27.303203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10228884-0dbf-44d5-a31f-a6cd40b9a95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:27.304364 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10228884-0dbf-44d5-a31f-a6cd40b9a95c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:27.304704 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10228884-0dbf-44d5-a31f-a6cd40b9a95c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:27.304981 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10228884-0dbf-44d5-a31f-a6cd40b9a95c None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:27.305732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10228884-0dbf-44d5-a31f-a6cd40b9a95c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:27.306050 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10228884-0dbf-44d5-a31f-a6cd40b9a95c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:27.307471 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10228884-0dbf-44d5-a31f-a6cd40b9a95c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:27.325920 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 388/788] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:27.326876 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10228884-0dbf-44d5-a31f-a6cd40b9a95c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:27.384284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713203d-cb51-4e3b-93b9-03af4465aa6d None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:27.419758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640c669-fe00-405e-a7d8-bec9ff3e6a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:27.421055 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640c669-fe00-405e-a7d8-bec9ff3e6a27 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:27.421524 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640c669-fe00-405e-a7d8-bec9ff3e6a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:27.421983 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640c669-fe00-405e-a7d8-bec9ff3e6a27 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:27.422966 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640c669-fe00-405e-a7d8-bec9ff3e6a27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:27.423460 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640c669-fe00-405e-a7d8-bec9ff3e6a27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:27.425045 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640c669-fe00-405e-a7d8-bec9ff3e6a27 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:27.426904 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10228884-0dbf-44d5-a31f-a6cd40b9a95c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:27.439090 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 401/789] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:27.440201 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640c669-fe00-405e-a7d8-bec9ff3e6a27 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:27.462892 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4b3fd-d25b-405d-a43b-9a924df35bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:27.463415 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4b3fd-d25b-405d-a43b-9a924df35bcd None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:27.463772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4b3fd-d25b-405d-a43b-9a924df35bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:27.464120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4b3fd-d25b-405d-a43b-9a924df35bcd None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:27.464897 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4b3fd-d25b-405d-a43b-9a924df35bcd None admin] RBAC: Adding query filter params (type=network) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:27.465288 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4b3fd-d25b-405d-a43b-9a924df35bcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:27.466722 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4b3fd-d25b-405d-a43b-9a924df35bcd None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:27.478485 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 389/790] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 10 21:02:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:27.479000 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4b3fd-d25b-405d-a43b-9a924df35bcd None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:27.547251 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640c669-fe00-405e-a7d8-bec9ff3e6a27 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:27.579039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4b3fd-d25b-405d-a43b-9a924df35bcd None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:27.581900 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0e6ab-3e2e-461d-806f-073581890914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:27.582854 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0e6ab-3e2e-461d-806f-073581890914 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:27.583214 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0e6ab-3e2e-461d-806f-073581890914 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:27.583602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0e6ab-3e2e-461d-806f-073581890914 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:27.591598 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0e6ab-3e2e-461d-806f-073581890914 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:27.593184 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0e6ab-3e2e-461d-806f-073581890914 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:27.608696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-0cf0e6ab-3e2e-461d-806f-073581890914 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 21:02:27.608696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:27.608696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:27.608696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:27.608696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:27.608696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:27.608696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:27.608696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:27.608696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:27.608696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:27.608696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:27.608696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:27.608696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:27.608696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:27.608696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:27.608696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:27.609746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:27.609746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:27.609746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:27.609746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:27.609746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:27.609746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:27.609746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:27.609746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:27.609746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:27.609746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:27.609746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:27.609746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:27.609746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:27.609746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:27.609746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:27.609746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:27.609746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:27.609746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:27.610870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:27.610870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:27.610870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:27.610870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:27.610870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:27.610870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:27.610870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:27.610870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:27.610870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 21:02:27.610870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:27.610870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 402/791] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:02:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:27.612155 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0e6ab-3e2e-461d-806f-073581890914 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:27.619285 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbca93a-5fcb-44fc-a2ea-77ca0d2adb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:27.620097 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbca93a-5fcb-44fc-a2ea-77ca0d2adb78 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:27.620376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbca93a-5fcb-44fc-a2ea-77ca0d2adb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:27.620648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbca93a-5fcb-44fc-a2ea-77ca0d2adb78 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:27.628142 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbca93a-5fcb-44fc-a2ea-77ca0d2adb78 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:27.629572 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbca93a-5fcb-44fc-a2ea-77ca0d2adb78 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:27.644383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-0bbca93a-5fcb-44fc-a2ea-77ca0d2adb78 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 21:02:27.644383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:27.644383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:27.644383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:27.644383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:27.644383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:27.644383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:27.644383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:27.644383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:27.644383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:27.644383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:27.644383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:27.644383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:27.644383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:27.644383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:27.644383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:27.646657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:27.646657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:27.646657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:27.646657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:27.646657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:27.646657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:27.646657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:27.646657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:27.646657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:27.646657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:27.646657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:27.646657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:27.646657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:27.646657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:27.646657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:27.646657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:27.646657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:27.646657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:27.649103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:27.649103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:27.649103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:27.649103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:27.649103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:27.649103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:27.649103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:27.649103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:27.649103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 21:02:27.649103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:27.649103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 390/792] 10.222.0.25 () {56 vars in 1117 bytes} [Tue May 10 21:02:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:27.649103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbca93a-5fcb-44fc-a2ea-77ca0d2adb78 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:27.714612 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0e6ab-3e2e-461d-806f-073581890914 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:27.746687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbca93a-5fcb-44fc-a2ea-77ca0d2adb78 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:27.749377 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451fee2-9fe2-45ae-a2a9-46b6a7520897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:27.750041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451fee2-9fe2-45ae-a2a9-46b6a7520897 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:27.750328 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451fee2-9fe2-45ae-a2a9-46b6a7520897 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:27.750638 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451fee2-9fe2-45ae-a2a9-46b6a7520897 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:27.751437 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451fee2-9fe2-45ae-a2a9-46b6a7520897 None admin] RBAC: Adding query filter params (interface=public, service_id=9ee887e38e52458bbacb478dbb9f5a16, region_id=RegionOne) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:27.751751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451fee2-9fe2-45ae-a2a9-46b6a7520897 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:27.753119 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451fee2-9fe2-45ae-a2a9-46b6a7520897 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:27.758893 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 403/793] 10.222.0.25 () {56 vars in 1251 bytes} [Tue May 10 21:02:27 2022] GET /identity/v3/endpoints?service_id=9ee887e38e52458bbacb478dbb9f5a16&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:27.759698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451fee2-9fe2-45ae-a2a9-46b6a7520897 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:27.784769 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd6c91-0843-4898-9ee9-14ac30b012e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:27.785444 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd6c91-0843-4898-9ee9-14ac30b012e4 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:27.785726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd6c91-0843-4898-9ee9-14ac30b012e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:27.785999 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd6c91-0843-4898-9ee9-14ac30b012e4 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:27.786870 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd6c91-0843-4898-9ee9-14ac30b012e4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:27.787177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd6c91-0843-4898-9ee9-14ac30b012e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:27.789154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd6c91-0843-4898-9ee9-14ac30b012e4 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:27.811229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 391/794] 10.222.0.25 () {56 vars in 1135 bytes} [Tue May 10 21:02:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:27.812116 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd6c91-0843-4898-9ee9-14ac30b012e4 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:27.872297 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451fee2-9fe2-45ae-a2a9-46b6a7520897 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:27.909936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc2a7f-7356-417a-9a51-0ae11c563fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:27.910668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc2a7f-7356-417a-9a51-0ae11c563fea None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:27.910958 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc2a7f-7356-417a-9a51-0ae11c563fea None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:27.911238 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc2a7f-7356-417a-9a51-0ae11c563fea None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:27.912104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc2a7f-7356-417a-9a51-0ae11c563fea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:27.912415 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc2a7f-7356-417a-9a51-0ae11c563fea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:27.914801 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc2a7f-7356-417a-9a51-0ae11c563fea None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:27.915694 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd6c91-0843-4898-9ee9-14ac30b012e4 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:27.935649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 404/795] 10.222.0.25 () {56 vars in 1149 bytes} [Tue May 10 21:02:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:27.936551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc2a7f-7356-417a-9a51-0ae11c563fea None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:27.951835 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a55fd-c84c-47fe-949a-1908fd4a58c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:27.952498 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a55fd-c84c-47fe-949a-1908fd4a58c5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:27.952781 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a55fd-c84c-47fe-949a-1908fd4a58c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:27.953058 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a55fd-c84c-47fe-949a-1908fd4a58c5 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:27.953736 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a55fd-c84c-47fe-949a-1908fd4a58c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:27.955113 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a55fd-c84c-47fe-949a-1908fd4a58c5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:27.966608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 392/796] 10.222.0.25 () {56 vars in 1087 bytes} [Tue May 10 21:02:27 2022] GET /identity/v3/services => generated 772 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:27.967607 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a55fd-c84c-47fe-949a-1908fd4a58c5 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:28.045369 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc2a7f-7356-417a-9a51-0ae11c563fea None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:28.081896 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebc836-00ea-48db-9546-d0ec3ff9d620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:28.082745 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebc836-00ea-48db-9546-d0ec3ff9d620 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:28.083035 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebc836-00ea-48db-9546-d0ec3ff9d620 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:28.083314 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebc836-00ea-48db-9546-d0ec3ff9d620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:28.094595 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebc836-00ea-48db-9546-d0ec3ff9d620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:28.095997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebc836-00ea-48db-9546-d0ec3ff9d620 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:28.115174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-d1ebc836-00ea-48db-9546-d0ec3ff9d620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:28.115174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:28.115174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:28.115174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:28.115174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:28.115174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:28.115174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:28.115174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:28.115174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:28.115174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:28.115174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:28.115174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:28.115174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:28.115174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:28.115174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:28.116951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:28.116951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:28.116951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:28.116951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:28.116951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:28.116951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:28.116951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:28.116951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:28.116951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:28.116951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:28.116951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:28.116951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:28.116951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:28.116951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:28.116951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:28.116951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:28.116951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:28.118650 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:28.118650 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:28.118650 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:28.118650 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:28.118650 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 405/797] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:28.118944 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f2588-1a44-4d1f-854f-d0f090c2fcf8 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:28.119026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f2588-1a44-4d1f-854f-d0f090c2fcf8 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:28.119355 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f2588-1a44-4d1f-854f-d0f090c2fcf8 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:28.124684 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 406/798] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:28.124684 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f2588-1a44-4d1f-854f-d0f090c2fcf8 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:28.141140 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a55fd-c84c-47fe-949a-1908fd4a58c5 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:28.189351 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e2ab9-19d7-41fa-93ed-8bdd1b18bca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:28.190165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e2ab9-19d7-41fa-93ed-8bdd1b18bca1 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:28.190468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e2ab9-19d7-41fa-93ed-8bdd1b18bca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:28.191916 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e2ab9-19d7-41fa-93ed-8bdd1b18bca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:28.205410 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e2ab9-19d7-41fa-93ed-8bdd1b18bca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:28.206944 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e2ab9-19d7-41fa-93ed-8bdd1b18bca1 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:28.226490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-fc9e2ab9-19d7-41fa-93ed-8bdd1b18bca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:28.226490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:28.226490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:28.226490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:28.226490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:28.226490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:28.226490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:28.226490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:28.226490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:28.226490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:28.226490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:28.226490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:28.226490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:28.226490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:28.226490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:28.227531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:28.227531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:28.227531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:28.227531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:28.227531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:28.227531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:28.227531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:28.227531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:28.227531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:28.227531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:28.227531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:28.227531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:28.227531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:28.227531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:28.227531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:28.227531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:28.227531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:28.228446 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:28.228446 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:28.228446 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:28.228446 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:28.228446 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 393/799] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:28.233246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e9182-ef51-4d30-a314-1fa2943d4ebc None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:28.233246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e9182-ef51-4d30-a314-1fa2943d4ebc None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:28.233246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e9182-ef51-4d30-a314-1fa2943d4ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:28.242295 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f2588-1a44-4d1f-854f-d0f090c2fcf8 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:28.249758 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-229e9182-ef51-4d30-a314-1fa2943d4ebc None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:28.251738 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-229e9182-ef51-4d30-a314-1fa2943d4ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:28.290317 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f24ad-40b6-4ef3-bf9d-0b5ac363e8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:28.294460 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f24ad-40b6-4ef3-bf9d-0b5ac363e8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:28.294460 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f24ad-40b6-4ef3-bf9d-0b5ac363e8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:28.294460 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f24ad-40b6-4ef3-bf9d-0b5ac363e8f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:28.294460 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f24ad-40b6-4ef3-bf9d-0b5ac363e8f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:28.294460 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f24ad-40b6-4ef3-bf9d-0b5ac363e8f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:28.294460 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f24ad-40b6-4ef3-bf9d-0b5ac363e8f4 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:28.309851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 407/800] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:28.310738 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f24ad-40b6-4ef3-bf9d-0b5ac363e8f4 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:28.353923 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 394/801] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:28.354737 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e9182-ef51-4d30-a314-1fa2943d4ebc None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:28.454805 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f24ad-40b6-4ef3-bf9d-0b5ac363e8f4 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:28.468261 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e9182-ef51-4d30-a314-1fa2943d4ebc None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:28.492775 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6a004-a29b-487f-9009-fd7f88914af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:28.493594 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6a004-a29b-487f-9009-fd7f88914af1 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:28.494194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6a004-a29b-487f-9009-fd7f88914af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:28.494506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6a004-a29b-487f-9009-fd7f88914af1 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:28.495512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6a004-a29b-487f-9009-fd7f88914af1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:28.495821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6a004-a29b-487f-9009-fd7f88914af1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:28.497894 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6a004-a29b-487f-9009-fd7f88914af1 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:28.501276 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e68789-3208-4ff8-bcc8-4230bc0a83df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:28.502069 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e68789-3208-4ff8-bcc8-4230bc0a83df None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:28.502352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e68789-3208-4ff8-bcc8-4230bc0a83df None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:28.502672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e68789-3208-4ff8-bcc8-4230bc0a83df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:28.509987 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e68789-3208-4ff8-bcc8-4230bc0a83df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:28.514613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 408/802] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:28.514743 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e68789-3208-4ff8-bcc8-4230bc0a83df None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:28.514821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6a004-a29b-487f-9009-fd7f88914af1 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:28.527347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-97e68789-3208-4ff8-bcc8-4230bc0a83df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:28.527347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:28.527347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:28.527347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:28.527347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:28.527347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:28.527347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:28.527347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:28.527347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:28.527347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:28.527347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:28.527347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:28.527347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:28.527347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:28.527347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:28.528442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:28.528442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:28.528442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:28.528442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:28.528442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:28.528442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:28.528442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:28.528442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:28.528442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:28.528442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:28.528442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:28.528442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:28.528442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:28.528442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:28.528442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:28.528442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:28.528442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:28.529356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:28.529356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:28.529356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:28.529356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:28.529356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:28.529356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:28.529356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:28.529356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:28.529356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 395/803] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:28.529847 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c67e8e-824b-428a-a9be-0ccdd3d3175d None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:28.530016 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c67e8e-824b-428a-a9be-0ccdd3d3175d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:28.530306 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c67e8e-824b-428a-a9be-0ccdd3d3175d None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:28.531706 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 396/804] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:28.536201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c67e8e-824b-428a-a9be-0ccdd3d3175d None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:28.627560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6a004-a29b-487f-9009-fd7f88914af1 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:28.635077 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c67e8e-824b-428a-a9be-0ccdd3d3175d None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:28.662097 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846af278-0332-470d-89d9-97f5fae4ce20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:28.663625 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846af278-0332-470d-89d9-97f5fae4ce20 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:28.663905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846af278-0332-470d-89d9-97f5fae4ce20 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:28.664175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846af278-0332-470d-89d9-97f5fae4ce20 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:28.664825 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846af278-0332-470d-89d9-97f5fae4ce20 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:28.666170 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846af278-0332-470d-89d9-97f5fae4ce20 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:28.669039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5672e-e14a-47ec-bf9f-9fbfec281920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:28.669837 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5672e-e14a-47ec-bf9f-9fbfec281920 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:28.670379 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5672e-e14a-47ec-bf9f-9fbfec281920 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:28.670685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5672e-e14a-47ec-bf9f-9fbfec281920 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:28.677268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5672e-e14a-47ec-bf9f-9fbfec281920 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:28.679480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-846af278-0332-470d-89d9-97f5fae4ce20 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 21:02:28.679480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:28.679480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:28.679480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:28.679480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:28.679480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:28.679480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:28.679480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:28.679480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 21:02:28.679480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:28.679480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:28.679480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:28.679480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:28.679480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:28.679480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:28.679480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:28.680488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:28.680488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:28.680488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:28.680488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:28.680488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:28.680488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:28.680488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:28.680488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:28.680488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:28.680488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:28.680488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:28.680488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:28.680488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:28.680488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:28.680488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:28.680488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:28.681322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:28.681322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:28.681322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:28.681322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:28.681322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:28.681322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:28.681322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:28.681322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:28.681322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:28.681322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:28.681322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:28.681322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:28.681322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:28.681322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 21:02:28.681322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:28.682122 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5672e-e14a-47ec-bf9f-9fbfec281920 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:28.682194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 409/805] 10.222.0.25 () {56 vars in 1129 bytes} [Tue May 10 21:02:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:28.682194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846af278-0332-470d-89d9-97f5fae4ce20 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:28.698034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-00b5672e-e14a-47ec-bf9f-9fbfec281920 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:28.698034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:28.698034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:28.698034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:28.698034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:28.698034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:28.698034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:28.698034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:28.698034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:28.698034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:28.698034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:28.698034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:28.698034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:28.698034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:28.698034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:28.699035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:28.699035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:28.699035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:28.699035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:28.699035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:28.699035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:28.699035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:28.699035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:28.699035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:28.699035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:28.699035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:28.699035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:28.699035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:28.699035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:28.699035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:28.699035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:28.699035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:28.700056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:28.700056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:28.700056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:28.700056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:28.700056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:28.700056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:28.700056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:28.700056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:28.700056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 397/806] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:28.700558 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abac04-93c8-4a83-85ea-48642f880eea None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:28.701103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abac04-93c8-4a83-85ea-48642f880eea None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:28.701103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abac04-93c8-4a83-85ea-48642f880eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:28.721068 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-70abac04-93c8-4a83-85ea-48642f880eea None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:28.722254 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-70abac04-93c8-4a83-85ea-48642f880eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:28.785128 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846af278-0332-470d-89d9-97f5fae4ce20 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:28.794638 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 398/807] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:28.794638 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abac04-93c8-4a83-85ea-48642f880eea None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:28.827377 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c150f-397d-41c9-bea1-8d80ac59b11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:28.828045 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c150f-397d-41c9-bea1-8d80ac59b11e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:28.828329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c150f-397d-41c9-bea1-8d80ac59b11e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:28.828612 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c150f-397d-41c9-bea1-8d80ac59b11e None admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:28.829403 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c150f-397d-41c9-bea1-8d80ac59b11e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:28.829748 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c150f-397d-41c9-bea1-8d80ac59b11e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:28.831166 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c150f-397d-41c9-bea1-8d80ac59b11e None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:28.850027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 410/808] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:28.850027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c150f-397d-41c9-bea1-8d80ac59b11e None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:28.903818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abac04-93c8-4a83-85ea-48642f880eea None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:28.938280 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195bc36-25e1-4ddc-802c-b40e6fd34855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:28.938981 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195bc36-25e1-4ddc-802c-b40e6fd34855 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:28.939270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195bc36-25e1-4ddc-802c-b40e6fd34855 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:28.939554 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195bc36-25e1-4ddc-802c-b40e6fd34855 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:28.940260 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195bc36-25e1-4ddc-802c-b40e6fd34855 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:28.940569 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195bc36-25e1-4ddc-802c-b40e6fd34855 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:28.941934 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195bc36-25e1-4ddc-802c-b40e6fd34855 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:28.951573 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 399/809] 10.222.0.25 () {56 vars in 1124 bytes} [Tue May 10 21:02:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:28.951573 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195bc36-25e1-4ddc-802c-b40e6fd34855 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:28.954083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c150f-397d-41c9-bea1-8d80ac59b11e None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:28.987220 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1684dea-7dd5-4586-ae6c-3cc70a5f8a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:28.987886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1684dea-7dd5-4586-ae6c-3cc70a5f8a40 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:28.988172 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1684dea-7dd5-4586-ae6c-3cc70a5f8a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:28.988446 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1684dea-7dd5-4586-ae6c-3cc70a5f8a40 None admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:28.989228 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1684dea-7dd5-4586-ae6c-3cc70a5f8a40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:28.989536 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1684dea-7dd5-4586-ae6c-3cc70a5f8a40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:28.991197 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1684dea-7dd5-4586-ae6c-3cc70a5f8a40 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:29.002927 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 411/810] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:29.003997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1684dea-7dd5-4586-ae6c-3cc70a5f8a40 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:29.049354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195bc36-25e1-4ddc-802c-b40e6fd34855 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:29.083993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ebdfb-5727-4edc-a9cd-0ba99a52c1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:29.085335 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ebdfb-5727-4edc-a9cd-0ba99a52c1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:29.085626 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ebdfb-5727-4edc-a9cd-0ba99a52c1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:29.085904 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ebdfb-5727-4edc-a9cd-0ba99a52c1b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:29.095798 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ebdfb-5727-4edc-a9cd-0ba99a52c1b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:29.103965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-476ebdfb-5727-4edc-a9cd-0ba99a52c1b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:02:29.103965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:29.103965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:29.103965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:29.103965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:29.103965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:29.103965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:29.103965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:29.103965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:29.103965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:29.103965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:29.103965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:29.103965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:29.103965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:29.103965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:29.103965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:29.105136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:29.105136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:29.105136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:29.105136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:29.105136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:29.105136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:29.105136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:29.105136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:29.105136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:29.105136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:29.105136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:29.105136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:29.105136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:29.105136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:29.105136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:29.105136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:29.106195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:29.106195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:29.106195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:29.106195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:29.106195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:29.106195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:29.106195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:29.106195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:29.106195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:29.106195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:29.106195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:02:29.106195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:29.106195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 400/811] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:02:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:29.106195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ebdfb-5727-4edc-a9cd-0ba99a52c1b0 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:29.118903 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1684dea-7dd5-4586-ae6c-3cc70a5f8a40 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:29.155632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb66e37-b201-4009-9d4b-5dcdd70f8696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:29.156456 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb66e37-b201-4009-9d4b-5dcdd70f8696 None admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:29.156739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb66e37-b201-4009-9d4b-5dcdd70f8696 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:29.157017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb66e37-b201-4009-9d4b-5dcdd70f8696 None admin] PATH_INFO: `/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/76040882d4374087bb7458fd8b5c1d8d/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:29.159027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb66e37-b201-4009-9d4b-5dcdd70f8696 None admin] RBAC: Authorizing `identity:create_grant(project_id=385eeb55a9ae42eba674de1e83d96e0d, user_id=76040882d4374087bb7458fd8b5c1d8d, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:29.160458 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb66e37-b201-4009-9d4b-5dcdd70f8696 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:29.205023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ebdfb-5727-4edc-a9cd-0ba99a52c1b0 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:29.226422 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 412/812] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:02:29 2022] PUT /identity/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/76040882d4374087bb7458fd8b5c1d8d/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:02:29.227709 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb66e37-b201-4009-9d4b-5dcdd70f8696 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:29.240517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbd730-54dc-406e-8b83-1771f7ac9f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:29.241997 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbd730-54dc-406e-8b83-1771f7ac9f92 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:29.241997 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbd730-54dc-406e-8b83-1771f7ac9f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:29.242268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbd730-54dc-406e-8b83-1771f7ac9f92 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:29.243045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbd730-54dc-406e-8b83-1771f7ac9f92 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:29.243356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbd730-54dc-406e-8b83-1771f7ac9f92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:29.244855 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbd730-54dc-406e-8b83-1771f7ac9f92 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:29.254712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 401/813] 10.222.0.25 () {56 vars in 1124 bytes} [Tue May 10 21:02:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:29.254712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbd730-54dc-406e-8b83-1771f7ac9f92 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:29.368672 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb66e37-b201-4009-9d4b-5dcdd70f8696 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:29.374171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbd730-54dc-406e-8b83-1771f7ac9f92 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:29.407286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f71d35-9795-49a6-b48e-23871855f0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:29.408167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f71d35-9795-49a6-b48e-23871855f0b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:29.408543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f71d35-9795-49a6-b48e-23871855f0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:29.408824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f71d35-9795-49a6-b48e-23871855f0b8 None admin] PATH_INFO: `/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/c0fc3052af194b48b7ce036ff605ff25/roles/d09c313a1a354ea68cf1013629a4a584` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:29.425826 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87025ec7-7bba-4845-9ee0-e259f3eeb748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:29.426549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87025ec7-7bba-4845-9ee0-e259f3eeb748 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:29.426832 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87025ec7-7bba-4845-9ee0-e259f3eeb748 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:29.427147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87025ec7-7bba-4845-9ee0-e259f3eeb748 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:29.427932 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87025ec7-7bba-4845-9ee0-e259f3eeb748 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:29.428806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87025ec7-7bba-4845-9ee0-e259f3eeb748 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:29.430177 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f71d35-9795-49a6-b48e-23871855f0b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=385eeb55a9ae42eba674de1e83d96e0d, user_id=c0fc3052af194b48b7ce036ff605ff25, role_id=d09c313a1a354ea68cf1013629a4a584)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:29.430363 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87025ec7-7bba-4845-9ee0-e259f3eeb748 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:29.432229 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f71d35-9795-49a6-b48e-23871855f0b8 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:29.439291 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 402/814] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:02:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:29.439898 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87025ec7-7bba-4845-9ee0-e259f3eeb748 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:29.486553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 413/815] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:02:29 2022] PUT /identity/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/c0fc3052af194b48b7ce036ff605ff25/roles/d09c313a1a354ea68cf1013629a4a584 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:02:29.487850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f71d35-9795-49a6-b48e-23871855f0b8 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:29.558234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87025ec7-7bba-4845-9ee0-e259f3eeb748 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:29.598651 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbd57c-d4ec-4287-b669-7cb857faf4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:29.599333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbd57c-d4ec-4287-b669-7cb857faf4b6 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:29.599622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbd57c-d4ec-4287-b669-7cb857faf4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:29.599906 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbd57c-d4ec-4287-b669-7cb857faf4b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:29.601817 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbd57c-d4ec-4287-b669-7cb857faf4b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:29.603612 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbd57c-d4ec-4287-b669-7cb857faf4b6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:29.668770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f71d35-9795-49a6-b48e-23871855f0b8 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:29.706978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa133cdf-de83-415a-bc9e-05c3aad3d994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:29.707859 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa133cdf-de83-415a-bc9e-05c3aad3d994 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:29.708147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa133cdf-de83-415a-bc9e-05c3aad3d994 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:29.708425 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa133cdf-de83-415a-bc9e-05c3aad3d994 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:29.724286 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 403/816] 10.222.0.25 () {60 vars in 1144 bytes} [Tue May 10 21:02:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:02:29.728703 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa133cdf-de83-415a-bc9e-05c3aad3d994 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:29.730389 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa133cdf-de83-415a-bc9e-05c3aad3d994 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:29.750588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-aa133cdf-de83-415a-bc9e-05c3aad3d994 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:29.750588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:29.750588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:29.750588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:29.750588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:29.750588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:29.750588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:29.750588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:29.750588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:29.750588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:29.750588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:29.750588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:29.750588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:29.750588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:29.750588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:29.751564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:29.751564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:29.751564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:29.751564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:29.751564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:29.751564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:29.751564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:29.751564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:29.751564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:29.751564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:29.751564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:29.751564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:29.751564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:29.751564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:29.751564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:29.751564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:29.751564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:29.752892 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:29.752892 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:29.752892 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:29.752892 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:29.752892 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 414/817] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:29.758333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbd57c-d4ec-4287-b669-7cb857faf4b6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:29.895556 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbd57c-d4ec-4287-b669-7cb857faf4b6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:29.937195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1276d20-b1b5-4ac5-a5d9-f1a5f974c7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:29.937195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1276d20-b1b5-4ac5-a5d9-f1a5f974c7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:29.937448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1276d20-b1b5-4ac5-a5d9-f1a5f974c7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:29.937520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1276d20-b1b5-4ac5-a5d9-f1a5f974c7d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:29.938250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1276d20-b1b5-4ac5-a5d9-f1a5f974c7d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:29.938598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1276d20-b1b5-4ac5-a5d9-f1a5f974c7d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:29.940290 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1276d20-b1b5-4ac5-a5d9-f1a5f974c7d3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:29.953539 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 404/818] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:29.958610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa133cdf-de83-415a-bc9e-05c3aad3d994 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:30.080075 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa133cdf-de83-415a-bc9e-05c3aad3d994 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:30.121108 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d88719-639b-4861-b413-92f9709429be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:30.121925 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88719-639b-4861-b413-92f9709429be None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:30.122212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88719-639b-4861-b413-92f9709429be None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:30.122517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88719-639b-4861-b413-92f9709429be None admin] PATH_INFO: `/v3/users/nova` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:30.130468 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d88719-639b-4861-b413-92f9709429be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:30.132733 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d88719-639b-4861-b413-92f9709429be None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:30.153419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-61d88719-639b-4861-b413-92f9709429be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 21:02:30.153419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:30.153419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:30.153419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:30.153419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:30.153419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:30.153419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:30.153419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:30.153419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:30.153419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:30.153419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:30.153419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:30.153419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:30.153419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:30.153419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:30.153419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:30.154414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:30.154414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:30.154414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:30.154414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:30.154414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:30.154414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:30.154414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:30.154414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:30.154414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:30.154414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:30.154414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:30.154414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:30.154414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:30.154414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:30.154414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:30.154414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:30.154414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:30.154414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:30.155404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:30.155404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:30.155404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:30.155404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:30.155404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:30.155404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:30.155404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:30.155404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:30.155404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 21:02:30.155404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:30.160278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 415/819] 10.222.0.25 () {56 vars in 1093 bytes} [Tue May 10 21:02:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:30.167558 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1276d20-b1b5-4ac5-a5d9-f1a5f974c7d3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:30.303964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1276d20-b1b5-4ac5-a5d9-f1a5f974c7d3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:30.345528 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65eaa5-2d96-4ff0-9707-e8550cabdc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:30.346210 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65eaa5-2d96-4ff0-9707-e8550cabdc04 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:30.346520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65eaa5-2d96-4ff0-9707-e8550cabdc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:30.346802 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65eaa5-2d96-4ff0-9707-e8550cabdc04 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:30.347654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65eaa5-2d96-4ff0-9707-e8550cabdc04 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:30.347967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65eaa5-2d96-4ff0-9707-e8550cabdc04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:30.349376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65eaa5-2d96-4ff0-9707-e8550cabdc04 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:30.372008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 405/820] 10.222.0.25 () {56 vars in 1133 bytes} [Tue May 10 21:02:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:30.379622 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d88719-639b-4861-b413-92f9709429be None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:30.437027 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c43575-4749-4141-bac7-d5231e50ee5a None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:30.437999 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c43575-4749-4141-bac7-d5231e50ee5a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:30.438514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c43575-4749-4141-bac7-d5231e50ee5a None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:30.441469 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 406/821] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:02:30.446551 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a4743-8dcd-4bed-b0b8-15c324269c41 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:30.447063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a4743-8dcd-4bed-b0b8-15c324269c41 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:30.447513 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a4743-8dcd-4bed-b0b8-15c324269c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:30.483642 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-724a4743-8dcd-4bed-b0b8-15c324269c41 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:30.485189 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-724a4743-8dcd-4bed-b0b8-15c324269c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:30.511019 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d88719-639b-4861-b413-92f9709429be None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:30.560736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae02929-67d7-46b6-93e8-598ceeae0cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:30.561321 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae02929-67d7-46b6-93e8-598ceeae0cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:30.561601 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae02929-67d7-46b6-93e8-598ceeae0cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:30.561877 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae02929-67d7-46b6-93e8-598ceeae0cb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:30.586554 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 407/822] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:30.605632 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a4743-8dcd-4bed-b0b8-15c324269c41 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:30.704514 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae02929-67d7-46b6-93e8-598ceeae0cb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:30.705981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae02929-67d7-46b6-93e8-598ceeae0cb0 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:30.708471 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a4743-8dcd-4bed-b0b8-15c324269c41 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:30.745754 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc3f67-6213-44b9-8484-12631982c725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:30.746988 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc3f67-6213-44b9-8484-12631982c725 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:30.747481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc3f67-6213-44b9-8484-12631982c725 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:30.747958 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc3f67-6213-44b9-8484-12631982c725 None admin] PATH_INFO: `/v3/services/network` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:30.749263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc3f67-6213-44b9-8484-12631982c725 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:30.750863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc3f67-6213-44b9-8484-12631982c725 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:30.765427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-ddbc3f67-6213-44b9-8484-12631982c725 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 21:02:30.765427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:30.765427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:30.765427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:30.765427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:30.765427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:30.765427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:30.765427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:30.765427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 21:02:30.765427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:30.765427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:30.765427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:30.765427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:30.765427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:30.765427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:30.765427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:30.765427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:30.766478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:30.766478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:30.766478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:30.766478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:30.766478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:30.766478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:30.766478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:30.766478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:30.766478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:30.766478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:30.766478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:30.766478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:30.766478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:30.766478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:30.766478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:30.766478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:30.767383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:30.767383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:30.767383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:30.767383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:30.767383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:30.767383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:30.767383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:30.767383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:30.767383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:30.767383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:30.767383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:30.767383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:30.767383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 21:02:30.767383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:30.774911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 408/823] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:30 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:30.777674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc3f67-6213-44b9-8484-12631982c725 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:30.866334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 416/824] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:02:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 21:02:30.871765 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae02929-67d7-46b6-93e8-598ceeae0cb0 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:30.948833 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc3f67-6213-44b9-8484-12631982c725 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:30.986788 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cc4d5-8fef-4e53-b73a-59b256e53805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:30.987473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cc4d5-8fef-4e53-b73a-59b256e53805 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:30.987760 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cc4d5-8fef-4e53-b73a-59b256e53805 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:30.988038 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cc4d5-8fef-4e53-b73a-59b256e53805 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:30.988746 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25cc4d5-8fef-4e53-b73a-59b256e53805 None admin] RBAC: Adding query filter params (name=network) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:30.989054 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25cc4d5-8fef-4e53-b73a-59b256e53805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:30.990408 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25cc4d5-8fef-4e53-b73a-59b256e53805 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:31.002712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 409/825] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 10 21:02:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:31.011658 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cc4d5-8fef-4e53-b73a-59b256e53805 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:31.105235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae02929-67d7-46b6-93e8-598ceeae0cb0 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:31.112818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cc4d5-8fef-4e53-b73a-59b256e53805 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:31.148618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c30b7-0cc5-4bfd-9308-d0040fbc0558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:31.149308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c30b7-0cc5-4bfd-9308-d0040fbc0558 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:31.149596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c30b7-0cc5-4bfd-9308-d0040fbc0558 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:31.149876 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c30b7-0cc5-4bfd-9308-d0040fbc0558 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:31.150636 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c30b7-0cc5-4bfd-9308-d0040fbc0558 None admin] RBAC: Adding query filter params (type=network) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:31.150951 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c30b7-0cc5-4bfd-9308-d0040fbc0558 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:31.152360 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c30b7-0cc5-4bfd-9308-d0040fbc0558 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:31.158287 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 410/826] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 10 21:02:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:31.164339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c30b7-0cc5-4bfd-9308-d0040fbc0558 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:31.183443 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f14f0c-73d6-4d05-9e59-bf581c3a032e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:31.184726 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f14f0c-73d6-4d05-9e59-bf581c3a032e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:31.185013 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f14f0c-73d6-4d05-9e59-bf581c3a032e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:31.185292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f14f0c-73d6-4d05-9e59-bf581c3a032e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:31.196713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f14f0c-73d6-4d05-9e59-bf581c3a032e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:31.198329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f14f0c-73d6-4d05-9e59-bf581c3a032e None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:31.217928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-10f14f0c-73d6-4d05-9e59-bf581c3a032e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:31.217928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:31.217928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:31.217928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:31.217928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:31.217928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:31.217928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:31.217928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:31.217928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:31.217928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:31.217928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:31.217928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:31.217928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:31.217928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:31.217928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:31.218911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:31.218911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:31.218911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:31.218911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:31.218911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:31.218911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:31.218911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:31.218911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:31.218911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:31.218911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:31.218911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:31.218911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:31.218911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:31.218911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:31.218911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:31.218911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:31.218911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:31.220417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:31.220417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:31.220417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:31.220417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:31.220417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 417/827] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:31.226151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f14f0c-73d6-4d05-9e59-bf581c3a032e None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:31.363286 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c30b7-0cc5-4bfd-9308-d0040fbc0558 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:31.416138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f14f0c-73d6-4d05-9e59-bf581c3a032e None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:31.429754 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778aacc-9a56-42a4-b35c-135d4ddec22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:31.430426 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778aacc-9a56-42a4-b35c-135d4ddec22c None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:31.430739 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778aacc-9a56-42a4-b35c-135d4ddec22c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:31.431020 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778aacc-9a56-42a4-b35c-135d4ddec22c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:31.431780 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778aacc-9a56-42a4-b35c-135d4ddec22c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:31.433139 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778aacc-9a56-42a4-b35c-135d4ddec22c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:31.468834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6e2e0-cffa-411d-ad06-949678fe65ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:31.469864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6e2e0-cffa-411d-ad06-949678fe65ea None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:31.470352 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6e2e0-cffa-411d-ad06-949678fe65ea None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:31.470862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6e2e0-cffa-411d-ad06-949678fe65ea None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:31.471783 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6e2e0-cffa-411d-ad06-949678fe65ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:31.472447 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6e2e0-cffa-411d-ad06-949678fe65ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:31.474017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6e2e0-cffa-411d-ad06-949678fe65ea None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:31.487639 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 418/828] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:31.495189 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6e2e0-cffa-411d-ad06-949678fe65ea None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:31.529747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 411/829] 10.222.0.25 () {60 vars in 1144 bytes} [Tue May 10 21:02:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:02:31.617920 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6e2e0-cffa-411d-ad06-949678fe65ea None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:31.659515 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28ba00-b4b3-4b61-b5b5-a6aae41e985d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:31.660630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28ba00-b4b3-4b61-b5b5-a6aae41e985d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:31.661154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28ba00-b4b3-4b61-b5b5-a6aae41e985d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:31.661618 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28ba00-b4b3-4b61-b5b5-a6aae41e985d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:31.670166 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28ba00-b4b3-4b61-b5b5-a6aae41e985d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:31.671958 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28ba00-b4b3-4b61-b5b5-a6aae41e985d None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:31.687557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-1d28ba00-b4b3-4b61-b5b5-a6aae41e985d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:31.687557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:31.687557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:31.687557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:31.687557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:31.687557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:31.687557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:31.687557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:31.687557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:31.687557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:31.687557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:31.687557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:31.687557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:31.687557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:31.687557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:31.688521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:31.688521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:31.688521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:31.688521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:31.688521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:31.688521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:31.688521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:31.688521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:31.688521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:31.688521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:31.688521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:31.688521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:31.688521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:31.688521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:31.688521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:31.688521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:31.688521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:31.689430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:31.689430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:31.689430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:31.689430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:31.689430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:31.689430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:31.689430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:31.689430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:31.691797 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 419/830] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:31.698593 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778aacc-9a56-42a4-b35c-135d4ddec22c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:31.813360 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778aacc-9a56-42a4-b35c-135d4ddec22c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:31.821465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729865ba-eefc-4392-81ed-b9ebbe096752 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:31.821996 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729865ba-eefc-4392-81ed-b9ebbe096752 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:31.822452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729865ba-eefc-4392-81ed-b9ebbe096752 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:31.824275 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 420/831] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:31.831114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c03f1c-c725-465b-bb2b-a1c412617def None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:31.831687 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c03f1c-c725-465b-bb2b-a1c412617def None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:31.832144 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c03f1c-c725-465b-bb2b-a1c412617def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:31.858319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-02c03f1c-c725-465b-bb2b-a1c412617def None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:31.859582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-02c03f1c-c725-465b-bb2b-a1c412617def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:31.888193 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b7dde-2a8a-4489-94a1-304ded86c78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:31.889229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b7dde-2a8a-4489-94a1-304ded86c78f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:31.889726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b7dde-2a8a-4489-94a1-304ded86c78f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:31.890206 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b7dde-2a8a-4489-94a1-304ded86c78f None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:31.891248 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b7dde-2a8a-4489-94a1-304ded86c78f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:31.891761 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b7dde-2a8a-4489-94a1-304ded86c78f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:31.893421 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b7dde-2a8a-4489-94a1-304ded86c78f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:31.910664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 412/832] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:31.917329 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b7dde-2a8a-4489-94a1-304ded86c78f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:31.955870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 421/833] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:02:31.980854 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c03f1c-c725-465b-bb2b-a1c412617def None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:32.046519 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b7dde-2a8a-4489-94a1-304ded86c78f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:32.093719 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4e69a-8d0c-41a7-b232-f149479b32fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:32.093719 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4e69a-8d0c-41a7-b232-f149479b32fd None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:32.093989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4e69a-8d0c-41a7-b232-f149479b32fd None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:32.094061 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4e69a-8d0c-41a7-b232-f149479b32fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:32.094928 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4e69a-8d0c-41a7-b232-f149479b32fd None admin] RBAC: Adding query filter params (role.id=5cd001edc58744738aa57180c0be68a9, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=c4c16a3b07c64a22bfc3df2a5a90c3f3) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:32.095241 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4e69a-8d0c-41a7-b232-f149479b32fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:32.096974 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4e69a-8d0c-41a7-b232-f149479b32fd None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:32.104206 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c03f1c-c725-465b-bb2b-a1c412617def None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:32.105112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 413/834] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:02:31 2022] GET /identity/v3/role_assignments?user.id=c4c16a3b07c64a22bfc3df2a5a90c3f3&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=5cd001edc58744738aa57180c0be68a9 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:32.148254 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb1d11-e45e-4072-8238-4aacf83902ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:32.149821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb1d11-e45e-4072-8238-4aacf83902ad None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:32.150346 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb1d11-e45e-4072-8238-4aacf83902ad None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:32.150864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb1d11-e45e-4072-8238-4aacf83902ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:32.163746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb1d11-e45e-4072-8238-4aacf83902ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:32.172489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-c8bb1d11-e45e-4072-8238-4aacf83902ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:02:32.172489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:32.172489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:32.172489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:32.172489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:32.172489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:32.172489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:32.172489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:32.172489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:32.172489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:32.172489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:32.172489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:32.172489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:32.172489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:32.172489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:32.172489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:32.173527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:32.173527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:32.173527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:32.173527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:32.173527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:32.173527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:32.173527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:32.173527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:32.173527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:32.173527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:32.173527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:32.173527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:32.173527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:32.173527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:32.173527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:32.173527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:32.174428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:32.174428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:32.174428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:32.174428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:32.174428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:32.174428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:32.174428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:32.174428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:32.174428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:32.174428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:32.174428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:02:32.174428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:32.177499 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 422/835] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:02:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:32.183596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4e69a-8d0c-41a7-b232-f149479b32fd None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:32.302481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4e69a-8d0c-41a7-b232-f149479b32fd None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:32.343506 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c9fcf-5bea-4ee5-9854-cb33a5bb48f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:32.344574 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c9fcf-5bea-4ee5-9854-cb33a5bb48f8 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:32.345086 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c9fcf-5bea-4ee5-9854-cb33a5bb48f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:32.345594 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c9fcf-5bea-4ee5-9854-cb33a5bb48f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:32.346652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c9fcf-5bea-4ee5-9854-cb33a5bb48f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:32.347183 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c9fcf-5bea-4ee5-9854-cb33a5bb48f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:32.348907 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c9fcf-5bea-4ee5-9854-cb33a5bb48f8 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:32.359761 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 414/836] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:02:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:32.364655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb1d11-e45e-4072-8238-4aacf83902ad None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:32.450925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b380b02-0051-40c2-841a-11c4b3c82ebf None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:32.451135 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b380b02-0051-40c2-841a-11c4b3c82ebf None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:32.451440 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b380b02-0051-40c2-841a-11c4b3c82ebf None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:32.453022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 415/837] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:02:32.458035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44407221-85c2-406a-92cd-83942b5a4eeb None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:32.458327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44407221-85c2-406a-92cd-83942b5a4eeb None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:32.458694 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44407221-85c2-406a-92cd-83942b5a4eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:32.473168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb1d11-e45e-4072-8238-4aacf83902ad None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:32.478617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-44407221-85c2-406a-92cd-83942b5a4eeb None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:32.479872 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-44407221-85c2-406a-92cd-83942b5a4eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:32.510548 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9aeee-9eb7-4307-9b62-78200a6b25e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:32.511663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9aeee-9eb7-4307-9b62-78200a6b25e0 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:32.512096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9aeee-9eb7-4307-9b62-78200a6b25e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:32.512521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9aeee-9eb7-4307-9b62-78200a6b25e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:32.525686 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9aeee-9eb7-4307-9b62-78200a6b25e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:32.527629 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9aeee-9eb7-4307-9b62-78200a6b25e0 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:32.546211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-dfd9aeee-9eb7-4307-9b62-78200a6b25e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:32.546211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:32.546211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:32.546211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:32.546211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:32.546211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:32.546211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:32.546211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:32.546211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:32.546211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:32.546211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:32.546211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:32.546211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:32.546211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:32.546211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:32.547205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:32.547205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:32.547205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:32.547205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:32.547205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:32.547205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:32.547205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:32.547205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:32.547205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:32.547205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:32.547205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:32.547205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:32.547205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:32.547205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:32.547205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:32.547205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:32.547205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:32.548116 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:32.548116 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:32.548116 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:32.548116 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:32.548116 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 423/838] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:32.549068 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cddec-76af-4053-86b3-7364c4b7b868 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:32.549408 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cddec-76af-4053-86b3-7364c4b7b868 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:32.549661 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cddec-76af-4053-86b3-7364c4b7b868 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:32.551058 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 424/839] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:32.555258 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cddec-76af-4053-86b3-7364c4b7b868 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:32.560187 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 416/840] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:02:32.561390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117c3a-9c7f-41e8-a20a-009189cc4f03 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:32.561690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117c3a-9c7f-41e8-a20a-009189cc4f03 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:32.561970 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117c3a-9c7f-41e8-a20a-009189cc4f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:32.586952 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-24117c3a-9c7f-41e8-a20a-009189cc4f03 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:32.588138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-24117c3a-9c7f-41e8-a20a-009189cc4f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:32.653549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 417/841] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:32.654217 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24117c3a-9c7f-41e8-a20a-009189cc4f03 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:32.677108 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cddec-76af-4053-86b3-7364c4b7b868 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:32.715899 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4aaea4-da71-4668-9f08-c2fa9afb268a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:32.716490 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aaea4-da71-4668-9f08-c2fa9afb268a None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:32.716778 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aaea4-da71-4668-9f08-c2fa9afb268a None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:32.717054 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aaea4-da71-4668-9f08-c2fa9afb268a None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:32.717779 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4aaea4-da71-4668-9f08-c2fa9afb268a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:32.718087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4aaea4-da71-4668-9f08-c2fa9afb268a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:32.719476 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4aaea4-da71-4668-9f08-c2fa9afb268a None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:32.731321 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 425/842] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:32.732224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4aaea4-da71-4668-9f08-c2fa9afb268a None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:32.757671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24117c3a-9c7f-41e8-a20a-009189cc4f03 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:32.793365 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e012cb-d901-4331-b62e-79e1b3c9677e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:32.794172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e012cb-d901-4331-b62e-79e1b3c9677e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:32.794478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e012cb-d901-4331-b62e-79e1b3c9677e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:32.795020 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e012cb-d901-4331-b62e-79e1b3c9677e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:32.795675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e012cb-d901-4331-b62e-79e1b3c9677e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:32.797039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e012cb-d901-4331-b62e-79e1b3c9677e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:32.808978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-01e012cb-d901-4331-b62e-79e1b3c9677e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 21:02:32.808978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:32.808978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:32.808978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:32.808978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:32.808978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:32.808978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:32.808978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:32.808978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 21:02:32.808978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:32.808978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:32.808978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:32.808978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:32.808978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:32.808978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:32.808978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:32.808978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:32.810002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:32.810002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:32.810002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:32.810002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:32.810002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:32.810002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:32.810002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:32.810002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:32.810002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:32.810002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:32.810002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:32.810002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:32.810002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:32.810002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:32.810002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:32.810002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:32.811517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:32.811517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:32.811517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:32.811517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:32.811517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:32.811517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:32.811517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:32.811517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:32.811517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:32.811517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:32.811517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:32.811517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:32.811517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 21:02:32.811517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:32.811517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 418/843] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:02:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:32.812326 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e012cb-d901-4331-b62e-79e1b3c9677e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:32.836028 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4aaea4-da71-4668-9f08-c2fa9afb268a None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:32.870837 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9de43-bf27-4600-824e-61fcde78482e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:32.871635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9de43-bf27-4600-824e-61fcde78482e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:32.871921 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9de43-bf27-4600-824e-61fcde78482e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:32.872203 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9de43-bf27-4600-824e-61fcde78482e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:32.882575 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d9de43-bf27-4600-824e-61fcde78482e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:32.890273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-c5d9de43-bf27-4600-824e-61fcde78482e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:32.890273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:32.890273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:32.890273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:32.890273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:32.890273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:32.890273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:32.890273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:32.890273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:32.890273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:32.890273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:32.890273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:32.890273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:32.890273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:32.890273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:32.890273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:32.891391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:32.891391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:32.891391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:32.891391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:32.891391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:32.891391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:32.891391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:32.891391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:32.891391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:32.891391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:32.891391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:32.891391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:32.891391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:32.891391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:32.891391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:32.891391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:32.892253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:32.892253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:32.892253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:32.892253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:32.892253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:32.892253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:32.892253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:32.892253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:32.892253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:32.892253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:32.892253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:02:32.892253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:32.892253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 426/844] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:02:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:32.892976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9de43-bf27-4600-824e-61fcde78482e None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:32.920948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e012cb-d901-4331-b62e-79e1b3c9677e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:32.954331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3369b00-1b99-4720-89ca-8517332ae700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:32.955150 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3369b00-1b99-4720-89ca-8517332ae700 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:32.955433 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3369b00-1b99-4720-89ca-8517332ae700 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:32.955720 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3369b00-1b99-4720-89ca-8517332ae700 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:32.964450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3369b00-1b99-4720-89ca-8517332ae700 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:32.965891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3369b00-1b99-4720-89ca-8517332ae700 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:32.980843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-f3369b00-1b99-4720-89ca-8517332ae700 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 21:02:32.980843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:32.980843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:32.980843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:32.980843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:32.980843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:32.980843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:32.980843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:32.980843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:32.980843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:32.980843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:32.980843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:32.980843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:32.980843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:32.980843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:32.980843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:32.981819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:32.981819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:32.981819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:32.981819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:32.981819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:32.981819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:32.981819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:32.981819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:32.981819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:32.981819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:32.981819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:32.981819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:32.981819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:32.981819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:32.981819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:32.981819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:32.981819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:32.981819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:32.983230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:32.983230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:32.983230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:32.983230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:32.983230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:32.983230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:32.983230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:32.983230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:32.983230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 21:02:32.983230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:32.983230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 419/845] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:02:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:32.983230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3369b00-1b99-4720-89ca-8517332ae700 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:33.002115 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9de43-bf27-4600-824e-61fcde78482e None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:33.036106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04094dc0-1539-4c7f-9d5c-6f2ac7d68abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:33.037023 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04094dc0-1539-4c7f-9d5c-6f2ac7d68abf None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:33.037921 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04094dc0-1539-4c7f-9d5c-6f2ac7d68abf None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:33.038285 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04094dc0-1539-4c7f-9d5c-6f2ac7d68abf None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:33.039031 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04094dc0-1539-4c7f-9d5c-6f2ac7d68abf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:33.039342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04094dc0-1539-4c7f-9d5c-6f2ac7d68abf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:33.040707 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04094dc0-1539-4c7f-9d5c-6f2ac7d68abf None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:33.045484 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 427/846] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:02:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:33.046266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04094dc0-1539-4c7f-9d5c-6f2ac7d68abf None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:33.090279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3369b00-1b99-4720-89ca-8517332ae700 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:33.122686 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728a37c-59f0-4559-b3aa-956a881c952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:33.123374 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728a37c-59f0-4559-b3aa-956a881c952a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:33.123647 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728a37c-59f0-4559-b3aa-956a881c952a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:33.123926 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728a37c-59f0-4559-b3aa-956a881c952a None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:33.124671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728a37c-59f0-4559-b3aa-956a881c952a None admin] RBAC: Adding query filter params (name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:33.124981 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728a37c-59f0-4559-b3aa-956a881c952a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:33.126344 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728a37c-59f0-4559-b3aa-956a881c952a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:33.134891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 420/847] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:02:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:33.135866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728a37c-59f0-4559-b3aa-956a881c952a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:33.155291 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04094dc0-1539-4c7f-9d5c-6f2ac7d68abf None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:33.189329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47040f-adfe-466c-838c-48b210bd964c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:33.190247 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47040f-adfe-466c-838c-48b210bd964c None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:33.190718 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47040f-adfe-466c-838c-48b210bd964c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:33.191136 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47040f-adfe-466c-838c-48b210bd964c None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:33.192120 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47040f-adfe-466c-838c-48b210bd964c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:33.192575 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47040f-adfe-466c-838c-48b210bd964c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:33.194701 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47040f-adfe-466c-838c-48b210bd964c None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:33.212696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 428/848] 10.222.0.25 () {56 vars in 1135 bytes} [Tue May 10 21:02:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:33.213682 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47040f-adfe-466c-838c-48b210bd964c None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:33.235851 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728a37c-59f0-4559-b3aa-956a881c952a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:33.269541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d3124-e09c-4a7f-9d06-a43c7709f47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:33.270295 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d3124-e09c-4a7f-9d06-a43c7709f47d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:33.270705 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d3124-e09c-4a7f-9d06-a43c7709f47d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:33.271031 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d3124-e09c-4a7f-9d06-a43c7709f47d None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:33.272472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d3124-e09c-4a7f-9d06-a43c7709f47d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:33.272785 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d3124-e09c-4a7f-9d06-a43c7709f47d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:33.274146 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d3124-e09c-4a7f-9d06-a43c7709f47d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:33.279039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 421/849] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:02:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:33.279893 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d3124-e09c-4a7f-9d06-a43c7709f47d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:33.339300 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47040f-adfe-466c-838c-48b210bd964c None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:33.376339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5b515-ede0-4461-a73d-ee43d81a0ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:33.381762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5b515-ede0-4461-a73d-ee43d81a0ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:33.381762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5b515-ede0-4461-a73d-ee43d81a0ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:33.381762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5b515-ede0-4461-a73d-ee43d81a0ea6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:33.389329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5b515-ede0-4461-a73d-ee43d81a0ea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:33.391099 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5b515-ede0-4461-a73d-ee43d81a0ea6 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:33.394212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d3124-e09c-4a7f-9d06-a43c7709f47d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:33.412033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-2cb5b515-ede0-4461-a73d-ee43d81a0ea6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:33.412033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:33.412033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:33.412033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:33.412033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:33.412033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:33.412033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:33.412033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:33.412033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:33.412033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:33.412033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:33.412033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:33.412033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:33.412033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:33.412033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:33.413080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:33.413080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:33.413080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:33.413080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:33.413080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:33.413080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:33.413080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:33.413080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:33.413080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:33.413080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:33.413080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:33.413080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:33.413080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:33.413080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:33.413080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:33.413080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:33.413080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:33.414234 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:33.414234 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:33.414234 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:33.414234 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:33.414234 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 429/850] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:33.419345 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5b515-ede0-4461-a73d-ee43d81a0ea6 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:33.436203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c9057-675d-434a-93c6-57a899a8d7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:33.437303 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c9057-675d-434a-93c6-57a899a8d7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:33.437795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c9057-675d-434a-93c6-57a899a8d7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:33.438274 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c9057-675d-434a-93c6-57a899a8d7e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:33.513847 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c9057-675d-434a-93c6-57a899a8d7e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:33.515937 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c9057-675d-434a-93c6-57a899a8d7e8 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:33.567730 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5b515-ede0-4461-a73d-ee43d81a0ea6 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:33.614208 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c9e0d-4d93-48ee-a643-14af10263689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:33.615869 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c9e0d-4d93-48ee-a643-14af10263689 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:33.616479 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c9e0d-4d93-48ee-a643-14af10263689 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:33.616941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c9e0d-4d93-48ee-a643-14af10263689 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:33.617689 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c9e0d-4d93-48ee-a643-14af10263689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:33.618157 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c9e0d-4d93-48ee-a643-14af10263689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:33.620226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c9e0d-4d93-48ee-a643-14af10263689 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:33.628074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 422/851] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:02:33 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 21:02:33.634370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c9057-675d-434a-93c6-57a899a8d7e8 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:33.643129 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 430/852] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:33.645653 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c9e0d-4d93-48ee-a643-14af10263689 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:33.754469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c9e0d-4d93-48ee-a643-14af10263689 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:33.754749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c9057-675d-434a-93c6-57a899a8d7e8 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:33.788779 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a32b3-b77b-4c4b-94aa-7c53e1a31eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:33.789611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a32b3-b77b-4c4b-94aa-7c53e1a31eef None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:33.789901 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a32b3-b77b-4c4b-94aa-7c53e1a31eef None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:33.790181 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a32b3-b77b-4c4b-94aa-7c53e1a31eef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:33.798647 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72548d4a-cddc-498c-9ef9-b8c40996a8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:33.799287 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a32b3-b77b-4c4b-94aa-7c53e1a31eef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:33.799722 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72548d4a-cddc-498c-9ef9-b8c40996a8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:33.800171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72548d4a-cddc-498c-9ef9-b8c40996a8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:33.800546 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72548d4a-cddc-498c-9ef9-b8c40996a8c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:33.800915 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a32b3-b77b-4c4b-94aa-7c53e1a31eef None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:33.812740 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72548d4a-cddc-498c-9ef9-b8c40996a8c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:33.814314 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72548d4a-cddc-498c-9ef9-b8c40996a8c8 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:33.816785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-123a32b3-b77b-4c4b-94aa-7c53e1a31eef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 21:02:33.816785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:33.816785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:33.816785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:33.816785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:33.816785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:33.816785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:33.816785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:33.816785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:33.816785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:33.816785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:33.816785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:33.816785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:33.816785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:33.816785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:33.816785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:33.819549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:33.819549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:33.819549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:33.819549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:33.819549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:33.819549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:33.819549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:33.819549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:33.819549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:33.819549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:33.819549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:33.819549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:33.819549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:33.819549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:33.819549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:33.819549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:33.819549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:33.819549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:33.821762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:33.821762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:33.821762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:33.821762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:33.821762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:33.821762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:33.821762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:33.821762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:33.821762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 21:02:33.821762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:33.823023 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 431/853] 10.222.0.25 () {56 vars in 1117 bytes} [Tue May 10 21:02:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:33.830471 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a32b3-b77b-4c4b-94aa-7c53e1a31eef None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:33.836018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-72548d4a-cddc-498c-9ef9-b8c40996a8c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:33.836018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:33.836018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:33.836018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:33.836018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:33.836018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:33.836018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:33.836018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:33.836018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:33.836018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:33.836018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:33.836018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:33.836018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:33.836018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:33.836018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:33.838383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:33.838383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:33.838383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:33.838383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:33.838383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:33.838383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:33.838383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:33.838383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:33.838383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:33.838383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:33.838383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:33.838383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:33.838383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:33.838383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:33.838383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:33.838383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:33.838383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:33.840501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:33.840501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:33.840501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:33.840501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:33.841300 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 423/854] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:33.848533 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72548d4a-cddc-498c-9ef9-b8c40996a8c8 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:33.941368 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a32b3-b77b-4c4b-94aa-7c53e1a31eef None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:33.975993 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823617ce-ab41-42c1-972b-592d753c0cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:33.976585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823617ce-ab41-42c1-972b-592d753c0cdf None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:33.976863 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823617ce-ab41-42c1-972b-592d753c0cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:33.977194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823617ce-ab41-42c1-972b-592d753c0cdf None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:33.977967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823617ce-ab41-42c1-972b-592d753c0cdf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:33.978272 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823617ce-ab41-42c1-972b-592d753c0cdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:33.979691 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72548d4a-cddc-498c-9ef9-b8c40996a8c8 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:33.979807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823617ce-ab41-42c1-972b-592d753c0cdf None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:34.002203 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 432/855] 10.222.0.25 () {56 vars in 1149 bytes} [Tue May 10 21:02:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:34.004270 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823617ce-ab41-42c1-972b-592d753c0cdf None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:34.025296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0d4f2-eac6-488c-9957-7c31da237923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:34.026405 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0d4f2-eac6-488c-9957-7c31da237923 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:34.027035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0d4f2-eac6-488c-9957-7c31da237923 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:34.027513 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0d4f2-eac6-488c-9957-7c31da237923 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:34.028974 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0d4f2-eac6-488c-9957-7c31da237923 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:34.029751 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0d4f2-eac6-488c-9957-7c31da237923 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:34.031902 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0d4f2-eac6-488c-9957-7c31da237923 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:34.054846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 424/856] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:34.056517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0d4f2-eac6-488c-9957-7c31da237923 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:34.113669 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823617ce-ab41-42c1-972b-592d753c0cdf None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:34.148508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e781a-3a28-45f9-b065-fbd154d212f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:34.149158 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e781a-3a28-45f9-b065-fbd154d212f1 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:34.149441 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e781a-3a28-45f9-b065-fbd154d212f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:34.149729 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e781a-3a28-45f9-b065-fbd154d212f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:34.161846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0d4f2-eac6-488c-9957-7c31da237923 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:34.198979 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7beaf7-9d4b-4544-a08f-0fc22d2a20c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:34.200280 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7beaf7-9d4b-4544-a08f-0fc22d2a20c0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:34.200769 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7beaf7-9d4b-4544-a08f-0fc22d2a20c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:34.201248 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7beaf7-9d4b-4544-a08f-0fc22d2a20c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:34.208655 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7beaf7-9d4b-4544-a08f-0fc22d2a20c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:34.211013 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7beaf7-9d4b-4544-a08f-0fc22d2a20c0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:34.218734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e781a-3a28-45f9-b065-fbd154d212f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:34.220271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e781a-3a28-45f9-b065-fbd154d212f1 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:34.226955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-cf7beaf7-9d4b-4544-a08f-0fc22d2a20c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:34.226955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:34.226955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:34.226955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:34.226955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:34.226955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:34.226955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:34.226955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:34.226955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:34.226955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:34.226955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:34.226955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:34.226955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:34.226955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:34.226955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:34.227873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:34.227873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:34.227873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:34.227873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:34.227873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:34.227873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:34.227873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:34.227873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:34.227873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:34.227873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:34.227873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:34.227873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:34.227873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:34.227873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:34.227873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:34.227873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:34.227873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:34.228789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:34.228789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:34.228789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:34.228789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:34.228789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:34.228789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:34.228789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:34.228789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:34.235658 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 425/857] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:34.237104 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7beaf7-9d4b-4544-a08f-0fc22d2a20c0 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:34.328877 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 433/858] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:02:34 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 21:02:34.331979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e781a-3a28-45f9-b065-fbd154d212f1 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:34.351936 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7beaf7-9d4b-4544-a08f-0fc22d2a20c0 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:34.395294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca93617-8de4-4a42-aae9-0959bba72a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:34.396244 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca93617-8de4-4a42-aae9-0959bba72a79 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:34.396561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca93617-8de4-4a42-aae9-0959bba72a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:34.396947 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca93617-8de4-4a42-aae9-0959bba72a79 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:34.397641 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca93617-8de4-4a42-aae9-0959bba72a79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:34.397951 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca93617-8de4-4a42-aae9-0959bba72a79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:34.400010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca93617-8de4-4a42-aae9-0959bba72a79 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:34.420125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 426/859] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:34.421781 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca93617-8de4-4a42-aae9-0959bba72a79 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:34.466274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e781a-3a28-45f9-b065-fbd154d212f1 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:34.504019 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f097887-eda9-4bf7-87e6-02cce7e72a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:34.505572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f097887-eda9-4bf7-87e6-02cce7e72a7c None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:34.505854 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f097887-eda9-4bf7-87e6-02cce7e72a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:34.506723 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f097887-eda9-4bf7-87e6-02cce7e72a7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:34.518252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f097887-eda9-4bf7-87e6-02cce7e72a7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:34.519716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f097887-eda9-4bf7-87e6-02cce7e72a7c None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:34.534600 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca93617-8de4-4a42-aae9-0959bba72a79 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:34.537463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-4f097887-eda9-4bf7-87e6-02cce7e72a7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:34.537463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:34.537463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:34.537463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:34.537463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:34.537463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:34.537463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:34.537463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:34.537463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:34.537463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:34.537463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:34.537463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:34.537463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:34.537463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:34.537463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:34.543587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:34.543587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:34.543587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:34.543587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:34.543587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:34.543587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:34.543587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:34.543587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:34.543587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:34.543587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:34.543587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:34.543587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:34.543587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:34.543587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:34.543587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:34.543587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:34.543587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:34.544506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:34.544506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:34.544506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:34.544506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:34.544506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 434/860] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:34.544506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f487d70-d645-476c-b8b3-6b5c700710bd None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:34.544506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f487d70-d645-476c-b8b3-6b5c700710bd None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:34.544506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f487d70-d645-476c-b8b3-6b5c700710bd None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:34.546565 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 435/861] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:34.547212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f487d70-d645-476c-b8b3-6b5c700710bd None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:34.569377 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7941b0-b01c-4b83-a33d-2d2848a81d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:34.570090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7941b0-b01c-4b83-a33d-2d2848a81d3f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:34.570381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7941b0-b01c-4b83-a33d-2d2848a81d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:34.570673 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7941b0-b01c-4b83-a33d-2d2848a81d3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:34.571505 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7941b0-b01c-4b83-a33d-2d2848a81d3f None admin] RBAC: Adding query filter params (role.id=5cd001edc58744738aa57180c0be68a9, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=76040882d4374087bb7458fd8b5c1d8d) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:34.571811 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7941b0-b01c-4b83-a33d-2d2848a81d3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:34.573218 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7941b0-b01c-4b83-a33d-2d2848a81d3f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:34.579458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 427/862] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:02:34 2022] GET /identity/v3/role_assignments?user.id=76040882d4374087bb7458fd8b5c1d8d&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=5cd001edc58744738aa57180c0be68a9 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:34.580595 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac46e59-a5aa-4ee4-9b0c-d310c5f4f319 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:34.580883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac46e59-a5aa-4ee4-9b0c-d310c5f4f319 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:34.581165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac46e59-a5aa-4ee4-9b0c-d310c5f4f319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:34.599893 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-0ac46e59-a5aa-4ee4-9b0c-d310c5f4f319 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:34.601115 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0ac46e59-a5aa-4ee4-9b0c-d310c5f4f319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:34.680696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f487d70-d645-476c-b8b3-6b5c700710bd None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:34.691208 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 428/863] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:34.714768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac46e59-a5aa-4ee4-9b0c-d310c5f4f319 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:34.723301 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1db97-88f6-4475-a747-0e4bd4f88736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:34.724407 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1db97-88f6-4475-a747-0e4bd4f88736 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:34.725876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1db97-88f6-4475-a747-0e4bd4f88736 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:34.726391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1db97-88f6-4475-a747-0e4bd4f88736 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:34.728112 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1db97-88f6-4475-a747-0e4bd4f88736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:34.728689 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1db97-88f6-4475-a747-0e4bd4f88736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:34.730976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1db97-88f6-4475-a747-0e4bd4f88736 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:34.747581 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 436/864] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:34.754492 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1db97-88f6-4475-a747-0e4bd4f88736 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:34.827637 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac46e59-a5aa-4ee4-9b0c-d310c5f4f319 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:34.875813 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d259a-793f-4222-875d-116f9d7b17c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:34.876166 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1db97-88f6-4475-a747-0e4bd4f88736 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:34.876671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d259a-793f-4222-875d-116f9d7b17c7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:34.876958 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d259a-793f-4222-875d-116f9d7b17c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:34.877241 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d259a-793f-4222-875d-116f9d7b17c7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:34.878074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d259a-793f-4222-875d-116f9d7b17c7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:34.880282 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d259a-793f-4222-875d-116f9d7b17c7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:34.896500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-922d259a-793f-4222-875d-116f9d7b17c7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 21:02:34.896500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:34.896500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:34.896500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:34.896500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:34.896500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:34.896500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:34.896500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:34.896500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 21:02:34.896500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:34.896500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:34.896500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:34.896500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:34.896500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:34.896500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:34.896500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:34.897510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:34.897510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:34.897510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:34.897510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:34.897510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:34.897510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:34.897510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:34.897510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:34.897510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:34.897510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:34.897510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:34.897510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:34.897510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:34.897510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:34.897510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:34.897510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:34.899866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:34.899866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:34.899866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:34.899866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:34.899866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:34.899866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:34.899866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:34.899866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:34.899866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:34.899866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:34.899866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:34.899866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:34.899866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:34.899866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 21:02:34.899866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:34.899866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 429/865] 10.222.0.25 () {56 vars in 1132 bytes} [Tue May 10 21:02:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:34.905599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d259a-793f-4222-875d-116f9d7b17c7 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:34.916135 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9574486-6543-47c1-8194-d4353a6e04a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:34.916995 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9574486-6543-47c1-8194-d4353a6e04a5 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:34.917281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9574486-6543-47c1-8194-d4353a6e04a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:34.918059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9574486-6543-47c1-8194-d4353a6e04a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:34.927154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9574486-6543-47c1-8194-d4353a6e04a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:34.929628 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9574486-6543-47c1-8194-d4353a6e04a5 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:34.948334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-c9574486-6543-47c1-8194-d4353a6e04a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:34.948334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:34.948334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:34.948334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:34.948334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:34.948334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:34.948334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:34.948334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:34.948334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:34.948334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:34.948334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:34.948334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:34.948334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:34.948334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:34.948334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:34.950134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:34.950134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:34.950134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:34.950134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:34.950134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:34.950134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:34.950134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:34.950134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:34.950134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:34.950134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:34.950134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:34.950134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:34.950134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:34.950134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:34.950134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:34.950134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:34.950134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:34.951269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:34.951269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:34.951269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:34.951269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:34.951269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:34.951269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:34.951269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:34.951269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:34.951269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 437/866] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:34.957862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9574486-6543-47c1-8194-d4353a6e04a5 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:35.018801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d259a-793f-4222-875d-116f9d7b17c7 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:35.054937 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3f38c-1a44-4562-a944-6b2755cf2b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:35.055763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3f38c-1a44-4562-a944-6b2755cf2b57 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:35.056153 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3f38c-1a44-4562-a944-6b2755cf2b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:35.056536 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3f38c-1a44-4562-a944-6b2755cf2b57 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:35.057368 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3f38c-1a44-4562-a944-6b2755cf2b57 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:35.057781 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3f38c-1a44-4562-a944-6b2755cf2b57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:35.059338 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3f38c-1a44-4562-a944-6b2755cf2b57 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:35.069206 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 430/867] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 10 21:02:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:35.070291 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3f38c-1a44-4562-a944-6b2755cf2b57 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:35.085269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9574486-6543-47c1-8194-d4353a6e04a5 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:35.129392 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686963fb-90a4-4b33-b02f-1bf443e220a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:35.130424 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686963fb-90a4-4b33-b02f-1bf443e220a4 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:35.130741 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686963fb-90a4-4b33-b02f-1bf443e220a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:35.131049 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686963fb-90a4-4b33-b02f-1bf443e220a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:35.132519 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686963fb-90a4-4b33-b02f-1bf443e220a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:35.132960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686963fb-90a4-4b33-b02f-1bf443e220a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:35.134547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686963fb-90a4-4b33-b02f-1bf443e220a4 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:35.150667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 438/868] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:35.156296 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686963fb-90a4-4b33-b02f-1bf443e220a4 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:35.174675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3f38c-1a44-4562-a944-6b2755cf2b57 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:35.221334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e53d6-426f-473a-85ea-9d74fb4d4a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:35.222200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e53d6-426f-473a-85ea-9d74fb4d4a7f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:35.222568 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e53d6-426f-473a-85ea-9d74fb4d4a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:35.223161 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e53d6-426f-473a-85ea-9d74fb4d4a7f None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:35.224150 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e53d6-426f-473a-85ea-9d74fb4d4a7f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:35.224461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e53d6-426f-473a-85ea-9d74fb4d4a7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:35.226493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e53d6-426f-473a-85ea-9d74fb4d4a7f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:35.233618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 431/869] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 10 21:02:35 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:35.270069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686963fb-90a4-4b33-b02f-1bf443e220a4 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:35.309471 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836ea13-8534-455c-9778-2c91fafc01f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:35.310149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836ea13-8534-455c-9778-2c91fafc01f0 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:35.310432 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836ea13-8534-455c-9778-2c91fafc01f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:35.310975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836ea13-8534-455c-9778-2c91fafc01f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:35.311950 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836ea13-8534-455c-9778-2c91fafc01f0 None admin] RBAC: Adding query filter params (role.id=d09c313a1a354ea68cf1013629a4a584, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=c0fc3052af194b48b7ce036ff605ff25) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:35.312266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836ea13-8534-455c-9778-2c91fafc01f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:35.313725 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836ea13-8534-455c-9778-2c91fafc01f0 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:35.323181 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 439/870] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:02:35 2022] GET /identity/v3/role_assignments?user.id=c0fc3052af194b48b7ce036ff605ff25&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=d09c313a1a354ea68cf1013629a4a584 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:35.600092 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de4a6c-c33e-420d-8121-e9158aa9f476 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:35.600367 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de4a6c-c33e-420d-8121-e9158aa9f476 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:35.600653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de4a6c-c33e-420d-8121-e9158aa9f476 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:35.602269 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 432/871] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:35.607684 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17e372-d8ae-4521-8b75-6296328fa3b7 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:35.608228 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17e372-d8ae-4521-8b75-6296328fa3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:35.608801 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17e372-d8ae-4521-8b75-6296328fa3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:35.626859 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-3f17e372-d8ae-4521-8b75-6296328fa3b7 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:35.628353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-3f17e372-d8ae-4521-8b75-6296328fa3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:35.695250 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 440/872] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:02:35.718401 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de4a6c-c33e-420d-8121-e9158aa9f476 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:35.823425 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de4a6c-c33e-420d-8121-e9158aa9f476 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:35.859272 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44025a8c-58b2-4626-b514-014a015208dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:35.859864 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44025a8c-58b2-4626-b514-014a015208dd None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:35.860144 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44025a8c-58b2-4626-b514-014a015208dd None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:35.860417 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44025a8c-58b2-4626-b514-014a015208dd None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:35.861158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44025a8c-58b2-4626-b514-014a015208dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:35.862556 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44025a8c-58b2-4626-b514-014a015208dd None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:35.942084 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 433/873] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 10 21:02:35 2022] POST /identity/v3/services => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:02:37.117253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8ffc8-7db4-45c4-b206-6828f122cd86 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:37.117779 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8ffc8-7db4-45c4-b206-6828f122cd86 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:37.117857 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8ffc8-7db4-45c4-b206-6828f122cd86 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:37.119479 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 441/874] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:37.124818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f0852-e432-4c54-adb5-55704debe7c8 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:37.125237 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f0852-e432-4c54-adb5-55704debe7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:37.125414 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f0852-e432-4c54-adb5-55704debe7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:37.142574 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-952f0852-e432-4c54-adb5-55704debe7c8 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:37.143765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-952f0852-e432-4c54-adb5-55704debe7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:37.221097 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 434/875] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:37 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:37.242709 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8ffc8-7db4-45c4-b206-6828f122cd86 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:37.344978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8ffc8-7db4-45c4-b206-6828f122cd86 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:37.382123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44aa6c-22ce-49f2-a5d5-d055ed625a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:37.382890 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44aa6c-22ce-49f2-a5d5-d055ed625a1e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:37.383175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44aa6c-22ce-49f2-a5d5-d055ed625a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:37.383444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44aa6c-22ce-49f2-a5d5-d055ed625a1e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:37.384101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44aa6c-22ce-49f2-a5d5-d055ed625a1e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:37.385455 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44aa6c-22ce-49f2-a5d5-d055ed625a1e None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:37.397635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-2b44aa6c-22ce-49f2-a5d5-d055ed625a1e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 21:02:37.397635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:37.397635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:37.397635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:37.397635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:37.397635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:37.397635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:37.397635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:37.397635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 21:02:37.397635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:37.397635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:37.397635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:37.397635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:37.397635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:37.397635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:37.397635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:37.397635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:37.399956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:37.399956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:37.399956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:37.399956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:37.399956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:37.399956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:37.399956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:37.399956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:37.399956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:37.399956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:37.399956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:37.399956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:37.399956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:37.399956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:37.399956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:37.399956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:37.401421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:37.401421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:37.401421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:37.401421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:37.401421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:37.401421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:37.401421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:37.401421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:37.401421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:37.401421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:37.401421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:37.401421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:37.401421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 21:02:37.401421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:37.406457 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 442/876] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 10 21:02:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:37.410260 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f0852-e432-4c54-adb5-55704debe7c8 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:37.509068 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f0852-e432-4c54-adb5-55704debe7c8 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:37.543780 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43dd68-55ea-45f3-a447-88c38b43ce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:37.544753 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43dd68-55ea-45f3-a447-88c38b43ce7d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:37.545040 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43dd68-55ea-45f3-a447-88c38b43ce7d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:37.545313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43dd68-55ea-45f3-a447-88c38b43ce7d None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:37.546036 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43dd68-55ea-45f3-a447-88c38b43ce7d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:37.546355 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43dd68-55ea-45f3-a447-88c38b43ce7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:37.547730 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43dd68-55ea-45f3-a447-88c38b43ce7d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:37.557610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 435/877] 10.222.0.25 () {56 vars in 1122 bytes} [Tue May 10 21:02:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:37.558941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44aa6c-22ce-49f2-a5d5-d055ed625a1e None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:37.656230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8c7aa-bd57-40e4-997d-e7a93dbc5fdc None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:37.656551 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8c7aa-bd57-40e4-997d-e7a93dbc5fdc None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:37.656729 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8c7aa-bd57-40e4-997d-e7a93dbc5fdc None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:37.658386 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 436/878] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:37.664981 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d9606-52db-477c-bc93-7d743cf64d73 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:37.665307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d9606-52db-477c-bc93-7d743cf64d73 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:37.665545 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d9606-52db-477c-bc93-7d743cf64d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:37.668120 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44aa6c-22ce-49f2-a5d5-d055ed625a1e None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:37.683024 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-1a0d9606-52db-477c-bc93-7d743cf64d73 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:37.684211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1a0d9606-52db-477c-bc93-7d743cf64d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:37.709252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ea491-f3d7-497f-a086-0c98739138a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:37.710085 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ea491-f3d7-497f-a086-0c98739138a2 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:37.710370 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ea491-f3d7-497f-a086-0c98739138a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:37.710994 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ea491-f3d7-497f-a086-0c98739138a2 None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:37.711979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ea491-f3d7-497f-a086-0c98739138a2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:37.712287 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ea491-f3d7-497f-a086-0c98739138a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:37.714105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ea491-f3d7-497f-a086-0c98739138a2 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:37.720364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 443/879] 10.222.0.25 () {56 vars in 1122 bytes} [Tue May 10 21:02:37 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:37.758420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 437/880] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:37 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:02:37.781182 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ea491-f3d7-497f-a086-0c98739138a2 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:37.842772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02cd41-80ea-4c7b-819c-b506c7b2a4d7 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:37.843104 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02cd41-80ea-4c7b-819c-b506c7b2a4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:37.843336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02cd41-80ea-4c7b-819c-b506c7b2a4d7 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:37.844936 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 438/881] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:37.851902 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3de7b-78b7-47bb-98ce-f1224a449d52 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:37.852209 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3de7b-78b7-47bb-98ce-f1224a449d52 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:37.852462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3de7b-78b7-47bb-98ce-f1224a449d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:37.873396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-70e3de7b-78b7-47bb-98ce-f1224a449d52 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:37.874667 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-70e3de7b-78b7-47bb-98ce-f1224a449d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:37.894741 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ea491-f3d7-497f-a086-0c98739138a2 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:37.940283 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6e792-48a8-49e3-8ba9-611411ec4c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:37.940889 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6e792-48a8-49e3-8ba9-611411ec4c61 None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:37.941176 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6e792-48a8-49e3-8ba9-611411ec4c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:37.941457 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6e792-48a8-49e3-8ba9-611411ec4c61 None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:37.942187 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6e792-48a8-49e3-8ba9-611411ec4c61 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:37.944043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6e792-48a8-49e3-8ba9-611411ec4c61 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:37.950150 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 439/882] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:37 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:02:37.973350 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3de7b-78b7-47bb-98ce-f1224a449d52 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:38.070591 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 444/883] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 10 21:02:37 2022] POST /identity/v3/services => generated 269 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:02:38.087348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3de7b-78b7-47bb-98ce-f1224a449d52 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:38.132896 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ebb6e-b023-475c-b806-782df6e0d765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:38.134669 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ebb6e-b023-475c-b806-782df6e0d765 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:38.135169 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ebb6e-b023-475c-b806-782df6e0d765 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:38.135610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ebb6e-b023-475c-b806-782df6e0d765 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:38.150236 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ebb6e-b023-475c-b806-782df6e0d765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:38.159319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-356ebb6e-b023-475c-b806-782df6e0d765 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 21:02:38.159319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:38.159319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:38.159319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:38.159319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:38.159319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:38.159319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:38.159319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:38.159319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:38.159319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:38.159319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:38.159319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:38.159319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:38.159319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:38.159319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:38.159319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:38.160653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:38.160653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:38.160653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:38.160653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:38.160653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:38.160653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:38.160653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:38.160653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:38.160653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:38.160653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:38.160653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:38.160653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:38.160653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:38.160653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:38.160653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:38.160653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:38.161784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:38.161784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:38.161784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:38.161784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:38.161784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:38.161784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:38.161784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:38.161784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:38.161784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:38.161784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:38.161784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 21:02:38.161784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:38.165055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 440/884] 10.222.0.25 () {56 vars in 1120 bytes} [Tue May 10 21:02:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:38.171536 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6e792-48a8-49e3-8ba9-611411ec4c61 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:38.277885 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6e792-48a8-49e3-8ba9-611411ec4c61 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:38.313301 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff2608-e733-4de2-ba9e-5f9a4f53f605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:38.314308 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff2608-e733-4de2-ba9e-5f9a4f53f605 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:38.314633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff2608-e733-4de2-ba9e-5f9a4f53f605 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:38.314916 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff2608-e733-4de2-ba9e-5f9a4f53f605 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:38.315673 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff2608-e733-4de2-ba9e-5f9a4f53f605 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:38.315980 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff2608-e733-4de2-ba9e-5f9a4f53f605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:38.317414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff2608-e733-4de2-ba9e-5f9a4f53f605 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:38.324993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413f3d4-9114-4dd3-a629-f9d6f1ee284e None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:38.325274 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413f3d4-9114-4dd3-a629-f9d6f1ee284e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:38.325557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413f3d4-9114-4dd3-a629-f9d6f1ee284e None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:38.326123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 445/885] 10.222.0.25 () {56 vars in 1115 bytes} [Tue May 10 21:02:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:38.327035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 441/886] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:02:38.332584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff2608-e733-4de2-ba9e-5f9a4f53f605 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:38.332996 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7720c-021b-4835-a795-ccab132e48d6 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:38.333210 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7720c-021b-4835-a795-ccab132e48d6 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:38.333491 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7720c-021b-4835-a795-ccab132e48d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:38.355137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d6b7720c-021b-4835-a795-ccab132e48d6 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:38.356323 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d6b7720c-021b-4835-a795-ccab132e48d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:38.435662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 442/887] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:38.439652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff2608-e733-4de2-ba9e-5f9a4f53f605 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:38.458599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7720c-021b-4835-a795-ccab132e48d6 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:38.474487 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ae9ab-a990-4801-bd09-85343d10f3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:38.475294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ae9ab-a990-4801-bd09-85343d10f3aa None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:38.475578 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ae9ab-a990-4801-bd09-85343d10f3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:38.475851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ae9ab-a990-4801-bd09-85343d10f3aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:38.492429 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ae9ab-a990-4801-bd09-85343d10f3aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:38.493887 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ae9ab-a990-4801-bd09-85343d10f3aa None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:38.512266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-a86ae9ab-a990-4801-bd09-85343d10f3aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:38.512266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:38.512266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:38.512266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:38.512266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:38.512266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:38.512266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:38.512266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:38.512266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:38.512266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:38.512266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:38.512266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:38.512266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:38.512266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:38.512266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:38.513241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:38.513241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:38.513241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:38.513241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:38.513241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:38.513241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:38.513241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:38.513241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:38.513241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:38.513241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:38.513241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:38.513241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:38.513241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:38.513241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:38.513241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:38.513241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:38.513241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:38.514513 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:38.514513 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:38.514513 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:38.514513 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:38.514513 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 446/888] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:38.526032 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ae9ab-a990-4801-bd09-85343d10f3aa None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:38.559032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7720c-021b-4835-a795-ccab132e48d6 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:38.597812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9930c40-a961-41b5-a4a1-8528beee480d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:38.598800 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9930c40-a961-41b5-a4a1-8528beee480d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:38.599092 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9930c40-a961-41b5-a4a1-8528beee480d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:38.599404 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9930c40-a961-41b5-a4a1-8528beee480d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:38.600579 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9930c40-a961-41b5-a4a1-8528beee480d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:38.602511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9930c40-a961-41b5-a4a1-8528beee480d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:38.617608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-b9930c40-a961-41b5-a4a1-8528beee480d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 21:02:38.617608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:38.617608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:38.617608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:38.617608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:38.617608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:38.617608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:38.617608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:38.617608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 21:02:38.617608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:38.617608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:38.617608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:38.617608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:38.617608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:38.617608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:38.617608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:38.617608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:38.618933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:38.618933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:38.618933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:38.618933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:38.618933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:38.618933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:38.618933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:38.618933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:38.618933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:38.618933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:38.618933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:38.618933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:38.618933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:38.618933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:38.618933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:38.618933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:38.619795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:38.619795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:38.619795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:38.619795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:38.619795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:38.619795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:38.619795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:38.619795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:38.619795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:38.619795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:38.619795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:38.619795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:38.619795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 21:02:38.619795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:38.622509 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 443/889] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:02:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:38.624669 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9930c40-a961-41b5-a4a1-8528beee480d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:38.648693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ae9ab-a990-4801-bd09-85343d10f3aa None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:38.682905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359d620-4fb7-4377-9e5f-cde980dc34d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:38.683569 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359d620-4fb7-4377-9e5f-cde980dc34d7 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:38.683849 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359d620-4fb7-4377-9e5f-cde980dc34d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:38.684124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359d620-4fb7-4377-9e5f-cde980dc34d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:38.684930 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359d620-4fb7-4377-9e5f-cde980dc34d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:38.685142 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359d620-4fb7-4377-9e5f-cde980dc34d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:38.686525 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359d620-4fb7-4377-9e5f-cde980dc34d7 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:38.704275 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 447/890] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:38.705489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359d620-4fb7-4377-9e5f-cde980dc34d7 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:38.755257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9930c40-a961-41b5-a4a1-8528beee480d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:38.795981 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069003e3-9629-4838-b37d-6acdf04b2789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:38.796749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069003e3-9629-4838-b37d-6acdf04b2789 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:38.797106 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069003e3-9629-4838-b37d-6acdf04b2789 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:38.797453 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069003e3-9629-4838-b37d-6acdf04b2789 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:38.798247 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069003e3-9629-4838-b37d-6acdf04b2789 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:38.798606 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069003e3-9629-4838-b37d-6acdf04b2789 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:38.800021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069003e3-9629-4838-b37d-6acdf04b2789 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:38.810005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 444/891] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:02:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:38.811992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069003e3-9629-4838-b37d-6acdf04b2789 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:38.820126 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359d620-4fb7-4377-9e5f-cde980dc34d7 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:38.869370 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3717676-9c49-4e28-bb5b-b73fa1872041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:38.870769 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3717676-9c49-4e28-bb5b-b73fa1872041 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:38.871643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3717676-9c49-4e28-bb5b-b73fa1872041 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:38.872282 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3717676-9c49-4e28-bb5b-b73fa1872041 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:38.882605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3717676-9c49-4e28-bb5b-b73fa1872041 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:38.885179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3717676-9c49-4e28-bb5b-b73fa1872041 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:38.906280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-b3717676-9c49-4e28-bb5b-b73fa1872041 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 21:02:38.906280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:38.906280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:38.906280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:38.906280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:38.906280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:38.906280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:38.906280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:38.906280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:38.906280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:38.906280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:38.906280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:38.906280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:38.906280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:38.906280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:38.906280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:38.907568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:38.907568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:38.907568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:38.907568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:38.907568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:38.907568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:38.907568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:38.907568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:38.907568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:38.907568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:38.907568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:38.907568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:38.907568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:38.907568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:38.907568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:38.907568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:38.907568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:38.907568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:38.908790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:38.908790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:38.908790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:38.908790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:38.908790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:38.908790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:38.908790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:38.908790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:38.908790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 21:02:38.908790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:38.911739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 448/892] 10.222.0.25 () {56 vars in 1117 bytes} [Tue May 10 21:02:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:38.917154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3717676-9c49-4e28-bb5b-b73fa1872041 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:38.932414 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069003e3-9629-4838-b37d-6acdf04b2789 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:38.978913 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a33535-4294-4ef6-a452-a6370b24af35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:38.980446 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a33535-4294-4ef6-a452-a6370b24af35 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:38.981080 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a33535-4294-4ef6-a452-a6370b24af35 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:38.981692 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a33535-4294-4ef6-a452-a6370b24af35 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:38.982764 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a33535-4294-4ef6-a452-a6370b24af35 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:38.983587 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a33535-4294-4ef6-a452-a6370b24af35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:38.985609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a33535-4294-4ef6-a452-a6370b24af35 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:38.993488 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 445/893] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:02:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:38.999797 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a33535-4294-4ef6-a452-a6370b24af35 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:39.037316 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3717676-9c49-4e28-bb5b-b73fa1872041 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:39.078829 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26ffde-0538-4846-8449-9a4d8c9f2a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:39.079930 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26ffde-0538-4846-8449-9a4d8c9f2a2f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:39.080820 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26ffde-0538-4846-8449-9a4d8c9f2a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:39.081262 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26ffde-0538-4846-8449-9a4d8c9f2a2f None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:39.082613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26ffde-0538-4846-8449-9a4d8c9f2a2f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:39.083253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26ffde-0538-4846-8449-9a4d8c9f2a2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:39.085635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26ffde-0538-4846-8449-9a4d8c9f2a2f None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:39.106686 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 449/894] 10.222.0.25 () {56 vars in 1149 bytes} [Tue May 10 21:02:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:39.112137 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26ffde-0538-4846-8449-9a4d8c9f2a2f None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:39.121418 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a33535-4294-4ef6-a452-a6370b24af35 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:39.164971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28f2c2-6da2-46a1-930f-bd6cf8f83f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:39.166362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28f2c2-6da2-46a1-930f-bd6cf8f83f69 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:39.166885 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28f2c2-6da2-46a1-930f-bd6cf8f83f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:39.167350 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28f2c2-6da2-46a1-930f-bd6cf8f83f69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:39.168318 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28f2c2-6da2-46a1-930f-bd6cf8f83f69 None admin] RBAC: Adding query filter params (interface=public, service_id=b89b645c527e42979203804b274065d9, region_id=RegionOne) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:39.168820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28f2c2-6da2-46a1-930f-bd6cf8f83f69 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:39.170686 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28f2c2-6da2-46a1-930f-bd6cf8f83f69 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:39.179398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 446/895] 10.222.0.25 () {56 vars in 1251 bytes} [Tue May 10 21:02:38 2022] GET /identity/v3/endpoints?service_id=b89b645c527e42979203804b274065d9&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:39.184474 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28f2c2-6da2-46a1-930f-bd6cf8f83f69 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:39.221621 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26ffde-0538-4846-8449-9a4d8c9f2a2f None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:39.256510 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69371b-e90a-4ffb-ba68-7fdde62bd40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:39.257177 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69371b-e90a-4ffb-ba68-7fdde62bd40c None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:39.257465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69371b-e90a-4ffb-ba68-7fdde62bd40c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:39.257742 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69371b-e90a-4ffb-ba68-7fdde62bd40c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:39.284326 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28f2c2-6da2-46a1-930f-bd6cf8f83f69 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:39.321111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592dddc-473f-4714-812e-c829f1ceab27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:39.322189 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592dddc-473f-4714-812e-c829f1ceab27 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:39.322933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592dddc-473f-4714-812e-c829f1ceab27 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:39.323446 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592dddc-473f-4714-812e-c829f1ceab27 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:39.324329 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592dddc-473f-4714-812e-c829f1ceab27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:39.325937 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592dddc-473f-4714-812e-c829f1ceab27 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:39.328375 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69371b-e90a-4ffb-ba68-7fdde62bd40c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:39.329835 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69371b-e90a-4ffb-ba68-7fdde62bd40c None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:39.333533 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 447/896] 10.222.0.25 () {56 vars in 1087 bytes} [Tue May 10 21:02:39 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:02:39.446745 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 450/897] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:02:39 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 21:02:39.450034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592dddc-473f-4714-812e-c829f1ceab27 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:39.562865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592dddc-473f-4714-812e-c829f1ceab27 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:39.596660 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef95a1-96d5-4d7a-ab86-f930617bfa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:39.597464 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef95a1-96d5-4d7a-ab86-f930617bfa8e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:39.597751 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef95a1-96d5-4d7a-ab86-f930617bfa8e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:39.598033 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef95a1-96d5-4d7a-ab86-f930617bfa8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:39.608777 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef95a1-96d5-4d7a-ab86-f930617bfa8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:39.610178 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef95a1-96d5-4d7a-ab86-f930617bfa8e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:39.627431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-e7ef95a1-96d5-4d7a-ab86-f930617bfa8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:39.627431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:39.627431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:39.627431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:39.627431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:39.627431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:39.627431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:39.627431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:39.627431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:39.627431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:39.627431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:39.627431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:39.627431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:39.627431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:39.627431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:39.628366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:39.628366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:39.628366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:39.628366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:39.628366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:39.628366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:39.628366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:39.628366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:39.628366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:39.628366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:39.628366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:39.628366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:39.628366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:39.628366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:39.628366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:39.628366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:39.628366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:39.629520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:39.629520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:39.629520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:39.629520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:39.629520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 448/898] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:39.636386 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69371b-e90a-4ffb-ba68-7fdde62bd40c None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:39.733785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69371b-e90a-4ffb-ba68-7fdde62bd40c None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:39.767539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd091c-4b91-4393-8f90-9433febe6670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:39.768585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd091c-4b91-4393-8f90-9433febe6670 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:39.769066 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd091c-4b91-4393-8f90-9433febe6670 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:39.769550 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd091c-4b91-4393-8f90-9433febe6670 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:39.770505 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd091c-4b91-4393-8f90-9433febe6670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:39.771007 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd091c-4b91-4393-8f90-9433febe6670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:39.773329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd091c-4b91-4393-8f90-9433febe6670 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:39.790304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 451/899] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:39.792087 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef95a1-96d5-4d7a-ab86-f930617bfa8e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:39.900992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef95a1-96d5-4d7a-ab86-f930617bfa8e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:39.935931 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f1ebc-c191-4f14-ba62-b28f3f416973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:39.937082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f1ebc-c191-4f14-ba62-b28f3f416973 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:39.937580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f1ebc-c191-4f14-ba62-b28f3f416973 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:39.938072 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f1ebc-c191-4f14-ba62-b28f3f416973 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:39.945560 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f1ebc-c191-4f14-ba62-b28f3f416973 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:39.947289 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f1ebc-c191-4f14-ba62-b28f3f416973 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:39.962680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-c44f1ebc-c191-4f14-ba62-b28f3f416973 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:39.962680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:39.962680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:39.962680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:39.962680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:39.962680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:39.962680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:39.962680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:39.962680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:39.962680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:39.962680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:39.962680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:39.962680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:39.962680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:39.962680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:39.963635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:39.963635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:39.963635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:39.963635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:39.963635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:39.963635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:39.963635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:39.963635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:39.963635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:39.963635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:39.963635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:39.963635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:39.963635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:39.963635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:39.963635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:39.963635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:39.963635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:39.964521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:39.964521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:39.964521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:39.964521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:39.964521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:39.964521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:39.964521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:39.964521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:39.970544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 449/900] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:39.972930 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd091c-4b91-4393-8f90-9433febe6670 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:40.037314 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308987ab-3502-4b57-b2ae-dac826109251 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:40.037616 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308987ab-3502-4b57-b2ae-dac826109251 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:40.037868 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308987ab-3502-4b57-b2ae-dac826109251 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:40.039522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 450/901] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:02:40.044855 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc4368-4fff-493a-b394-c78fcc3964ec None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:40.045204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc4368-4fff-493a-b394-c78fcc3964ec None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:40.045544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc4368-4fff-493a-b394-c78fcc3964ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:40.063822 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-38dc4368-4fff-493a-b394-c78fcc3964ec None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:40.065050 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-38dc4368-4fff-493a-b394-c78fcc3964ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:40.087103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd091c-4b91-4393-8f90-9433febe6670 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:40.130094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1a164-7442-4697-bf5d-8c10e2b1e4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:40.132135 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1a164-7442-4697-bf5d-8c10e2b1e4cc None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:40.132646 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1a164-7442-4697-bf5d-8c10e2b1e4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:40.133076 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1a164-7442-4697-bf5d-8c10e2b1e4cc None admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:40.134027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1a164-7442-4697-bf5d-8c10e2b1e4cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:40.134539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1a164-7442-4697-bf5d-8c10e2b1e4cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:40.136119 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1a164-7442-4697-bf5d-8c10e2b1e4cc None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:40.144016 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 451/902] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:02:40.150200 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 452/903] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:40.158031 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc4368-4fff-493a-b394-c78fcc3964ec None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:40.159370 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1a164-7442-4697-bf5d-8c10e2b1e4cc None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:40.268344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1a164-7442-4697-bf5d-8c10e2b1e4cc None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:40.276908 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc4368-4fff-493a-b394-c78fcc3964ec None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:40.311249 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507c646-9ba1-4624-981b-c98cfd9426ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:40.311951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65dda0b-77e1-4588-a927-bc2c7a9d172c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:40.312582 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507c646-9ba1-4624-981b-c98cfd9426ce None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:40.312700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dda0b-77e1-4588-a927-bc2c7a9d172c None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:40.312924 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dda0b-77e1-4588-a927-bc2c7a9d172c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:40.313207 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dda0b-77e1-4588-a927-bc2c7a9d172c None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:40.313568 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507c646-9ba1-4624-981b-c98cfd9426ce None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:40.313956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65dda0b-77e1-4588-a927-bc2c7a9d172c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:40.314257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507c646-9ba1-4624-981b-c98cfd9426ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:40.315349 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507c646-9ba1-4624-981b-c98cfd9426ce None admin] RBAC: Adding query filter params (role.id=be44cff8846d48519c82b28f7c2d2c90, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=c0fc3052af194b48b7ce036ff605ff25) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:40.315461 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65dda0b-77e1-4588-a927-bc2c7a9d172c None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:40.315975 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507c646-9ba1-4624-981b-c98cfd9426ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:40.317676 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507c646-9ba1-4624-981b-c98cfd9426ce None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:40.324878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 452/904] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:02:40 2022] GET /identity/v3/role_assignments?user.id=c0fc3052af194b48b7ce036ff605ff25&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=be44cff8846d48519c82b28f7c2d2c90 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:40.404703 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 453/905] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 10 21:02:40 2022] POST /identity/v3/services => generated 241 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:02:40.528094 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8812ac4-7b9d-449d-9d0b-56bbb2702bf8 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:40.528292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8812ac4-7b9d-449d-9d0b-56bbb2702bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:40.528573 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8812ac4-7b9d-449d-9d0b-56bbb2702bf8 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:40.530261 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 453/906] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:40.536744 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff33c6-0049-496a-9bd0-d50fd6b620b3 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:40.537117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff33c6-0049-496a-9bd0-d50fd6b620b3 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:40.537436 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff33c6-0049-496a-9bd0-d50fd6b620b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:40.556813 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-2aff33c6-0049-496a-9bd0-d50fd6b620b3 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:40.558048 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-2aff33c6-0049-496a-9bd0-d50fd6b620b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:40.637492 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 454/907] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:40.660270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8812ac4-7b9d-449d-9d0b-56bbb2702bf8 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:40.763553 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8812ac4-7b9d-449d-9d0b-56bbb2702bf8 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:40.801451 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1fb21-95b3-45f2-a4f8-83bf42b0f3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:40.802199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1fb21-95b3-45f2-a4f8-83bf42b0f3af None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:40.803199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1fb21-95b3-45f2-a4f8-83bf42b0f3af None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:40.803375 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1fb21-95b3-45f2-a4f8-83bf42b0f3af None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:40.804028 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1fb21-95b3-45f2-a4f8-83bf42b0f3af None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:40.805390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1fb21-95b3-45f2-a4f8-83bf42b0f3af None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:40.817836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-78c1fb21-95b3-45f2-a4f8-83bf42b0f3af None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 21:02:40.817836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:40.817836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:40.817836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:40.817836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:40.817836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:40.817836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:40.817836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:40.817836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 21:02:40.817836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:40.817836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:40.817836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:40.817836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:40.817836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:40.817836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:40.817836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:40.819128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:40.819128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:40.819128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:40.819128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:40.819128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:40.819128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:40.819128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:40.819128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:40.819128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:40.819128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:40.819128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:40.819128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:40.819128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:40.819128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:40.819128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:40.819128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:40.820472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:40.820472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:40.820472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:40.820472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:40.820472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:40.820472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:40.820472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:40.820472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:40.820472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:40.820472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:40.820472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:40.820472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:40.820472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:40.820472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 21:02:40.820472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:40.820472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 454/908] 10.222.0.25 () {56 vars in 1132 bytes} [Tue May 10 21:02:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:40.825437 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff33c6-0049-496a-9bd0-d50fd6b620b3 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:40.936542 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff33c6-0049-496a-9bd0-d50fd6b620b3 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:40.970699 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808bea6-34c0-401e-8166-6f4fb33557ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:40.971377 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808bea6-34c0-401e-8166-6f4fb33557ce None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:40.971667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808bea6-34c0-401e-8166-6f4fb33557ce None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:40.971946 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808bea6-34c0-401e-8166-6f4fb33557ce None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:40.972656 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808bea6-34c0-401e-8166-6f4fb33557ce None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:40.972964 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808bea6-34c0-401e-8166-6f4fb33557ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:40.974907 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808bea6-34c0-401e-8166-6f4fb33557ce None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:40.984522 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 455/909] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 10 21:02:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:40.987502 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1fb21-95b3-45f2-a4f8-83bf42b0f3af None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:41.093274 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1fb21-95b3-45f2-a4f8-83bf42b0f3af None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:41.127248 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f583d-4358-4cb1-9848-e1ac6b808e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:41.127929 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f583d-4358-4cb1-9848-e1ac6b808e30 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:41.128218 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f583d-4358-4cb1-9848-e1ac6b808e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:41.128498 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f583d-4358-4cb1-9848-e1ac6b808e30 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:41.129216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f583d-4358-4cb1-9848-e1ac6b808e30 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:41.129527 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f583d-4358-4cb1-9848-e1ac6b808e30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:41.130952 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f583d-4358-4cb1-9848-e1ac6b808e30 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:41.136399 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 455/910] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 10 21:02:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:41.141976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808bea6-34c0-401e-8166-6f4fb33557ce None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:41.249233 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808bea6-34c0-401e-8166-6f4fb33557ce None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:41.283089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4909b-22f9-4629-a977-6158b0d7355c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:41.283872 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4909b-22f9-4629-a977-6158b0d7355c None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:41.284077 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4909b-22f9-4629-a977-6158b0d7355c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:41.284356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4909b-22f9-4629-a977-6158b0d7355c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:41.285201 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4909b-22f9-4629-a977-6158b0d7355c None admin] RBAC: Adding query filter params (interface=public, service_id=d13edba226434502890726aa01a2d7c1, region_id=RegionOne) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:41.285512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4909b-22f9-4629-a977-6158b0d7355c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:41.287470 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4909b-22f9-4629-a977-6158b0d7355c None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:41.297397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 456/911] 10.222.0.25 () {56 vars in 1251 bytes} [Tue May 10 21:02:41 2022] GET /identity/v3/endpoints?service_id=d13edba226434502890726aa01a2d7c1&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:41.298817 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f583d-4358-4cb1-9848-e1ac6b808e30 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:41.397009 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f583d-4358-4cb1-9848-e1ac6b808e30 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:41.434547 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b6827-56a5-4ce5-8b94-c1ff75cb1f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:41.435225 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b6827-56a5-4ce5-8b94-c1ff75cb1f4a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:41.435514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b6827-56a5-4ce5-8b94-c1ff75cb1f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:41.435792 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b6827-56a5-4ce5-8b94-c1ff75cb1f4a None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:41.436512 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b6827-56a5-4ce5-8b94-c1ff75cb1f4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:41.437869 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b6827-56a5-4ce5-8b94-c1ff75cb1f4a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:41.444474 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 456/912] 10.222.0.25 () {56 vars in 1087 bytes} [Tue May 10 21:02:41 2022] GET /identity/v3/services => generated 1497 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:02:41.758275 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d8496-6faa-4903-92ba-6f123c150359 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:41.758660 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d8496-6faa-4903-92ba-6f123c150359 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:41.758845 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d8496-6faa-4903-92ba-6f123c150359 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:41.760361 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 457/913] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:41.765796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba5144-f4ff-40c4-bcfb-48f93481a299 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:41.766098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba5144-f4ff-40c4-bcfb-48f93481a299 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:41.766383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba5144-f4ff-40c4-bcfb-48f93481a299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:41.783949 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-01ba5144-f4ff-40c4-bcfb-48f93481a299 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:41.785125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-01ba5144-f4ff-40c4-bcfb-48f93481a299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:41.858592 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 457/914] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:02:41.880570 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d8496-6faa-4903-92ba-6f123c150359 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:41.983186 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d8496-6faa-4903-92ba-6f123c150359 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:42.016439 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881543f-e3ec-4bd9-8bc3-95e03a929c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:42.017170 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881543f-e3ec-4bd9-8bc3-95e03a929c72 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:42.017457 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881543f-e3ec-4bd9-8bc3-95e03a929c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:42.017736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881543f-e3ec-4bd9-8bc3-95e03a929c72 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:42.018395 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881543f-e3ec-4bd9-8bc3-95e03a929c72 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:42.019873 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881543f-e3ec-4bd9-8bc3-95e03a929c72 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:42.032667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-c881543f-e3ec-4bd9-8bc3-95e03a929c72 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 21:02:42.032667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:42.032667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:42.032667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:42.032667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:42.032667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:42.032667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:42.032667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:42.032667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 21:02:42.032667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:42.032667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:42.032667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:42.032667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:42.032667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:42.032667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:42.032667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:42.032667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:42.035016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:42.035016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:42.035016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:42.035016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:42.035016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:42.035016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:42.035016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:42.035016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:42.035016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:42.035016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:42.035016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:42.035016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:42.035016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:42.035016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:42.035016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:42.035016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:42.037339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:42.037339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:42.037339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:42.037339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:42.037339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:42.037339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:42.037339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:42.037339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:42.037339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:42.037339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:42.037339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:42.037339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:42.037339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 21:02:42.037339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:42.037339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 458/915] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:02:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:42.042469 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba5144-f4ff-40c4-bcfb-48f93481a299 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:42.142091 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba5144-f4ff-40c4-bcfb-48f93481a299 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:42.177812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7036824-1d7f-4b0f-a8d1-c91cf0966d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:42.178520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7036824-1d7f-4b0f-a8d1-c91cf0966d48 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:42.178808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7036824-1d7f-4b0f-a8d1-c91cf0966d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:42.179143 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7036824-1d7f-4b0f-a8d1-c91cf0966d48 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:42.179859 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7036824-1d7f-4b0f-a8d1-c91cf0966d48 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:42.180215 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7036824-1d7f-4b0f-a8d1-c91cf0966d48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:42.181585 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7036824-1d7f-4b0f-a8d1-c91cf0966d48 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:42.186813 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 458/916] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:02:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:42.192507 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881543f-e3ec-4bd9-8bc3-95e03a929c72 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:42.295010 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881543f-e3ec-4bd9-8bc3-95e03a929c72 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:42.328787 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26484a0f-9b2c-4877-8ec3-fc92fd1b480b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:42.329455 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26484a0f-9b2c-4877-8ec3-fc92fd1b480b None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:42.329888 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26484a0f-9b2c-4877-8ec3-fc92fd1b480b None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:42.330175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26484a0f-9b2c-4877-8ec3-fc92fd1b480b None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:42.330920 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26484a0f-9b2c-4877-8ec3-fc92fd1b480b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:42.331233 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26484a0f-9b2c-4877-8ec3-fc92fd1b480b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:42.332593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26484a0f-9b2c-4877-8ec3-fc92fd1b480b None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:42.337856 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 459/917] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 10 21:02:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:42.343573 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7036824-1d7f-4b0f-a8d1-c91cf0966d48 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:42.446729 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7036824-1d7f-4b0f-a8d1-c91cf0966d48 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:42.484011 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638c440-9350-42b0-b4b2-e358fac72dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:42.484694 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638c440-9350-42b0-b4b2-e358fac72dd7 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:42.484982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638c440-9350-42b0-b4b2-e358fac72dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:42.485262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638c440-9350-42b0-b4b2-e358fac72dd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:42.486042 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638c440-9350-42b0-b4b2-e358fac72dd7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:42.487478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638c440-9350-42b0-b4b2-e358fac72dd7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:42.563285 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 459/918] 10.222.0.25 () {60 vars in 1144 bytes} [Tue May 10 21:02:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:02:42.668982 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d693da-af43-4dae-b668-0457db98fbd1 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:42.668982 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d693da-af43-4dae-b668-0457db98fbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:42.668982 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d693da-af43-4dae-b668-0457db98fbd1 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:42.668982 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 460/919] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:42.678754 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c30a99-0775-46ea-98ea-e1de3b3c50d7 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:42.678754 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c30a99-0775-46ea-98ea-e1de3b3c50d7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:42.678754 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c30a99-0775-46ea-98ea-e1de3b3c50d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:42.695830 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-63c30a99-0775-46ea-98ea-e1de3b3c50d7 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:42.697403 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-63c30a99-0775-46ea-98ea-e1de3b3c50d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:42.785005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 460/920] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:42.808784 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d693da-af43-4dae-b668-0457db98fbd1 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:42.822487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed1571-a5f2-41a1-95d4-eaf588378a1e None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:42.822759 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed1571-a5f2-41a1-95d4-eaf588378a1e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:42.822994 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed1571-a5f2-41a1-95d4-eaf588378a1e None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:42.824610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 461/921] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:02:42.829525 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d106f-e498-4685-9ae8-0b2a25ccbd8a None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:42.829997 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d106f-e498-4685-9ae8-0b2a25ccbd8a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:42.830284 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d106f-e498-4685-9ae8-0b2a25ccbd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:42.857861 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-537d106f-e498-4685-9ae8-0b2a25ccbd8a None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:42.859561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-537d106f-e498-4685-9ae8-0b2a25ccbd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:42.922321 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d693da-af43-4dae-b668-0457db98fbd1 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:42.941215 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 462/922] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:02:42.965822 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b667c-5e70-4421-8d8b-2b8df82db133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:42.966735 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b667c-5e70-4421-8d8b-2b8df82db133 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:42.967019 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b667c-5e70-4421-8d8b-2b8df82db133 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:42.967430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b667c-5e70-4421-8d8b-2b8df82db133 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:42.968532 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d106f-e498-4685-9ae8-0b2a25ccbd8a None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:42.982209 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b667c-5e70-4421-8d8b-2b8df82db133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:42.991132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-174b667c-5e70-4421-8d8b-2b8df82db133 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 21:02:42.991132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:42.991132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:42.991132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:42.991132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:42.991132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:42.991132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:42.991132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:42.991132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:42.991132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:42.991132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:42.991132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:42.991132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:42.991132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:42.991132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:42.991132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:42.992103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:42.992103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:42.992103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:42.992103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:42.992103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:42.992103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:42.992103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:42.992103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:42.992103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:42.992103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:42.992103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:42.992103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:42.992103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:42.992103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:42.992103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:42.992103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:42.992953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:42.992953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:42.992953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:42.992953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:42.992953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:42.992953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:42.992953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:42.992953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:42.992953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:42.992953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:42.992953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 21:02:42.992953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:42.992953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 461/923] 10.222.0.25 () {56 vars in 1120 bytes} [Tue May 10 21:02:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:42.999452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b667c-5e70-4421-8d8b-2b8df82db133 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:43.101308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d106f-e498-4685-9ae8-0b2a25ccbd8a None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:43.104977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b667c-5e70-4421-8d8b-2b8df82db133 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:43.141325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83412371-0fd2-413c-aef0-d3c29126a2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:43.141992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198f388-739c-4bb9-ac43-840582d15564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:43.142467 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83412371-0fd2-413c-aef0-d3c29126a2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:43.142908 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83412371-0fd2-413c-aef0-d3c29126a2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:43.143116 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198f388-739c-4bb9-ac43-840582d15564 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:43.143471 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83412371-0fd2-413c-aef0-d3c29126a2c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:43.143590 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198f388-739c-4bb9-ac43-840582d15564 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:43.143930 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198f388-739c-4bb9-ac43-840582d15564 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:43.144623 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83412371-0fd2-413c-aef0-d3c29126a2c8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:43.144763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198f388-739c-4bb9-ac43-840582d15564 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:43.145194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83412371-0fd2-413c-aef0-d3c29126a2c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:43.147270 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83412371-0fd2-413c-aef0-d3c29126a2c8 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:43.148920 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198f388-739c-4bb9-ac43-840582d15564 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:43.157511 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 462/924] 10.222.0.25 () {56 vars in 1115 bytes} [Tue May 10 21:02:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:43.162914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-7198f388-739c-4bb9-ac43-840582d15564 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 21:02:43.162914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:43.162914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:43.162914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:43.162914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:43.162914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:43.162914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:43.162914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:43.162914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 21:02:43.162914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:43.162914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:43.162914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:43.162914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:43.162914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:43.162914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:43.162914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:43.162914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:43.164123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:43.164123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:43.164123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:43.164123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:43.164123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:43.164123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:43.164123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:43.164123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:43.164123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:43.164123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:43.164123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:43.164123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:43.164123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:43.164123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:43.164123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:43.164123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:43.165154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:43.165154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:43.165154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:43.165154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:43.165154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:43.165154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:43.165154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:43.165154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:43.165154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:43.165154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:43.165154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:43.165154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:43.165154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 21:02:43.165154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:43.166610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83412371-0fd2-413c-aef0-d3c29126a2c8 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:43.167408 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 463/925] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 10 21:02:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:43.175420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198f388-739c-4bb9-ac43-840582d15564 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:43.280892 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83412371-0fd2-413c-aef0-d3c29126a2c8 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:43.287588 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198f388-739c-4bb9-ac43-840582d15564 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:43.321658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f64269-7752-4297-b4cf-3f54361f0696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:43.322539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f64269-7752-4297-b4cf-3f54361f0696 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:43.322824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f64269-7752-4297-b4cf-3f54361f0696 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:43.323098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f64269-7752-4297-b4cf-3f54361f0696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:43.328927 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab2aa5-89d6-4df9-867d-735f595db2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:43.330220 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab2aa5-89d6-4df9-867d-735f595db2fc None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:43.330616 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab2aa5-89d6-4df9-867d-735f595db2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:43.330968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab2aa5-89d6-4df9-867d-735f595db2fc None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:43.331756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab2aa5-89d6-4df9-867d-735f595db2fc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:43.332474 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab2aa5-89d6-4df9-867d-735f595db2fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:43.334292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f64269-7752-4297-b4cf-3f54361f0696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:43.334818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab2aa5-89d6-4df9-867d-735f595db2fc None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:43.335832 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f64269-7752-4297-b4cf-3f54361f0696 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:43.340787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 464/926] 10.222.0.25 () {56 vars in 1122 bytes} [Tue May 10 21:02:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:43.346480 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab2aa5-89d6-4df9-867d-735f595db2fc None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:43.359267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-27f64269-7752-4297-b4cf-3f54361f0696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:43.359267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:43.359267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:43.359267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:43.359267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:43.359267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:43.359267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:43.359267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:43.359267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:43.359267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:43.359267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:43.359267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:43.359267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:43.359267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:43.359267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:43.361037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:43.361037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:43.361037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:43.361037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:43.361037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:43.361037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:43.361037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:43.361037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:43.361037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:43.361037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:43.361037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:43.361037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:43.361037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:43.361037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:43.361037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:43.361037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:43.361037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:43.362153 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:43.362153 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:43.362153 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:43.362153 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:43.362153 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 463/927] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:43.368614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f64269-7752-4297-b4cf-3f54361f0696 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:43.458176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab2aa5-89d6-4df9-867d-735f595db2fc None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:43.495043 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d064ec-51e7-492a-a5e0-b5e1a4da7032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:43.495736 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d064ec-51e7-492a-a5e0-b5e1a4da7032 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:43.496015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d064ec-51e7-492a-a5e0-b5e1a4da7032 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:43.496178 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f64269-7752-4297-b4cf-3f54361f0696 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:43.496352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d064ec-51e7-492a-a5e0-b5e1a4da7032 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:43.496980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d064ec-51e7-492a-a5e0-b5e1a4da7032 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:43.497286 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d064ec-51e7-492a-a5e0-b5e1a4da7032 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:43.498680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d064ec-51e7-492a-a5e0-b5e1a4da7032 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:43.504131 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 465/928] 10.222.0.25 () {56 vars in 1122 bytes} [Tue May 10 21:02:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:43.510729 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d064ec-51e7-492a-a5e0-b5e1a4da7032 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:43.540406 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ef164-5f83-4bf1-aea3-319647f9b62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:43.541098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ef164-5f83-4bf1-aea3-319647f9b62d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:43.541383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ef164-5f83-4bf1-aea3-319647f9b62d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:43.541662 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ef164-5f83-4bf1-aea3-319647f9b62d None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:43.542399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ef164-5f83-4bf1-aea3-319647f9b62d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:43.542858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ef164-5f83-4bf1-aea3-319647f9b62d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:43.544485 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ef164-5f83-4bf1-aea3-319647f9b62d None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:43.557917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 464/929] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:43.564118 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ef164-5f83-4bf1-aea3-319647f9b62d None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:43.617969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d064ec-51e7-492a-a5e0-b5e1a4da7032 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:43.651370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22ecc0-8563-4eb4-adfd-47e2a43ec0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:43.652023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22ecc0-8563-4eb4-adfd-47e2a43ec0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:43.652306 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22ecc0-8563-4eb4-adfd-47e2a43ec0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:43.652584 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22ecc0-8563-4eb4-adfd-47e2a43ec0f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:43.653730 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22ecc0-8563-4eb4-adfd-47e2a43ec0f6 None admin] RBAC: Adding query filter params (interface=public, service_id=0f2aee5a6c414aaaa1fab05634b1427c, region_id=RegionOne) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:43.653730 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22ecc0-8563-4eb4-adfd-47e2a43ec0f6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:43.655139 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22ecc0-8563-4eb4-adfd-47e2a43ec0f6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:43.660573 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 466/930] 10.222.0.25 () {56 vars in 1251 bytes} [Tue May 10 21:02:43 2022] GET /identity/v3/endpoints?service_id=0f2aee5a6c414aaaa1fab05634b1427c&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:43.666468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22ecc0-8563-4eb4-adfd-47e2a43ec0f6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:43.670535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ef164-5f83-4bf1-aea3-319647f9b62d None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:43.712311 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a5969-c380-4167-bf15-ff18aeef63ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:43.713133 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a5969-c380-4167-bf15-ff18aeef63ea None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:43.713417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a5969-c380-4167-bf15-ff18aeef63ea None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:43.713692 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a5969-c380-4167-bf15-ff18aeef63ea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:43.720669 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a5969-c380-4167-bf15-ff18aeef63ea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:43.722084 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a5969-c380-4167-bf15-ff18aeef63ea None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:43.737556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-639a5969-c380-4167-bf15-ff18aeef63ea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 21:02:43.737556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:43.737556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:43.737556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:43.737556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:43.737556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:43.737556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:43.737556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:43.737556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:43.737556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:43.737556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:43.737556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:43.737556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:43.737556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:43.737556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:43.737556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:43.738593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:43.738593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:43.738593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:43.738593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:43.738593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:43.738593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:43.738593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:43.738593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:43.738593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:43.738593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:43.738593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:43.738593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:43.738593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:43.738593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:43.738593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:43.738593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:43.738593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:43.738593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:43.739576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:43.739576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:43.739576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:43.739576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:43.739576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:43.739576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:43.739576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:43.739576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:43.739576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 21:02:43.739576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:43.739576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 465/931] 10.222.0.25 () {56 vars in 1117 bytes} [Tue May 10 21:02:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:43.740985 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695b5cd-b0cf-4653-bde2-8c20caa990d8 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:43.740985 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695b5cd-b0cf-4653-bde2-8c20caa990d8 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:43.741233 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695b5cd-b0cf-4653-bde2-8c20caa990d8 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:43.742600 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 466/932] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:43.744642 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695b5cd-b0cf-4653-bde2-8c20caa990d8 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:43.772448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22ecc0-8563-4eb4-adfd-47e2a43ec0f6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:43.807180 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaeba7d-5e0c-4e85-b2cd-0e6fcfc554dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:43.807866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaeba7d-5e0c-4e85-b2cd-0e6fcfc554dc None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:43.808148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaeba7d-5e0c-4e85-b2cd-0e6fcfc554dc None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:43.808425 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaeba7d-5e0c-4e85-b2cd-0e6fcfc554dc None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:43.809119 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaeba7d-5e0c-4e85-b2cd-0e6fcfc554dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:43.810538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaeba7d-5e0c-4e85-b2cd-0e6fcfc554dc None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:43.816899 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 467/933] 10.222.0.25 () {56 vars in 1087 bytes} [Tue May 10 21:02:43 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:02:43.818808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e49c1-f84e-4a20-afb8-e4465c5c8cce None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:43.819209 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e49c1-f84e-4a20-afb8-e4465c5c8cce None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:43.819492 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e49c1-f84e-4a20-afb8-e4465c5c8cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:43.842592 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-df1e49c1-f84e-4a20-afb8-e4465c5c8cce None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:43.843856 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-df1e49c1-f84e-4a20-afb8-e4465c5c8cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:43.867507 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695b5cd-b0cf-4653-bde2-8c20caa990d8 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:43.907269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6a8a9-a802-4e11-8f54-97cfc2f1e837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:43.907873 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6a8a9-a802-4e11-8f54-97cfc2f1e837 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:43.908156 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6a8a9-a802-4e11-8f54-97cfc2f1e837 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:43.908426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6a8a9-a802-4e11-8f54-97cfc2f1e837 None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:43.909283 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6a8a9-a802-4e11-8f54-97cfc2f1e837 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:43.909589 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6a8a9-a802-4e11-8f54-97cfc2f1e837 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:43.911106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6a8a9-a802-4e11-8f54-97cfc2f1e837 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:43.939822 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 467/934] 10.222.0.25 () {56 vars in 1149 bytes} [Tue May 10 21:02:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:43.940806 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6a8a9-a802-4e11-8f54-97cfc2f1e837 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:43.947685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 468/935] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:43.969389 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e49c1-f84e-4a20-afb8-e4465c5c8cce None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:44.052595 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6a8a9-a802-4e11-8f54-97cfc2f1e837 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:44.077764 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e49c1-f84e-4a20-afb8-e4465c5c8cce None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:44.089000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bbb56-ef8c-429e-a27f-75da00748286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:44.089803 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bbb56-ef8c-429e-a27f-75da00748286 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:44.090080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bbb56-ef8c-429e-a27f-75da00748286 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:44.090349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bbb56-ef8c-429e-a27f-75da00748286 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:44.102282 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bbb56-ef8c-429e-a27f-75da00748286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:44.103784 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bbb56-ef8c-429e-a27f-75da00748286 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:44.118618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fa652-14db-45ab-912c-f949fecc5b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:44.119774 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fa652-14db-45ab-912c-f949fecc5b51 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:44.120256 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fa652-14db-45ab-912c-f949fecc5b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:44.120726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fa652-14db-45ab-912c-f949fecc5b51 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:44.121636 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fa652-14db-45ab-912c-f949fecc5b51 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:44.122520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-6d5bbb56-ef8c-429e-a27f-75da00748286 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:44.122520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:44.122520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:44.122520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:44.122520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:44.122520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:44.122520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:44.122520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:44.122520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:44.122520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:44.122520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:44.122520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:44.122520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:44.122520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:44.122520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:44.123367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:44.123367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:44.123367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:44.123367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:44.123367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:44.123367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:44.123367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:44.123367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:44.123367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:44.123367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:44.123367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:44.123367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:44.123367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:44.123367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:44.123367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:44.123367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:44.123367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:44.124681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:44.124681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:44.124681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:44.124681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:44.124681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 468/936] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:44.126019 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fa652-14db-45ab-912c-f949fecc5b51 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:44.129306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bbb56-ef8c-429e-a27f-75da00748286 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:44.143846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-664fa652-14db-45ab-912c-f949fecc5b51 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 21:02:44.143846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:44.143846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:44.143846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:44.143846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:44.143846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:44.143846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:44.143846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:44.143846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 21:02:44.143846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:44.143846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:44.143846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:44.143846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:44.143846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:44.143846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:44.143846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:44.144834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:44.144834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:44.144834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:44.144834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:44.144834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:44.144834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:44.144834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:44.144834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:44.144834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:44.144834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:44.144834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:44.144834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:44.144834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:44.144834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:44.144834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:44.144834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:44.145675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:44.145675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:44.145675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:44.145675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:44.145675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:44.145675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:44.145675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:44.145675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:44.145675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:44.145675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:44.145675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:44.145675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:44.145675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:44.145675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 21:02:44.145675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:44.150484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 469/937] 10.222.0.25 () {56 vars in 1132 bytes} [Tue May 10 21:02:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:44.154624 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fa652-14db-45ab-912c-f949fecc5b51 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:44.236864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bbb56-ef8c-429e-a27f-75da00748286 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:44.269886 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fa652-14db-45ab-912c-f949fecc5b51 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:44.271840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c94975-2778-48a2-8497-4414ab08bc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:44.272614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c94975-2778-48a2-8497-4414ab08bc18 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:44.272995 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c94975-2778-48a2-8497-4414ab08bc18 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:44.273390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c94975-2778-48a2-8497-4414ab08bc18 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:44.274212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c94975-2778-48a2-8497-4414ab08bc18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:44.274634 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c94975-2778-48a2-8497-4414ab08bc18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:44.276081 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c94975-2778-48a2-8497-4414ab08bc18 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:44.288917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 469/938] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:44.294508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c94975-2778-48a2-8497-4414ab08bc18 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:44.305140 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038fe2b-cc2b-4d34-8b64-96addba30b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:44.306105 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038fe2b-cc2b-4d34-8b64-96addba30b01 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:44.306105 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038fe2b-cc2b-4d34-8b64-96addba30b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:44.306390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038fe2b-cc2b-4d34-8b64-96addba30b01 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:44.307236 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038fe2b-cc2b-4d34-8b64-96addba30b01 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:44.307545 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038fe2b-cc2b-4d34-8b64-96addba30b01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:44.308950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038fe2b-cc2b-4d34-8b64-96addba30b01 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:44.314409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 470/939] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 10 21:02:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:44.322055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038fe2b-cc2b-4d34-8b64-96addba30b01 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:44.402329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c94975-2778-48a2-8497-4414ab08bc18 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:44.421276 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038fe2b-cc2b-4d34-8b64-96addba30b01 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:44.437432 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab2d1a-1202-42d4-ad31-d24ec243ef29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:44.438393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab2d1a-1202-42d4-ad31-d24ec243ef29 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:44.438884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab2d1a-1202-42d4-ad31-d24ec243ef29 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:44.439187 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab2d1a-1202-42d4-ad31-d24ec243ef29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:44.447481 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab2d1a-1202-42d4-ad31-d24ec243ef29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:44.449050 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab2d1a-1202-42d4-ad31-d24ec243ef29 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:44.458126 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0febb6-ccec-4f6f-b1ca-e84502b7a2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:44.459600 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0febb6-ccec-4f6f-b1ca-e84502b7a2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:44.460134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0febb6-ccec-4f6f-b1ca-e84502b7a2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:44.460567 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0febb6-ccec-4f6f-b1ca-e84502b7a2d5 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:44.461417 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0febb6-ccec-4f6f-b1ca-e84502b7a2d5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:44.461867 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0febb6-ccec-4f6f-b1ca-e84502b7a2d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:44.463392 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0febb6-ccec-4f6f-b1ca-e84502b7a2d5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:44.465751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-e8ab2d1a-1202-42d4-ad31-d24ec243ef29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:44.465751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:44.465751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:44.465751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:44.465751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:44.465751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:44.465751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:44.465751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:44.465751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:44.465751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:44.465751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:44.465751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:44.465751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:44.465751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:44.465751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:44.466821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:44.466821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:44.466821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:44.466821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:44.466821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:44.466821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:44.466821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:44.466821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:44.466821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:44.466821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:44.466821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:44.466821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:44.466821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:44.466821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:44.466821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:44.466821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:44.466821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:44.467731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:44.467731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:44.467731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:44.467731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:44.467731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:44.467731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:44.467731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:44.467731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:44.468356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 470/940] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:44.476251 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab2d1a-1202-42d4-ad31-d24ec243ef29 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:44.476617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 471/941] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 10 21:02:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:44.477922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0febb6-ccec-4f6f-b1ca-e84502b7a2d5 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:44.581558 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab2d1a-1202-42d4-ad31-d24ec243ef29 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:44.592347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0febb6-ccec-4f6f-b1ca-e84502b7a2d5 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:44.625603 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaf301-2c0c-4e25-bfaa-e509b6e229e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:44.625888 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ab983-79fe-4bc1-bfc1-bdb3388f8178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:44.626452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaf301-2c0c-4e25-bfaa-e509b6e229e3 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:44.626810 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaf301-2c0c-4e25-bfaa-e509b6e229e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:44.627085 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ab983-79fe-4bc1-bfc1-bdb3388f8178 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:44.627198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaf301-2c0c-4e25-bfaa-e509b6e229e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:44.627599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ab983-79fe-4bc1-bfc1-bdb3388f8178 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:44.628014 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ab983-79fe-4bc1-bfc1-bdb3388f8178 None admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:44.628138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daaf301-2c0c-4e25-bfaa-e509b6e229e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:44.629047 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ab983-79fe-4bc1-bfc1-bdb3388f8178 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:44.629501 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ab983-79fe-4bc1-bfc1-bdb3388f8178 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:44.629608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daaf301-2c0c-4e25-bfaa-e509b6e229e3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:44.631838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ab983-79fe-4bc1-bfc1-bdb3388f8178 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:44.645344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 471/942] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:44.651823 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ab983-79fe-4bc1-bfc1-bdb3388f8178 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:44.738852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 472/943] 10.222.0.25 () {60 vars in 1144 bytes} [Tue May 10 21:02:44 2022] POST /identity/v3/endpoints => generated 347 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:02:44.756854 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ab983-79fe-4bc1-bfc1-bdb3388f8178 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:44.808803 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf3ba9-7e99-4016-9862-c9c184dd1569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:44.810005 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf3ba9-7e99-4016-9862-c9c184dd1569 None admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:44.810476 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf3ba9-7e99-4016-9862-c9c184dd1569 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:44.810945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf3ba9-7e99-4016-9862-c9c184dd1569 None admin] PATH_INFO: `/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/c0fc3052af194b48b7ce036ff605ff25/roles/be44cff8846d48519c82b28f7c2d2c90` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:44.813480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf3ba9-7e99-4016-9862-c9c184dd1569 None admin] RBAC: Authorizing `identity:create_grant(project_id=385eeb55a9ae42eba674de1e83d96e0d, user_id=c0fc3052af194b48b7ce036ff605ff25, role_id=be44cff8846d48519c82b28f7c2d2c90)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:44.815165 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf3ba9-7e99-4016-9862-c9c184dd1569 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:44.890286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 472/944] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:02:44 2022] PUT /identity/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/c0fc3052af194b48b7ce036ff605ff25/roles/be44cff8846d48519c82b28f7c2d2c90 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:02:44.967012 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc4149-b509-4cff-8536-43a0285a5905 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:44.967306 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc4149-b509-4cff-8536-43a0285a5905 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:44.967592 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc4149-b509-4cff-8536-43a0285a5905 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:44.969226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 473/945] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:44.980476 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa27e7-b37a-4885-ae7a-4f7e15abc68c None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:44.980790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa27e7-b37a-4885-ae7a-4f7e15abc68c None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:44.981072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa27e7-b37a-4885-ae7a-4f7e15abc68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:45.002981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-f9fa27e7-b37a-4885-ae7a-4f7e15abc68c None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:45.004211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-f9fa27e7-b37a-4885-ae7a-4f7e15abc68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:45.085895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 473/946] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:45.109629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc4149-b509-4cff-8536-43a0285a5905 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:45.240563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc4149-b509-4cff-8536-43a0285a5905 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:45.291864 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee87193-ae6a-4a0c-ad0d-a9323617f7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:45.292556 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee87193-ae6a-4a0c-ad0d-a9323617f7fb None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:45.292830 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee87193-ae6a-4a0c-ad0d-a9323617f7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:45.298501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee87193-ae6a-4a0c-ad0d-a9323617f7fb None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:45.298501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee87193-ae6a-4a0c-ad0d-a9323617f7fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:45.298501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee87193-ae6a-4a0c-ad0d-a9323617f7fb None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:45.298501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: WARNING keystone.server.flask.common [None req-0ee87193-ae6a-4a0c-ad0d-a9323617f7fb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 21:02:45.367728 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.sql.core [None req-0ee87193-ae6a-4a0c-ad0d-a9323617f7fb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 21:02:45.367728 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 21:02:45.367728 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [parameters: {'id': 'f8b07ec40c414625b8b4d40a96c00e7f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 21:02:45.367728 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80454) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 21:02:45.375656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-0ee87193-ae6a-4a0c-ad0d-a9323617f7fb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f8b07ec40c414625b8b4d40a96c00e7f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f8b07ec40c414625b8b4d40a96c00e7f. May 10 21:02:45.375656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:45.375656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 21:02:45.375656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 21:02:45.375656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 21:02:45.375656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 21:02:45.375656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 21:02:45.375656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application result = self._query(query) May 10 21:02:45.375656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 21:02:45.375656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application conn.query(q) May 10 21:02:45.375656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 21:02:45.375656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 21:02:45.375656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 21:02:45.379757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application result.read() May 10 21:02:45.379757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 21:02:45.379757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 21:02:45.379757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 21:02:45.379757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 21:02:45.379757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 21:02:45.379757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 21:02:45.379757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 21:02:45.379757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 21:02:45.379757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 21:02:45.379757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:45.379757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 21:02:45.379757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:45.379757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:45.379757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 21:02:45.379757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 21:02:45.379757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 10 21:02:45.379757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return project_ref.to_dict() May 10 21:02:45.380804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 21:02:45.380804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application next(self.gen) May 10 21:02:45.380804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 21:02:45.380804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application yield resource May 10 21:02:45.380804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 21:02:45.380804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application next(self.gen) May 10 21:02:45.380804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 21:02:45.380804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.session.rollback() May 10 21:02:45.380804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 21:02:45.380804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.force_reraise() May 10 21:02:45.380804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 21:02:45.380804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise self.value May 10 21:02:45.380804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 21:02:45.380804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 21:02:45.380804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 21:02:45.380804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application session.commit() May 10 21:02:45.380804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 21:02:45.381724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 21:02:45.381724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 21:02:45.381724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._prepare_impl() May 10 21:02:45.381724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 21:02:45.381724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.session.flush() May 10 21:02:45.381724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 21:02:45.381724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._flush(objects) May 10 21:02:45.381724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 21:02:45.381724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 21:02:45.381724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 21:02:45.381724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application compat.raise_( May 10 21:02:45.381724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 21:02:45.381724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception May 10 21:02:45.381724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 21:02:45.381724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application flush_context.execute() May 10 21:02:45.381724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 21:02:45.381724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rec.execute(self) May 10 21:02:45.383598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 21:02:45.383598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 21:02:45.383598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 21:02:45.383598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 21:02:45.383598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 21:02:45.383598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 21:02:45.383598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 21:02:45.383598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 21:02:45.383598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 21:02:45.383598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 21:02:45.383598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 21:02:45.383598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 21:02:45.383598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 21:02:45.383598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 21:02:45.383598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 21:02:45.385522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 21:02:45.385522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 21:02:45.385522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception May 10 21:02:45.385522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 21:02:45.385522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 21:02:45.385522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 21:02:45.385522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 21:02:45.385522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 21:02:45.385522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application result = self._query(query) May 10 21:02:45.385522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 21:02:45.385522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application conn.query(q) May 10 21:02:45.385522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 21:02:45.385522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 21:02:45.385522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 21:02:45.385522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application result.read() May 10 21:02:45.385522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 21:02:45.385522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 21:02:45.387688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 21:02:45.387688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 21:02:45.387688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 21:02:45.387688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 21:02:45.387688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 21:02:45.387688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 21:02:45.387688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 21:02:45.387688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 21:02:45.387688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [parameters: {'id': 'f8b07ec40c414625b8b4d40a96c00e7f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 21:02:45.387688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 21:02:45.387688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:45.387688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:45.387688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:45.387688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:45.387688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 10 21:02:45.389564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 10 21:02:45.389564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 21:02:45.389564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 21:02:45.389564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 10 21:02:45.389564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:45.389564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:45.389564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:45.389564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:45.389564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:45.389564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:45.389564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:45.389564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:45.389564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:45.389564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:45.389564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:45.389564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:45.389564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:45.398137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:45.398137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 10 21:02:45.398137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 10 21:02:45.398137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:45.398137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:45.398137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 10 21:02:45.398137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.Conflict( May 10 21:02:45.398137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f8b07ec40c414625b8b4d40a96c00e7f. May 10 21:02:45.398137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:45.398137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 474/947] 10.222.0.25 () {60 vars in 1140 bytes} [Tue May 10 21:02:45 2022] POST /identity/v3/projects => generated 262 bytes in 268 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:45.399460 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa27e7-b37a-4885-ae7a-4f7e15abc68c None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:45.499775 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa27e7-b37a-4885-ae7a-4f7e15abc68c None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:45.535719 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a4259-56a6-45d2-8b65-8357fb8f469e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:45.537477 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a4259-56a6-45d2-8b65-8357fb8f469e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:45.538005 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a4259-56a6-45d2-8b65-8357fb8f469e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:45.538517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a4259-56a6-45d2-8b65-8357fb8f469e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:45.546305 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a4259-56a6-45d2-8b65-8357fb8f469e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:45.548018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a4259-56a6-45d2-8b65-8357fb8f469e None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:45.562342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-c99a4259-56a6-45d2-8b65-8357fb8f469e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:45.562342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:45.562342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:45.562342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:45.562342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:45.562342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:45.562342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:45.562342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:45.562342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:45.562342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:45.562342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:45.562342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:45.562342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:45.562342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:45.562342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:45.563309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:45.563309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:45.563309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:45.563309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:45.563309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:45.563309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:45.563309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:45.563309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:45.563309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:45.563309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:45.563309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:45.563309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:45.563309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:45.563309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:45.563309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:45.563309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:45.563309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:45.564221 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:45.564221 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:45.564221 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:45.564221 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:45.564221 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:45.564221 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:45.564221 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:45.564221 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:45.570771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 474/948] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:45.575769 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee87193-ae6a-4a0c-ad0d-a9323617f7fb None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:45.685599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee87193-ae6a-4a0c-ad0d-a9323617f7fb None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:45.720866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16326a31-0788-4ca8-9d35-cb84331dcd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:45.721530 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16326a31-0788-4ca8-9d35-cb84331dcd16 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:45.721816 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16326a31-0788-4ca8-9d35-cb84331dcd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:45.722092 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16326a31-0788-4ca8-9d35-cb84331dcd16 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:45.722881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16326a31-0788-4ca8-9d35-cb84331dcd16 None admin] RBAC: Adding query filter params (name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:45.723188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16326a31-0788-4ca8-9d35-cb84331dcd16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:45.725996 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16326a31-0788-4ca8-9d35-cb84331dcd16 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:45.747152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 475/949] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 10 21:02:45 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:46.243817 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6d0fe-b992-4e72-b46d-0bfc6c34981e None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:46.244564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6d0fe-b992-4e72-b46d-0bfc6c34981e None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:46.245063 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6d0fe-b992-4e72-b46d-0bfc6c34981e None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:46.246903 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 475/950] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:46.252543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fac86-1468-45ec-9d05-c050f25713f9 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:46.253062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fac86-1468-45ec-9d05-c050f25713f9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:46.253562 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fac86-1468-45ec-9d05-c050f25713f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:46.271587 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-678fac86-1468-45ec-9d05-c050f25713f9 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:46.273605 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-678fac86-1468-45ec-9d05-c050f25713f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:46.342304 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 476/951] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:46.366551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6d0fe-b992-4e72-b46d-0bfc6c34981e None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:46.471297 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6d0fe-b992-4e72-b46d-0bfc6c34981e None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:46.506375 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fef3c-e76f-4b63-be6a-1490b511cef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:46.507223 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fef3c-e76f-4b63-be6a-1490b511cef1 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:46.507509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fef3c-e76f-4b63-be6a-1490b511cef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:46.507784 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fef3c-e76f-4b63-be6a-1490b511cef1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:46.508439 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fef3c-e76f-4b63-be6a-1490b511cef1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:46.509854 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fef3c-e76f-4b63-be6a-1490b511cef1 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:46.522356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-8d2fef3c-e76f-4b63-be6a-1490b511cef1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 21:02:46.522356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:46.522356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:46.522356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:46.522356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:46.522356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:46.522356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:46.522356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:46.522356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 21:02:46.522356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:46.522356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:46.522356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:46.522356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:46.522356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:46.522356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:46.522356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:46.522356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:46.523444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:46.523444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:46.523444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:46.523444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:46.523444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:46.523444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:46.523444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:46.523444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:46.523444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:46.523444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:46.523444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:46.523444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:46.523444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:46.523444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:46.523444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:46.523444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:46.524304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:46.524304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:46.524304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:46.524304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:46.524304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:46.524304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:46.524304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:46.524304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:46.524304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:46.524304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:46.524304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:46.524304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:46.524304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 21:02:46.524304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:46.524304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 476/952] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 10 21:02:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:46.531968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fac86-1468-45ec-9d05-c050f25713f9 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:46.635914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fac86-1468-45ec-9d05-c050f25713f9 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:46.672279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f691ea-3bdc-4712-84f8-9de3bf2d16f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:46.672957 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f691ea-3bdc-4712-84f8-9de3bf2d16f1 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:46.673245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f691ea-3bdc-4712-84f8-9de3bf2d16f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:46.673521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f691ea-3bdc-4712-84f8-9de3bf2d16f1 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:46.674229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f691ea-3bdc-4712-84f8-9de3bf2d16f1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:46.674564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f691ea-3bdc-4712-84f8-9de3bf2d16f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:46.675922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f691ea-3bdc-4712-84f8-9de3bf2d16f1 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:46.682506 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 477/953] 10.222.0.25 () {56 vars in 1122 bytes} [Tue May 10 21:02:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:46.687845 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fef3c-e76f-4b63-be6a-1490b511cef1 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:46.793786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fef3c-e76f-4b63-be6a-1490b511cef1 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:46.828259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fc4e2-62c7-4de3-afe8-c000371c1216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:46.828928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fc4e2-62c7-4de3-afe8-c000371c1216 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:46.829215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fc4e2-62c7-4de3-afe8-c000371c1216 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:46.829493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fc4e2-62c7-4de3-afe8-c000371c1216 None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:46.830207 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fc4e2-62c7-4de3-afe8-c000371c1216 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:46.830542 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fc4e2-62c7-4de3-afe8-c000371c1216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:46.831911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fc4e2-62c7-4de3-afe8-c000371c1216 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:46.837719 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 477/954] 10.222.0.25 () {56 vars in 1122 bytes} [Tue May 10 21:02:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:46.844026 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f691ea-3bdc-4712-84f8-9de3bf2d16f1 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:46.949037 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f691ea-3bdc-4712-84f8-9de3bf2d16f1 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:46.984515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9a5a4-963b-41c2-853e-46b3f9196c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:46.985525 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9a5a4-963b-41c2-853e-46b3f9196c71 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:46.986021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9a5a4-963b-41c2-853e-46b3f9196c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:46.986549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9a5a4-963b-41c2-853e-46b3f9196c71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:46.987504 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9a5a4-963b-41c2-853e-46b3f9196c71 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:46.989108 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9a5a4-963b-41c2-853e-46b3f9196c71 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:47.094683 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 478/955] 10.222.0.25 () {60 vars in 1144 bytes} [Tue May 10 21:02:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:02:47.223897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6bb83-03de-4aec-9278-4ca9f1b97b5f None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:47.224256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6bb83-03de-4aec-9278-4ca9f1b97b5f None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:47.224472 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6bb83-03de-4aec-9278-4ca9f1b97b5f None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:47.226037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 478/956] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:47.231929 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fbcce-8686-4298-8124-ef3d7ea5f8a8 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:47.232527 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fbcce-8686-4298-8124-ef3d7ea5f8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:47.233025 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fbcce-8686-4298-8124-ef3d7ea5f8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:47.251705 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-4c9fbcce-8686-4298-8124-ef3d7ea5f8a8 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:47.253303 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4c9fbcce-8686-4298-8124-ef3d7ea5f8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:47.335058 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 479/957] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:47.358937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6bb83-03de-4aec-9278-4ca9f1b97b5f None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:47.361441 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671581c8-15ad-4506-bee8-029579ac7e2c None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:47.361736 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671581c8-15ad-4506-bee8-029579ac7e2c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:47.362023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671581c8-15ad-4506-bee8-029579ac7e2c None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:47.363423 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 480/958] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:02:47.369095 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b2a54-3186-4dc9-86f8-d626970997e9 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:47.369389 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b2a54-3186-4dc9-86f8-d626970997e9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:47.369672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b2a54-3186-4dc9-86f8-d626970997e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:47.386802 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a01b2a54-3186-4dc9-86f8-d626970997e9 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:47.387985 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a01b2a54-3186-4dc9-86f8-d626970997e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:47.461675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 481/959] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:02:47.472152 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6bb83-03de-4aec-9278-4ca9f1b97b5f None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:47.485565 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b2a54-3186-4dc9-86f8-d626970997e9 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:47.512471 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0cb5a-54ed-4407-9324-dd8308c3d961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:47.513276 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0cb5a-54ed-4407-9324-dd8308c3d961 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:47.513563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0cb5a-54ed-4407-9324-dd8308c3d961 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:47.513842 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0cb5a-54ed-4407-9324-dd8308c3d961 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:47.514530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0cb5a-54ed-4407-9324-dd8308c3d961 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:47.515901 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0cb5a-54ed-4407-9324-dd8308c3d961 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:47.531529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-9fc0cb5a-54ed-4407-9324-dd8308c3d961 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 21:02:47.531529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:47.531529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:47.531529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:47.531529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:47.531529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:47.531529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:47.531529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:47.531529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 21:02:47.531529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:47.531529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:47.531529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:47.531529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:47.531529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:47.531529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:47.531529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:47.531529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:47.532572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:47.532572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:47.532572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:47.532572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:47.532572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:47.532572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:47.532572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:47.532572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:47.532572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:47.532572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:47.532572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:47.532572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:47.532572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:47.532572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:47.532572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:47.532572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:47.533517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:47.533517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:47.533517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:47.533517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:47.533517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:47.533517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:47.533517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:47.533517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:47.533517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:47.533517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:47.533517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:47.533517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:47.533517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 21:02:47.533517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:47.533517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 479/960] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:47.540820 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0cb5a-54ed-4407-9324-dd8308c3d961 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:47.600319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b2a54-3186-4dc9-86f8-d626970997e9 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:47.635487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0ed02-1274-4bce-915e-6d2b7c5b9184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:47.636229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0ed02-1274-4bce-915e-6d2b7c5b9184 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:47.636766 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0ed02-1274-4bce-915e-6d2b7c5b9184 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:47.636766 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0ed02-1274-4bce-915e-6d2b7c5b9184 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:47.647964 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0cb5a-54ed-4407-9324-dd8308c3d961 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:47.648234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0ed02-1274-4bce-915e-6d2b7c5b9184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:47.656645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-30e0ed02-1274-4bce-915e-6d2b7c5b9184 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 21:02:47.656645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:47.656645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:47.656645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:47.656645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:47.656645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:47.656645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:47.656645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:47.656645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:47.656645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:47.656645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:47.656645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:47.656645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:47.656645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:47.656645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:47.656645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:47.657732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:47.657732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:47.657732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:47.657732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:47.657732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:47.657732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:47.657732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:47.657732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:47.657732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:47.657732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:47.657732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:47.657732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:47.657732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:47.657732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:47.657732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:47.657732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:47.658652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:47.658652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:47.658652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:47.658652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:47.658652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:47.658652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:47.658652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:47.658652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:47.658652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:47.658652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:47.658652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 21:02:47.658652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:47.658652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 482/961] 10.222.0.25 () {56 vars in 1120 bytes} [Tue May 10 21:02:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:47.663689 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0ed02-1274-4bce-915e-6d2b7c5b9184 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:47.696668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c375c-90cb-4fac-963d-1ff4660b0c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:47.697348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c375c-90cb-4fac-963d-1ff4660b0c5a None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:47.697851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c375c-90cb-4fac-963d-1ff4660b0c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:47.698141 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c375c-90cb-4fac-963d-1ff4660b0c5a None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:47.699241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c375c-90cb-4fac-963d-1ff4660b0c5a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:47.699564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c375c-90cb-4fac-963d-1ff4660b0c5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:47.701268 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c375c-90cb-4fac-963d-1ff4660b0c5a None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:47.714525 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 480/962] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 10 21:02:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:47.716895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c375c-90cb-4fac-963d-1ff4660b0c5a None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:47.789715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0ed02-1274-4bce-915e-6d2b7c5b9184 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:47.824896 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ede4-6058-4b96-b5e5-692983fa9ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:47.825950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ede4-6058-4b96-b5e5-692983fa9ffa None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:47.826495 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ede4-6058-4b96-b5e5-692983fa9ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:47.826971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ede4-6058-4b96-b5e5-692983fa9ffa None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:47.827903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235ede4-6058-4b96-b5e5-692983fa9ffa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:47.828404 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235ede4-6058-4b96-b5e5-692983fa9ffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:47.830116 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235ede4-6058-4b96-b5e5-692983fa9ffa None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:47.830600 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c375c-90cb-4fac-963d-1ff4660b0c5a None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:47.839176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 483/963] 10.222.0.25 () {56 vars in 1115 bytes} [Tue May 10 21:02:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:47.844369 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ede4-6058-4b96-b5e5-692983fa9ffa None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:47.873939 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c777a47-e089-4096-bfc1-a9a0efdfc2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:47.875110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c777a47-e089-4096-bfc1-a9a0efdfc2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:47.875620 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c777a47-e089-4096-bfc1-a9a0efdfc2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:47.876111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c777a47-e089-4096-bfc1-a9a0efdfc2f9 None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:47.877011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c777a47-e089-4096-bfc1-a9a0efdfc2f9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:47.877512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c777a47-e089-4096-bfc1-a9a0efdfc2f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:47.879091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c777a47-e089-4096-bfc1-a9a0efdfc2f9 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:47.890812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 481/964] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 10 21:02:47 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:47.952346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ede4-6058-4b96-b5e5-692983fa9ffa None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:47.990736 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f241c0-0849-4329-9014-9ecb2b2141df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:47.991630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f241c0-0849-4329-9014-9ecb2b2141df None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:47.991915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f241c0-0849-4329-9014-9ecb2b2141df None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:47.992190 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f241c0-0849-4329-9014-9ecb2b2141df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:48.006346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f241c0-0849-4329-9014-9ecb2b2141df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:48.008055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f241c0-0849-4329-9014-9ecb2b2141df None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:48.027336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-52f241c0-0849-4329-9014-9ecb2b2141df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:48.027336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:48.027336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:48.027336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:48.027336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:48.027336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:48.027336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:48.027336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:48.027336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:48.027336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:48.027336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:48.027336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:48.027336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:48.027336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:48.027336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:48.028328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:48.028328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:48.028328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:48.028328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:48.028328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:48.028328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:48.028328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:48.028328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:48.028328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:48.028328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:48.028328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:48.028328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:48.028328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:48.028328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:48.028328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:48.028328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:48.028328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:48.029258 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:48.029258 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:48.029258 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:48.029258 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:48.029258 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 484/965] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:48.034847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c777a47-e089-4096-bfc1-a9a0efdfc2f9 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:48.142845 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c777a47-e089-4096-bfc1-a9a0efdfc2f9 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:48.176987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7735bf8-2ce5-431c-872d-f78c595a312d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:48.178562 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7735bf8-2ce5-431c-872d-f78c595a312d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:48.179066 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7735bf8-2ce5-431c-872d-f78c595a312d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:48.179539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7735bf8-2ce5-431c-872d-f78c595a312d None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:48.180449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7735bf8-2ce5-431c-872d-f78c595a312d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:48.180974 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7735bf8-2ce5-431c-872d-f78c595a312d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:48.182547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7735bf8-2ce5-431c-872d-f78c595a312d None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:48.188386 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f98a5c-c9d2-4291-bd2c-ab91a099803a None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:48.188678 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f98a5c-c9d2-4291-bd2c-ab91a099803a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:48.188961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f98a5c-c9d2-4291-bd2c-ab91a099803a None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:48.191778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 485/966] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:48.196045 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 482/967] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:48.200376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeab4f-a86b-4c01-b8ce-4b5dbcdb6ff5 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:48.200376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeab4f-a86b-4c01-b8ce-4b5dbcdb6ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:48.200376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeab4f-a86b-4c01-b8ce-4b5dbcdb6ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:48.201638 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7735bf8-2ce5-431c-872d-f78c595a312d None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:48.216976 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-c7aeab4f-a86b-4c01-b8ce-4b5dbcdb6ff5 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:48.218484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c7aeab4f-a86b-4c01-b8ce-4b5dbcdb6ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:48.299244 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 486/968] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:48.317504 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7735bf8-2ce5-431c-872d-f78c595a312d None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:48.323981 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeab4f-a86b-4c01-b8ce-4b5dbcdb6ff5 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:48.355584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4e8a6-b58e-4701-ab20-941c4fa78bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:48.356397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4e8a6-b58e-4701-ab20-941c4fa78bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:48.356679 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4e8a6-b58e-4701-ab20-941c4fa78bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:48.356953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4e8a6-b58e-4701-ab20-941c4fa78bb9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:48.364216 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4e8a6-b58e-4701-ab20-941c4fa78bb9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:48.365688 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4e8a6-b58e-4701-ab20-941c4fa78bb9 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:48.381391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-e1d4e8a6-b58e-4701-ab20-941c4fa78bb9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 21:02:48.381391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:48.381391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:48.381391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:48.381391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:48.381391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:48.381391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:48.381391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:48.381391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:48.381391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:48.381391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:48.381391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:48.381391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:48.381391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:48.381391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:48.381391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:48.387426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:48.387426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:48.387426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:48.387426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:48.387426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:48.387426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:48.387426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:48.387426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:48.387426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:48.387426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:48.387426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:48.387426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:48.387426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:48.387426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:48.387426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:48.387426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:48.387426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:48.387426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:48.388400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:48.388400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:48.388400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:48.388400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:48.388400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:48.388400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:48.388400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:48.388400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:48.388400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 21:02:48.388400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:48.388400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 483/969] 10.222.0.25 () {56 vars in 1117 bytes} [Tue May 10 21:02:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:48.389008 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4e8a6-b58e-4701-ab20-941c4fa78bb9 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:48.434164 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeab4f-a86b-4c01-b8ce-4b5dbcdb6ff5 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:48.470575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95433b4-a295-4330-b0a7-210a787d57c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:48.471449 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95433b4-a295-4330-b0a7-210a787d57c3 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:48.471833 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95433b4-a295-4330-b0a7-210a787d57c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:48.472212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95433b4-a295-4330-b0a7-210a787d57c3 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:48.473034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95433b4-a295-4330-b0a7-210a787d57c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:48.474773 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95433b4-a295-4330-b0a7-210a787d57c3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:48.490534 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4e8a6-b58e-4701-ab20-941c4fa78bb9 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:48.516652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.sql.core [None req-d95433b4-a295-4330-b0a7-210a787d57c3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 21:02:48.516652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 21:02:48.516652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [parameters: {'user_id': 'd65c46909dbb4f1da16053d5839d21a8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 21:02:48.516652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80454) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 21:02:48.525280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d7d72-d7ca-4713-80c6-a7c12dae5eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:48.526101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d7d72-d7ca-4713-80c6-a7c12dae5eaf None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:48.526505 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d7d72-d7ca-4713-80c6-a7c12dae5eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:48.526879 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d7d72-d7ca-4713-80c6-a7c12dae5eaf None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:48.527370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-d95433b4-a295-4330-b0a7-210a787d57c3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 21:02:48.527370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:48.527370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 21:02:48.527370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 21:02:48.527370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 21:02:48.527370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 21:02:48.527370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 21:02:48.527370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application result = self._query(query) May 10 21:02:48.527370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 21:02:48.527370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application conn.query(q) May 10 21:02:48.527370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 21:02:48.527370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 21:02:48.527370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 21:02:48.527370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application result.read() May 10 21:02:48.527370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 21:02:48.529004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 21:02:48.529004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 21:02:48.529004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 21:02:48.529004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 21:02:48.529004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 21:02:48.529004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 21:02:48.529004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 21:02:48.529004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 21:02:48.529004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:48.529004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 21:02:48.529004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:48.529004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:48.529004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 21:02:48.529004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 21:02:48.529004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 10 21:02:48.529004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 10 21:02:48.529004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 21:02:48.529004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application next(self.gen) May 10 21:02:48.530420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 21:02:48.530420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application yield resource May 10 21:02:48.530420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 21:02:48.530420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application next(self.gen) May 10 21:02:48.530420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 21:02:48.530420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.session.rollback() May 10 21:02:48.530420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 21:02:48.530420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.force_reraise() May 10 21:02:48.530420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 21:02:48.530420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise self.value May 10 21:02:48.530420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 21:02:48.530420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 21:02:48.530420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 21:02:48.530420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application session.commit() May 10 21:02:48.530420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 21:02:48.530420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 21:02:48.530420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 21:02:48.532331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._prepare_impl() May 10 21:02:48.532331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 21:02:48.532331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.session.flush() May 10 21:02:48.532331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 21:02:48.532331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._flush(objects) May 10 21:02:48.532331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 21:02:48.532331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 21:02:48.532331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 21:02:48.532331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application compat.raise_( May 10 21:02:48.532331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 21:02:48.532331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception May 10 21:02:48.532331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 21:02:48.532331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application flush_context.execute() May 10 21:02:48.532331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 21:02:48.532331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rec.execute(self) May 10 21:02:48.532331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 21:02:48.532331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 21:02:48.534200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 21:02:48.534200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 21:02:48.534200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 10 21:02:48.534200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application result = connection._execute_20( May 10 21:02:48.534200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 21:02:48.534200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 21:02:48.534200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 21:02:48.534200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 21:02:48.534200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 21:02:48.534200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 21:02:48.534200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 21:02:48.534200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 21:02:48.534200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 21:02:48.534200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 21:02:48.534200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 21:02:48.534200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception May 10 21:02:48.547112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 21:02:48.547112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 21:02:48.547112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 21:02:48.547112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 21:02:48.547112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 21:02:48.547112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application result = self._query(query) May 10 21:02:48.547112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 21:02:48.547112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application conn.query(q) May 10 21:02:48.547112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 21:02:48.547112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 21:02:48.547112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 21:02:48.547112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application result.read() May 10 21:02:48.547112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 21:02:48.547112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 21:02:48.547112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 21:02:48.547112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 21:02:48.548971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 21:02:48.548971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 21:02:48.548971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 21:02:48.548971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 21:02:48.548971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 21:02:48.548971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 21:02:48.548971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd65c46909dbb4f1da16053d5839d21a8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 21:02:48.548971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 21:02:48.548971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:48.548971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:48.548971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:48.548971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:48.548971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:48.548971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:48.548971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:48.550903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:48.550903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:48.550903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:48.550903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:48.550903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:48.550903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:48.550903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:48.550903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 10 21:02:48.550903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 10 21:02:48.550903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:48.550903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:48.550903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:48.550903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:48.550903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:48.550903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:48.550903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 10 21:02:48.550903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 10 21:02:48.553648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 10 21:02:48.553648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 10 21:02:48.553648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 21:02:48.553648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 21:02:48.553648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 21:02:48.553648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:48.554324 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d7d72-d7ca-4713-80c6-a7c12dae5eaf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:48.554324 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d7d72-d7ca-4713-80c6-a7c12dae5eaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:48.554507 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 487/970] 10.222.0.25 () {60 vars in 1131 bytes} [Tue May 10 21:02:48 2022] POST /identity/v3/users => generated 160 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:48.554593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d7d72-d7ca-4713-80c6-a7c12dae5eaf None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:48.554675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95433b4-a295-4330-b0a7-210a787d57c3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:48.554758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 484/971] 10.222.0.25 () {56 vars in 1149 bytes} [Tue May 10 21:02:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:48.560736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d7d72-d7ca-4713-80c6-a7c12dae5eaf None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:48.664353 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95433b4-a295-4330-b0a7-210a787d57c3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:48.683072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d7d72-d7ca-4713-80c6-a7c12dae5eaf None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:48.708541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731f0c3-9cf5-46c5-b72d-359fcc79328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:48.709701 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731f0c3-9cf5-46c5-b72d-359fcc79328d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:48.710219 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731f0c3-9cf5-46c5-b72d-359fcc79328d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:48.710720 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731f0c3-9cf5-46c5-b72d-359fcc79328d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:48.718377 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731f0c3-9cf5-46c5-b72d-359fcc79328d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:48.720794 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731f0c3-9cf5-46c5-b72d-359fcc79328d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:48.721762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbbe44-cccc-470b-9584-a8aefdfd3f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:48.722412 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbbe44-cccc-470b-9584-a8aefdfd3f77 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:48.722739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbbe44-cccc-470b-9584-a8aefdfd3f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:48.723017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbbe44-cccc-470b-9584-a8aefdfd3f77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:48.737230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-3731f0c3-9cf5-46c5-b72d-359fcc79328d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 21:02:48.737230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:48.737230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:48.737230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:48.737230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:48.737230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:48.737230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:48.737230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:48.737230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:48.737230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:48.737230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:48.737230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:48.737230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:48.737230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:48.737230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:48.737230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:48.738264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:48.738264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:48.738264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:48.738264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:48.738264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:48.738264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:48.738264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:48.738264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:48.738264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:48.738264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:48.738264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:48.738264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:48.738264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:48.738264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:48.738264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:48.738264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:48.738264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:48.738264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:48.740709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:48.740709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:48.740709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:02:48.740709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:02:48.740709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:02:48.740709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:02:48.740709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:02:48.740709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:02:48.740709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 21:02:48.740709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:48.748168 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 488/972] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:02:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:48.749291 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731f0c3-9cf5-46c5-b72d-359fcc79328d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:48.794934 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbbe44-cccc-470b-9584-a8aefdfd3f77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:48.796371 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbbe44-cccc-470b-9584-a8aefdfd3f77 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:48.853361 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731f0c3-9cf5-46c5-b72d-359fcc79328d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:48.888751 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8316024-b4c9-4fbb-a18a-5e39a23a8102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:48.889817 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8316024-b4c9-4fbb-a18a-5e39a23a8102 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:48.890357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8316024-b4c9-4fbb-a18a-5e39a23a8102 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:48.890883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8316024-b4c9-4fbb-a18a-5e39a23a8102 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:48.891907 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8316024-b4c9-4fbb-a18a-5e39a23a8102 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:48.892431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8316024-b4c9-4fbb-a18a-5e39a23a8102 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:48.894044 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8316024-b4c9-4fbb-a18a-5e39a23a8102 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:48.913905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 485/973] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:02:48 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 21:02:48.915277 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbbe44-cccc-470b-9584-a8aefdfd3f77 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:48.946662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 489/974] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 10 21:02:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:49.029507 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbbe44-cccc-470b-9584-a8aefdfd3f77 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:49.065848 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54068767-deb8-433b-a83d-0724b1579401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:49.066688 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54068767-deb8-433b-a83d-0724b1579401 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:49.066970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54068767-deb8-433b-a83d-0724b1579401 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:49.067241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54068767-deb8-433b-a83d-0724b1579401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:49.079059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54068767-deb8-433b-a83d-0724b1579401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:49.080570 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54068767-deb8-433b-a83d-0724b1579401 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:49.100644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-54068767-deb8-433b-a83d-0724b1579401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:49.100644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:49.100644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:49.100644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:49.100644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:49.100644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:49.100644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:49.100644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:49.100644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:49.100644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:49.100644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:49.100644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:49.100644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:49.100644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:49.100644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:49.101643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:49.101643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:49.101643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:49.101643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:49.101643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:49.101643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:49.101643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:49.101643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:49.101643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:49.101643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:49.101643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:49.101643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:49.101643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:49.101643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:49.101643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:49.101643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:49.101643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:49.102581 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:49.102581 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:49.102581 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:49.102581 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:49.102581 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 486/975] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:49.109116 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8316024-b4c9-4fbb-a18a-5e39a23a8102 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:49.219524 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8316024-b4c9-4fbb-a18a-5e39a23a8102 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:49.253302 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c93651-0018-43a6-b078-c33dec088af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:49.253972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c93651-0018-43a6-b078-c33dec088af6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:49.254257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c93651-0018-43a6-b078-c33dec088af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:49.254557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c93651-0018-43a6-b078-c33dec088af6 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:49.255354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c93651-0018-43a6-b078-c33dec088af6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:49.255625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c93651-0018-43a6-b078-c33dec088af6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:49.256985 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c93651-0018-43a6-b078-c33dec088af6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:49.268942 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 490/976] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:49.275876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54068767-deb8-433b-a83d-0724b1579401 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:49.377920 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54068767-deb8-433b-a83d-0724b1579401 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:49.410495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ca87b-2589-49a7-8837-cc9d8ab5d036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:49.411314 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ca87b-2589-49a7-8837-cc9d8ab5d036 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:49.411592 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ca87b-2589-49a7-8837-cc9d8ab5d036 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:49.411958 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ca87b-2589-49a7-8837-cc9d8ab5d036 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:49.418931 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ca87b-2589-49a7-8837-cc9d8ab5d036 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:49.420350 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ca87b-2589-49a7-8837-cc9d8ab5d036 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:49.434649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-7e3ca87b-2589-49a7-8837-cc9d8ab5d036 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:49.434649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:49.434649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:49.434649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:49.434649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:49.434649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:49.434649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:49.434649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:49.434649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:49.434649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:49.434649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:49.434649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:49.434649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:02:49.434649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:02:49.434649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:02:49.435560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:02:49.435560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:49.435560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:49.435560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:49.435560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:49.435560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:49.435560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:49.435560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:49.435560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:49.435560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:49.435560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:49.435560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:49.435560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:49.435560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:49.435560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:49.435560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:49.435560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:49.436493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:02:49.436493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:02:49.436493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:02:49.436493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:02:49.436493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:02:49.436493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:02:49.436493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:02:49.436493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:49.436493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 487/977] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:49.443263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c93651-0018-43a6-b078-c33dec088af6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:49.470040 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d17778-bdce-4788-b5bf-5db54d3c837e None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:49.470351 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d17778-bdce-4788-b5bf-5db54d3c837e None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:49.470671 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d17778-bdce-4788-b5bf-5db54d3c837e None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:49.472026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 488/978] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:02:49.477545 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ad152-9e7b-49c9-9437-d93fc4a834e7 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:49.477828 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ad152-9e7b-49c9-9437-d93fc4a834e7 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:49.478110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ad152-9e7b-49c9-9437-d93fc4a834e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:49.494584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-e35ad152-9e7b-49c9-9437-d93fc4a834e7 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:49.495770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e35ad152-9e7b-49c9-9437-d93fc4a834e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:49.545271 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c93651-0018-43a6-b078-c33dec088af6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:49.562050 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 489/979] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:02:49.583810 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba50c26-e114-4303-b08f-98ce7cd48dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:49.584457 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba50c26-e114-4303-b08f-98ce7cd48dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:49.584812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba50c26-e114-4303-b08f-98ce7cd48dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:49.585098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba50c26-e114-4303-b08f-98ce7cd48dc3 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:49.585389 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ad152-9e7b-49c9-9437-d93fc4a834e7 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:49.585886 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba50c26-e114-4303-b08f-98ce7cd48dc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:49.586194 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba50c26-e114-4303-b08f-98ce7cd48dc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:49.587649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba50c26-e114-4303-b08f-98ce7cd48dc3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:49.602809 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 491/980] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:02:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:49.605344 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba50c26-e114-4303-b08f-98ce7cd48dc3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:49.685959 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ad152-9e7b-49c9-9437-d93fc4a834e7 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:49.702386 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba50c26-e114-4303-b08f-98ce7cd48dc3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:49.727405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44d367-c094-4557-8ff6-a230b356da7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:49.728589 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44d367-c094-4557-8ff6-a230b356da7a None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:49.729134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44d367-c094-4557-8ff6-a230b356da7a None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:49.729415 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44d367-c094-4557-8ff6-a230b356da7a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:49.730272 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44d367-c094-4557-8ff6-a230b356da7a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:49.732308 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44d367-c094-4557-8ff6-a230b356da7a None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:49.735529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdf129-4c20-415b-8ccd-610fcdf1f4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:49.736185 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdf129-4c20-415b-8ccd-610fcdf1f4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:49.736468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdf129-4c20-415b-8ccd-610fcdf1f4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:49.736741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdf129-4c20-415b-8ccd-610fcdf1f4a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:49.737567 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdf129-4c20-415b-8ccd-610fcdf1f4a5 None admin] RBAC: Adding query filter params (role.id=be44cff8846d48519c82b28f7c2d2c90, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=c0fc3052af194b48b7ce036ff605ff25) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:49.737879 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdf129-4c20-415b-8ccd-610fcdf1f4a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:49.739346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdf129-4c20-415b-8ccd-610fcdf1f4a5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:49.745556 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 492/981] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:02:49 2022] GET /identity/v3/role_assignments?user.id=c0fc3052af194b48b7ce036ff605ff25&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=be44cff8846d48519c82b28f7c2d2c90 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:49.745862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-ce44d367-c094-4557-8ff6-a230b356da7a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 21:02:49.745862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:49.745862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:49.745862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:49.745862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:49.745862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:49.745862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:49.745862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:49.745862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 21:02:49.745862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:49.745862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:49.745862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:49.745862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:49.745862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:49.745862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:49.745862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:49.745862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:49.747087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:49.747087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:49.747087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:49.747087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:49.747087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:49.747087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:49.747087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:49.747087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:49.747087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:49.747087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:49.747087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:49.747087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:49.747087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:49.747087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:49.747087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:49.747087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:49.748041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:49.748041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:49.748041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:49.748041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:49.748041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:49.748041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:49.748041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:49.748041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:49.748041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:49.748041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:49.748041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:49.748041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:49.748041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 21:02:49.748041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:49.752107 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 490/982] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 10 21:02:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:49.753473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdf129-4c20-415b-8ccd-610fcdf1f4a5 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:49.863247 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdf129-4c20-415b-8ccd-610fcdf1f4a5 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:49.898296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20751f7-2f89-4525-947e-b99e839825ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:49.899016 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20751f7-2f89-4525-947e-b99e839825ad None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:49.899305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20751f7-2f89-4525-947e-b99e839825ad None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:49.899583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20751f7-2f89-4525-947e-b99e839825ad None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:49.900304 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20751f7-2f89-4525-947e-b99e839825ad None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:49.900612 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20751f7-2f89-4525-947e-b99e839825ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:49.901989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20751f7-2f89-4525-947e-b99e839825ad None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:49.912581 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 493/983] 10.222.0.25 () {56 vars in 1122 bytes} [Tue May 10 21:02:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:49.914251 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44d367-c094-4557-8ff6-a230b356da7a None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:50.017424 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44d367-c094-4557-8ff6-a230b356da7a None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:50.053254 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a043361-cfce-43bb-9631-7ff8b1393901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:50.053919 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a043361-cfce-43bb-9631-7ff8b1393901 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:50.054208 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a043361-cfce-43bb-9631-7ff8b1393901 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:50.054514 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a043361-cfce-43bb-9631-7ff8b1393901 None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:50.055224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a043361-cfce-43bb-9631-7ff8b1393901 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:50.055535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a043361-cfce-43bb-9631-7ff8b1393901 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:50.056904 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a043361-cfce-43bb-9631-7ff8b1393901 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:50.066374 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 491/984] 10.222.0.25 () {56 vars in 1122 bytes} [Tue May 10 21:02:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:50.068703 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20751f7-2f89-4525-947e-b99e839825ad None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:50.163470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20751f7-2f89-4525-947e-b99e839825ad None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:50.196295 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46d1b3-af47-4804-8fe7-250ad157607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:50.196616 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b649e4a-baac-42a7-a854-017e7e021c23 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:50.196894 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b649e4a-baac-42a7-a854-017e7e021c23 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:50.196996 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46d1b3-af47-4804-8fe7-250ad157607b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:50.197176 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b649e4a-baac-42a7-a854-017e7e021c23 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:50.197275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46d1b3-af47-4804-8fe7-250ad157607b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:50.197489 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46d1b3-af47-4804-8fe7-250ad157607b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:50.198284 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46d1b3-af47-4804-8fe7-250ad157607b None admin] RBAC: Adding query filter params (interface=admin, service_id=0f2aee5a6c414aaaa1fab05634b1427c, region_id=RegionOne) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:50.199683 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46d1b3-af47-4804-8fe7-250ad157607b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:50.199891 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 492/985] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:02:50.200127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46d1b3-af47-4804-8fe7-250ad157607b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:50.203563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e031a-980a-4bf7-9f43-d58d89260910 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:50.203982 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e031a-980a-4bf7-9f43-d58d89260910 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:50.204157 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e031a-980a-4bf7-9f43-d58d89260910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:50.205508 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 494/986] 10.222.0.25 () {56 vars in 1249 bytes} [Tue May 10 21:02:50 2022] GET /identity/v3/endpoints?service_id=0f2aee5a6c414aaaa1fab05634b1427c&interface=admin®ion_id=RegionOne => generated 193 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:50.211027 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46d1b3-af47-4804-8fe7-250ad157607b None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:50.221147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-7f4e031a-980a-4bf7-9f43-d58d89260910 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:50.222329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-7f4e031a-980a-4bf7-9f43-d58d89260910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:50.288575 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 493/987] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:02:50.311845 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e031a-980a-4bf7-9f43-d58d89260910 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:50.319035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46d1b3-af47-4804-8fe7-250ad157607b None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:50.351501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423dd5f7-90c4-4b9f-aa4c-d4fd9fd5d73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:50.352169 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dd5f7-90c4-4b9f-aa4c-d4fd9fd5d73c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:50.352457 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dd5f7-90c4-4b9f-aa4c-d4fd9fd5d73c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:50.352736 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dd5f7-90c4-4b9f-aa4c-d4fd9fd5d73c None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:50.353485 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423dd5f7-90c4-4b9f-aa4c-d4fd9fd5d73c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:50.354808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423dd5f7-90c4-4b9f-aa4c-d4fd9fd5d73c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:50.360846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 495/988] 10.222.0.25 () {56 vars in 1087 bytes} [Tue May 10 21:02:50 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:02:50.416907 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e031a-980a-4bf7-9f43-d58d89260910 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:50.453980 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab26f6-77b2-4cd7-b4c1-4623f8104480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:50.454692 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab26f6-77b2-4cd7-b4c1-4623f8104480 None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:50.454981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab26f6-77b2-4cd7-b4c1-4623f8104480 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:50.455255 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab26f6-77b2-4cd7-b4c1-4623f8104480 None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:50.455994 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab26f6-77b2-4cd7-b4c1-4623f8104480 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:50.457387 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab26f6-77b2-4cd7-b4c1-4623f8104480 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:50.528857 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 494/989] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 10 21:02:50 2022] POST /identity/v3/services => generated 242 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:02:52.021820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a5fed-bd2f-41b9-828e-f676dfea176f None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:52.022340 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a5fed-bd2f-41b9-828e-f676dfea176f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:52.022422 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a5fed-bd2f-41b9-828e-f676dfea176f None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:52.023809 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 496/990] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:52.029022 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948033e-62aa-4e3d-b24b-6bf815d0ee78 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:52.029448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948033e-62aa-4e3d-b24b-6bf815d0ee78 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:52.029688 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948033e-62aa-4e3d-b24b-6bf815d0ee78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:52.047235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-f948033e-62aa-4e3d-b24b-6bf815d0ee78 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:52.048428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-f948033e-62aa-4e3d-b24b-6bf815d0ee78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:52.123144 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 495/991] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:52.145064 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a5fed-bd2f-41b9-828e-f676dfea176f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:52.243542 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a5fed-bd2f-41b9-828e-f676dfea176f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:52.276808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa58a01-e980-4dfc-b21b-8f9c28df23cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:52.277602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa58a01-e980-4dfc-b21b-8f9c28df23cb None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:52.277889 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa58a01-e980-4dfc-b21b-8f9c28df23cb None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:52.278166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa58a01-e980-4dfc-b21b-8f9c28df23cb None admin] PATH_INFO: `/v3/services/image` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:52.278851 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa58a01-e980-4dfc-b21b-8f9c28df23cb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:52.280212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa58a01-e980-4dfc-b21b-8f9c28df23cb None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:52.291674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-baa58a01-e980-4dfc-b21b-8f9c28df23cb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 21:02:52.291674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:52.291674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:52.291674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:52.291674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:52.291674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:52.291674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:52.291674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:52.291674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 21:02:52.291674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:52.291674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:52.291674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:52.291674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:52.291674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:52.291674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:52.291674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:52.291674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:52.292696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:52.292696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:52.292696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:52.292696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:52.292696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:52.292696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:52.292696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:52.292696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:52.292696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:52.292696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:52.292696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:52.292696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:52.292696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:52.292696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:52.292696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:52.292696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:52.293829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:52.293829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:52.293829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:52.293829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:52.293829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:52.293829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:52.293829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:52.293829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:52.293829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:52.293829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:52.293829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:52.293829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:52.293829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 21:02:52.293829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:52.301128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 497/992] 10.222.0.25 () {56 vars in 1105 bytes} [Tue May 10 21:02:52 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:52.301250 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948033e-62aa-4e3d-b24b-6bf815d0ee78 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:52.395698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948033e-62aa-4e3d-b24b-6bf815d0ee78 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:52.430183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11faab74-f778-4b25-9406-8c307f6bff29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:52.432962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faab74-f778-4b25-9406-8c307f6bff29 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:52.432962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faab74-f778-4b25-9406-8c307f6bff29 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:52.432962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faab74-f778-4b25-9406-8c307f6bff29 None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:52.432962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11faab74-f778-4b25-9406-8c307f6bff29 None admin] RBAC: Adding query filter params (name=image) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:52.432962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11faab74-f778-4b25-9406-8c307f6bff29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:52.433960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11faab74-f778-4b25-9406-8c307f6bff29 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:52.442869 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 496/993] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:52.446487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa58a01-e980-4dfc-b21b-8f9c28df23cb None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:52.545909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa58a01-e980-4dfc-b21b-8f9c28df23cb None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:52.579185 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfddf3-e954-4cb5-a0c8-960a3034b97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:52.579884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfddf3-e954-4cb5-a0c8-960a3034b97a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:52.580172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfddf3-e954-4cb5-a0c8-960a3034b97a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:52.580453 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfddf3-e954-4cb5-a0c8-960a3034b97a None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:52.581187 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfddf3-e954-4cb5-a0c8-960a3034b97a None admin] RBAC: Adding query filter params (type=image) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:52.581498 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfddf3-e954-4cb5-a0c8-960a3034b97a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:52.582986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfddf3-e954-4cb5-a0c8-960a3034b97a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:52.594620 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 498/994] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:52.622344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee950a7-d96a-4d41-9ad5-25e7ab8da3ec None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:52.622667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee950a7-d96a-4d41-9ad5-25e7ab8da3ec None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:52.622952 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee950a7-d96a-4d41-9ad5-25e7ab8da3ec None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:52.624529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 497/995] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:52.631336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdc880-a080-4465-9d7f-733c4051af7e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:52.631630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdc880-a080-4465-9d7f-733c4051af7e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:52.631918 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdc880-a080-4465-9d7f-733c4051af7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:52.650113 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-e7fdc880-a080-4465-9d7f-733c4051af7e None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:52.651656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e7fdc880-a080-4465-9d7f-733c4051af7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:52.770492 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 499/996] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:52.792021 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee950a7-d96a-4d41-9ad5-25e7ab8da3ec None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:52.826877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f527ad-054e-4358-bbeb-33471e26b89b None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:52.827201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f527ad-054e-4358-bbeb-33471e26b89b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:52.827440 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f527ad-054e-4358-bbeb-33471e26b89b None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:52.828800 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 500/997] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:02:52.833937 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e848-95a3-4946-9810-54806fae45fa None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:52.834222 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e848-95a3-4946-9810-54806fae45fa None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:52.834527 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e848-95a3-4946-9810-54806fae45fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:52.853750 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-65f4e848-95a3-4946-9810-54806fae45fa None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:52.853750 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-65f4e848-95a3-4946-9810-54806fae45fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:52.902516 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee950a7-d96a-4d41-9ad5-25e7ab8da3ec None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:52.918940 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 501/998] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:52.938933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480cf80-d2a9-4c09-9ff2-56e23606a384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:52.939746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480cf80-d2a9-4c09-9ff2-56e23606a384 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:52.940026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480cf80-d2a9-4c09-9ff2-56e23606a384 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:52.940298 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480cf80-d2a9-4c09-9ff2-56e23606a384 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:52.940944 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480cf80-d2a9-4c09-9ff2-56e23606a384 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:52.942213 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4e848-95a3-4946-9810-54806fae45fa None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:52.942352 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480cf80-d2a9-4c09-9ff2-56e23606a384 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:52.954416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-1480cf80-d2a9-4c09-9ff2-56e23606a384 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 21:02:52.954416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:52.954416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:52.954416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:52.954416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:52.954416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:52.954416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:52.954416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:52.954416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 21:02:52.954416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:52.954416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:52.954416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:52.954416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:52.954416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:52.954416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:52.954416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:52.954416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:52.955526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:52.955526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:52.955526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:52.955526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:52.955526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:52.955526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:52.955526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:52.955526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:52.955526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:52.955526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:52.955526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:52.955526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:52.955526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:52.955526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:52.955526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:52.955526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:52.956766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:52.956766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:52.956766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:52.956766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:52.956766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:52.956766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:52.956766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:52.956766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:52.956766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:52.956766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:52.956766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:52.956766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:52.956766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 21:02:52.956766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:52.956766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 498/999] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 10 21:02:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:52.961497 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480cf80-d2a9-4c09-9ff2-56e23606a384 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:53.042221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4e848-95a3-4946-9810-54806fae45fa None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:53.061852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480cf80-d2a9-4c09-9ff2-56e23606a384 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:53.077291 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d309ae7-fe20-4530-b969-e50acf602bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:53.078094 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d309ae7-fe20-4530-b969-e50acf602bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:53.078383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d309ae7-fe20-4530-b969-e50acf602bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:53.078764 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d309ae7-fe20-4530-b969-e50acf602bc9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:53.079420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d309ae7-fe20-4530-b969-e50acf602bc9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:53.080776 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d309ae7-fe20-4530-b969-e50acf602bc9 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:53.092956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-2d309ae7-fe20-4530-b969-e50acf602bc9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 21:02:53.092956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:53.092956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:53.092956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:53.092956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:53.092956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:53.092956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:53.092956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:53.092956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 21:02:53.092956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:53.092956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:53.092956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:53.092956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:53.092956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:53.092956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:53.092956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:53.092956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:53.093992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:53.093992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:53.093992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:53.093992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:53.093992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:53.093992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:53.093992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:53.093992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:53.093992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:53.093992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:53.093992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:53.093992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:53.093992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:53.093992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:53.093992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:53.093992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:53.094919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:53.094919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:53.094919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:53.094919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:53.094919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:53.094919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:53.094919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:53.094919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:53.094919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:53.094919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:53.094919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:53.094919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:53.094919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 21:02:53.094919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:53.095677 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6259c2-9df2-4edf-9fdc-3a89685a1b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:53.095677 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6259c2-9df2-4edf-9fdc-3a89685a1b61 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:53.095677 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6259c2-9df2-4edf-9fdc-3a89685a1b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:53.095888 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6259c2-9df2-4edf-9fdc-3a89685a1b61 None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:53.096509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6259c2-9df2-4edf-9fdc-3a89685a1b61 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:53.096815 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6259c2-9df2-4edf-9fdc-3a89685a1b61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:53.098158 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6259c2-9df2-4edf-9fdc-3a89685a1b61 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:53.103243 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 499/1000] 10.222.0.25 () {56 vars in 1122 bytes} [Tue May 10 21:02:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:53.103521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 502/1001] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:53.104803 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6259c2-9df2-4edf-9fdc-3a89685a1b61 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:53.108359 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d309ae7-fe20-4530-b969-e50acf602bc9 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:53.202958 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6259c2-9df2-4edf-9fdc-3a89685a1b61 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:53.205127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d309ae7-fe20-4530-b969-e50acf602bc9 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:53.235442 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a4871-ec62-4cd4-84f7-8ab04bf903fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:53.236101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a4871-ec62-4cd4-84f7-8ab04bf903fe None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:53.236397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a4871-ec62-4cd4-84f7-8ab04bf903fe None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:53.236648 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a4871-ec62-4cd4-84f7-8ab04bf903fe None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:53.237347 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a4871-ec62-4cd4-84f7-8ab04bf903fe None admin] RBAC: Adding query filter params (name=compute) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:53.237650 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a4871-ec62-4cd4-84f7-8ab04bf903fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:53.238164 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b980ad-fa61-40d5-b9a2-3b2a06a0aee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:53.238862 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b980ad-fa61-40d5-b9a2-3b2a06a0aee1 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:53.239607 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a4871-ec62-4cd4-84f7-8ab04bf903fe None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:53.239727 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b980ad-fa61-40d5-b9a2-3b2a06a0aee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:53.239983 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b980ad-fa61-40d5-b9a2-3b2a06a0aee1 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:53.240629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b980ad-fa61-40d5-b9a2-3b2a06a0aee1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:53.240931 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b980ad-fa61-40d5-b9a2-3b2a06a0aee1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:53.242403 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b980ad-fa61-40d5-b9a2-3b2a06a0aee1 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:53.244749 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 500/1002] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 10 21:02:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:53.252044 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 503/1003] 10.222.0.25 () {56 vars in 1122 bytes} [Tue May 10 21:02:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:53.252665 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b980ad-fa61-40d5-b9a2-3b2a06a0aee1 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:53.252790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a4871-ec62-4cd4-84f7-8ab04bf903fe None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:53.348007 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a4871-ec62-4cd4-84f7-8ab04bf903fe None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:53.348347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b980ad-fa61-40d5-b9a2-3b2a06a0aee1 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:53.381999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302432b-913b-452b-989c-32a6cef923c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:53.387624 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302432b-913b-452b-989c-32a6cef923c9 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:53.387757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b537382-9f06-407b-b7ee-3f282963fdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:53.387868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302432b-913b-452b-989c-32a6cef923c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:53.387868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302432b-913b-452b-989c-32a6cef923c9 None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:53.388030 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b537382-9f06-407b-b7ee-3f282963fdac None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:53.388030 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b537382-9f06-407b-b7ee-3f282963fdac None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:53.388195 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302432b-913b-452b-989c-32a6cef923c9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:53.388281 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b537382-9f06-407b-b7ee-3f282963fdac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:53.388365 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302432b-913b-452b-989c-32a6cef923c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:53.388448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b537382-9f06-407b-b7ee-3f282963fdac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:53.388530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302432b-913b-452b-989c-32a6cef923c9 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:53.388696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b537382-9f06-407b-b7ee-3f282963fdac None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:53.392364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 501/1004] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 10 21:02:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:53.397973 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302432b-913b-452b-989c-32a6cef923c9 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:53.493906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302432b-913b-452b-989c-32a6cef923c9 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:53.511838 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 504/1005] 10.222.0.25 () {60 vars in 1144 bytes} [Tue May 10 21:02:53 2022] POST /identity/v3/endpoints => generated 325 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:02:53.545971 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaac48e-a185-4313-bdd1-d6637801f92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:53.546672 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaac48e-a185-4313-bdd1-d6637801f92c None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:53.546954 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaac48e-a185-4313-bdd1-d6637801f92c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:53.547227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaac48e-a185-4313-bdd1-d6637801f92c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:53.548020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaac48e-a185-4313-bdd1-d6637801f92c None admin] RBAC: Adding query filter params (interface=public, service_id=9ab88db71ab84fd284ebd410136a59f6, region_id=RegionOne) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:53.548327 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaac48e-a185-4313-bdd1-d6637801f92c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:53.549841 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaac48e-a185-4313-bdd1-d6637801f92c None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:53.556197 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 502/1006] 10.222.0.25 () {56 vars in 1251 bytes} [Tue May 10 21:02:53 2022] GET /identity/v3/endpoints?service_id=9ab88db71ab84fd284ebd410136a59f6&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:53.561768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b537382-9f06-407b-b7ee-3f282963fdac None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:53.663806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b537382-9f06-407b-b7ee-3f282963fdac None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:53.697962 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab408217-0cfd-4a56-939b-2b8d44a79b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:53.698647 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab408217-0cfd-4a56-939b-2b8d44a79b0f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:53.698932 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab408217-0cfd-4a56-939b-2b8d44a79b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:53.699204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab408217-0cfd-4a56-939b-2b8d44a79b0f None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:53.699882 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab408217-0cfd-4a56-939b-2b8d44a79b0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:53.701225 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab408217-0cfd-4a56-939b-2b8d44a79b0f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:53.707708 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 505/1007] 10.222.0.25 () {56 vars in 1087 bytes} [Tue May 10 21:02:53 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:02:54.849840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550183d-e4c3-4595-9e0a-f422eef23a93 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:54.850272 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550183d-e4c3-4595-9e0a-f422eef23a93 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:54.850484 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550183d-e4c3-4595-9e0a-f422eef23a93 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:54.853405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 503/1008] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:54.857514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07269fba-1f0d-440b-86d0-a0618501db46 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:54.857945 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07269fba-1f0d-440b-86d0-a0618501db46 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:54.858185 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07269fba-1f0d-440b-86d0-a0618501db46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:54.876363 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-07269fba-1f0d-440b-86d0-a0618501db46 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:54.877534 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-07269fba-1f0d-440b-86d0-a0618501db46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:54.947516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 506/1009] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:54.969442 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550183d-e4c3-4595-9e0a-f422eef23a93 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:55.070161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550183d-e4c3-4595-9e0a-f422eef23a93 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:55.104664 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2667576-1a52-42c4-9ac9-215427b328ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:55.105324 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2667576-1a52-42c4-9ac9-215427b328ec None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:55.105601 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2667576-1a52-42c4-9ac9-215427b328ec None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:55.105871 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2667576-1a52-42c4-9ac9-215427b328ec None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:55.106610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2667576-1a52-42c4-9ac9-215427b328ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:55.107950 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2667576-1a52-42c4-9ac9-215427b328ec None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:55.190574 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 504/1010] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 10 21:02:54 2022] POST /identity/v3/services => generated 242 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:02:55.762147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1c2b1-98dc-47dc-8b67-527adc667256 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:55.762546 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1c2b1-98dc-47dc-8b67-527adc667256 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:55.762744 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1c2b1-98dc-47dc-8b67-527adc667256 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:55.764175 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 507/1011] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:55.770316 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c0d8c-860b-4f11-82fd-56b5d6d381cc None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:55.770681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c0d8c-860b-4f11-82fd-56b5d6d381cc None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:55.770914 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c0d8c-860b-4f11-82fd-56b5d6d381cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:55.788204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-356c0d8c-860b-4f11-82fd-56b5d6d381cc None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:55.789382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-356c0d8c-860b-4f11-82fd-56b5d6d381cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:55.862099 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 505/1012] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:55 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:55.884989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1c2b1-98dc-47dc-8b67-527adc667256 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:55.941801 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f903866-151a-4334-94d8-ccf1154ca97f None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:55.942464 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f903866-151a-4334-94d8-ccf1154ca97f None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:55.942749 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f903866-151a-4334-94d8-ccf1154ca97f None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:55.944261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 506/1013] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:02:55.949253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34179c1-49f0-4cc3-a00d-7b98cc7d889e None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:55.949546 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34179c1-49f0-4cc3-a00d-7b98cc7d889e None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:55.949830 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34179c1-49f0-4cc3-a00d-7b98cc7d889e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:55.966319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-e34179c1-49f0-4cc3-a00d-7b98cc7d889e None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:55.967539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e34179c1-49f0-4cc3-a00d-7b98cc7d889e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:55.984266 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1c2b1-98dc-47dc-8b67-527adc667256 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:56.018479 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae595852-4330-418c-801d-20799cfbd7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:56.019223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae595852-4330-418c-801d-20799cfbd7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:56.019508 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae595852-4330-418c-801d-20799cfbd7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:56.019781 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae595852-4330-418c-801d-20799cfbd7e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:56.021676 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae595852-4330-418c-801d-20799cfbd7e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:56.023124 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae595852-4330-418c-801d-20799cfbd7e5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:56.024939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 508/1014] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:56.030423 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae595852-4330-418c-801d-20799cfbd7e5 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:56.034473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 507/1015] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:55 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:02:56.057249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34179c1-49f0-4cc3-a00d-7b98cc7d889e None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:56.130490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae595852-4330-418c-801d-20799cfbd7e5 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:56.152988 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34179c1-49f0-4cc3-a00d-7b98cc7d889e None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:56.163993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b88e04-0b88-4133-bd44-19111bfd43ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:56.164654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b88e04-0b88-4133-bd44-19111bfd43ee None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:56.164941 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b88e04-0b88-4133-bd44-19111bfd43ee None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:56.165219 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b88e04-0b88-4133-bd44-19111bfd43ee None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:56.165932 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b88e04-0b88-4133-bd44-19111bfd43ee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:56.167388 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b88e04-0b88-4133-bd44-19111bfd43ee None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:56.186901 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8718357-5607-4367-a091-a573d3a04ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:56.187695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8718357-5607-4367-a091-a573d3a04ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:56.187982 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8718357-5607-4367-a091-a573d3a04ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:56.188257 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8718357-5607-4367-a091-a573d3a04ae6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:56.188907 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8718357-5607-4367-a091-a573d3a04ae6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:56.190256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8718357-5607-4367-a091-a573d3a04ae6 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:56.201843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-b8718357-5607-4367-a091-a573d3a04ae6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 21:02:56.201843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:56.201843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:56.201843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:56.201843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:56.201843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:56.201843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:56.201843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:56.201843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 21:02:56.201843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:56.201843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:56.201843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:56.201843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:56.201843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:56.201843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:56.201843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:56.201843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:56.203059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:56.203059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:56.203059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:56.203059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:56.203059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:56.203059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:56.203059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:56.203059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:56.203059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:56.203059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:56.203059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:56.203059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:56.203059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:56.203059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:56.203059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:56.203059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:56.203935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:56.203935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:56.203935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:56.203935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:56.203935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:56.203935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:56.203935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:56.203935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:56.203935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:56.203935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:56.203935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:56.203935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:56.203935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 21:02:56.203935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:56.203935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 508/1016] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:02:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:02:56.209855 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8718357-5607-4367-a091-a573d3a04ae6 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:56.254358 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 509/1017] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 10 21:02:56 2022] POST /identity/v3/projects => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:02:56.328013 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8718357-5607-4367-a091-a573d3a04ae6 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:56.363932 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f386b-d17e-4d60-afb5-db445b8fb72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:56.364892 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f386b-d17e-4d60-afb5-db445b8fb72d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:56.365183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f386b-d17e-4d60-afb5-db445b8fb72d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:56.365465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f386b-d17e-4d60-afb5-db445b8fb72d None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:56.366198 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f386b-d17e-4d60-afb5-db445b8fb72d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:56.366541 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f386b-d17e-4d60-afb5-db445b8fb72d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:56.368012 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f386b-d17e-4d60-afb5-db445b8fb72d None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:56.373592 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 509/1018] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 10 21:02:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:56.379224 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b88e04-0b88-4133-bd44-19111bfd43ee None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:56.484234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b88e04-0b88-4133-bd44-19111bfd43ee None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:56.518265 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e678970-75f9-4ead-84b6-cf97329df0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:56.518996 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e678970-75f9-4ead-84b6-cf97329df0ba None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:56.519305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e678970-75f9-4ead-84b6-cf97329df0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:56.519588 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e678970-75f9-4ead-84b6-cf97329df0ba None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:56.520862 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e678970-75f9-4ead-84b6-cf97329df0ba None admin] RBAC: Adding query filter params (type=compute) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:56.521176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e678970-75f9-4ead-84b6-cf97329df0ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:56.522654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e678970-75f9-4ead-84b6-cf97329df0ba None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:56.527396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 510/1019] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 10 21:02:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:56.533324 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f386b-d17e-4d60-afb5-db445b8fb72d None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:56.631865 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f386b-d17e-4d60-afb5-db445b8fb72d None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:56.664101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c9d3a-5501-4aba-a332-2098aa355e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:56.664766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9d3a-5501-4aba-a332-2098aa355e8c None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:56.665053 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9d3a-5501-4aba-a332-2098aa355e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:56.665334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9d3a-5501-4aba-a332-2098aa355e8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:56.666085 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9c9d3a-5501-4aba-a332-2098aa355e8c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:56.667476 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9c9d3a-5501-4aba-a332-2098aa355e8c None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:56.746483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 510/1020] 10.222.0.25 () {60 vars in 1144 bytes} [Tue May 10 21:02:56 2022] POST /identity/v3/endpoints => generated 334 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:02:57.442262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972663e-5a2a-4d18-b8a0-dc40b0f9272e None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:57.442856 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972663e-5a2a-4d18-b8a0-dc40b0f9272e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:57.442856 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972663e-5a2a-4d18-b8a0-dc40b0f9272e None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:57.444385 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 511/1021] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:57.449334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3187f87-3a46-41c2-ae75-2a56848dc827 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:57.449719 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3187f87-3a46-41c2-ae75-2a56848dc827 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:57.449893 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3187f87-3a46-41c2-ae75-2a56848dc827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:57.466725 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-a3187f87-3a46-41c2-ae75-2a56848dc827 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:57.467886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a3187f87-3a46-41c2-ae75-2a56848dc827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:57.542300 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 511/1022] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:57.563975 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972663e-5a2a-4d18-b8a0-dc40b0f9272e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:57.666243 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972663e-5a2a-4d18-b8a0-dc40b0f9272e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:57.698156 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e584f-5dd6-4da3-8dba-95d7a49a400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:57.698891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e584f-5dd6-4da3-8dba-95d7a49a400a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:57.699171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e584f-5dd6-4da3-8dba-95d7a49a400a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:57.699438 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e584f-5dd6-4da3-8dba-95d7a49a400a None admin] PATH_INFO: `/v3/services/image` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:57.700078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e584f-5dd6-4da3-8dba-95d7a49a400a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:57.701415 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e584f-5dd6-4da3-8dba-95d7a49a400a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:57.713234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-ea6e584f-5dd6-4da3-8dba-95d7a49a400a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 21:02:57.713234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:57.713234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:02:57.713234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:02:57.713234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:02:57.713234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:02:57.713234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:02:57.713234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:57.713234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 21:02:57.713234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:57.713234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:02:57.713234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:57.713234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:57.713234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:57.713234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:57.713234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:57.713234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:57.714216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:57.714216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:57.714216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:57.714216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:57.714216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:57.714216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:57.714216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:02:57.714216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:02:57.714216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:02:57.714216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:02:57.714216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:57.714216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:57.714216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:57.714216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:57.714216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:57.714216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:57.719245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:57.719245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:02:57.719245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:57.719245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:57.719245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:57.719245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:57.719245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:57.719245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:57.719245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:57.719245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:57.719245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:02:57.719245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:02:57.719245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 21:02:57.719245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:02:57.719245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 512/1023] 10.222.0.25 () {56 vars in 1105 bytes} [Tue May 10 21:02:57 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:57.722055 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3187f87-3a46-41c2-ae75-2a56848dc827 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:57.814051 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3187f87-3a46-41c2-ae75-2a56848dc827 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:57.850361 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872dbff-23cb-42e4-904e-0f40b766123d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:57.852920 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872dbff-23cb-42e4-904e-0f40b766123d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:57.852920 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872dbff-23cb-42e4-904e-0f40b766123d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:57.852920 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872dbff-23cb-42e4-904e-0f40b766123d None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:57.852920 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872dbff-23cb-42e4-904e-0f40b766123d None admin] RBAC: Adding query filter params (name=image) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:57.853212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872dbff-23cb-42e4-904e-0f40b766123d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:57.856222 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872dbff-23cb-42e4-904e-0f40b766123d None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:57.864827 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 512/1024] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:57.866014 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e584f-5dd6-4da3-8dba-95d7a49a400a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:57.963473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e584f-5dd6-4da3-8dba-95d7a49a400a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:57.996175 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd607a-84e3-4bcb-9472-b3ab04762c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:57.996840 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd607a-84e3-4bcb-9472-b3ab04762c52 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:57.997120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd607a-84e3-4bcb-9472-b3ab04762c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:57.997388 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd607a-84e3-4bcb-9472-b3ab04762c52 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:57.998087 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd607a-84e3-4bcb-9472-b3ab04762c52 None admin] RBAC: Adding query filter params (type=image) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:57.998386 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd607a-84e3-4bcb-9472-b3ab04762c52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:57.999751 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd607a-84e3-4bcb-9472-b3ab04762c52 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:58.009860 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 513/1025] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:02:58.010861 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872dbff-23cb-42e4-904e-0f40b766123d None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:58.108453 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872dbff-23cb-42e4-904e-0f40b766123d None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:58.141577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2317a7-a722-49ac-95ba-8bf3f188ef23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:58.142240 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2317a7-a722-49ac-95ba-8bf3f188ef23 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:58.142551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2317a7-a722-49ac-95ba-8bf3f188ef23 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:58.142835 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2317a7-a722-49ac-95ba-8bf3f188ef23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:58.143633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2317a7-a722-49ac-95ba-8bf3f188ef23 None admin] RBAC: Adding query filter params (interface=public, service_id=88724b20c3b34bc596c316aaaa2d6125, region_id=RegionOne) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:58.143950 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2317a7-a722-49ac-95ba-8bf3f188ef23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:58.146091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2317a7-a722-49ac-95ba-8bf3f188ef23 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:58.151074 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 513/1026] 10.222.0.25 () {56 vars in 1251 bytes} [Tue May 10 21:02:58 2022] GET /identity/v3/endpoints?service_id=88724b20c3b34bc596c316aaaa2d6125&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:58.156860 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd607a-84e3-4bcb-9472-b3ab04762c52 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:58.250722 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd607a-84e3-4bcb-9472-b3ab04762c52 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:58.282737 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014a204-59af-4347-986c-feb82ecf7ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:58.283394 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014a204-59af-4347-986c-feb82ecf7ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:58.283676 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014a204-59af-4347-986c-feb82ecf7ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:58.283951 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014a204-59af-4347-986c-feb82ecf7ec3 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:58.284622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014a204-59af-4347-986c-feb82ecf7ec3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:58.285991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014a204-59af-4347-986c-feb82ecf7ec3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:58.292400 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 514/1027] 10.222.0.25 () {56 vars in 1087 bytes} [Tue May 10 21:02:58 2022] GET /identity/v3/services => generated 1957 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:02:58.538622 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6499dd8-ce6e-497b-a2f6-50650f7bf1d6 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:58.539110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6499dd8-ce6e-497b-a2f6-50650f7bf1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:58.539110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6499dd8-ce6e-497b-a2f6-50650f7bf1d6 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:58.540571 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 514/1028] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:58.545838 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69fd4b-ed66-454c-a0c4-90e59fec1ca9 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:58.546222 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69fd4b-ed66-454c-a0c4-90e59fec1ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:58.546406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69fd4b-ed66-454c-a0c4-90e59fec1ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:58.563184 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-4a69fd4b-ed66-454c-a0c4-90e59fec1ca9 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:58.564367 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4a69fd4b-ed66-454c-a0c4-90e59fec1ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:58.630879 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 515/1029] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:58.654388 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6499dd8-ce6e-497b-a2f6-50650f7bf1d6 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:58.756614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6499dd8-ce6e-497b-a2f6-50650f7bf1d6 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:58.789774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb27136-13a5-4df7-afbf-171160d88aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:58.790522 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb27136-13a5-4df7-afbf-171160d88aca None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:58.790811 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb27136-13a5-4df7-afbf-171160d88aca None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:58.791090 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb27136-13a5-4df7-afbf-171160d88aca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:58.792368 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb27136-13a5-4df7-afbf-171160d88aca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:58.794057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb27136-13a5-4df7-afbf-171160d88aca None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:58.800356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 515/1030] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:58.802093 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69fd4b-ed66-454c-a0c4-90e59fec1ca9 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:58.905606 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69fd4b-ed66-454c-a0c4-90e59fec1ca9 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:58.940871 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91e21b-9c6a-463c-b770-48de6e814714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:58.941549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91e21b-9c6a-463c-b770-48de6e814714 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:58.942196 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91e21b-9c6a-463c-b770-48de6e814714 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:58.942888 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91e21b-9c6a-463c-b770-48de6e814714 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:58.943630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91e21b-9c6a-463c-b770-48de6e814714 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:58.945052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91e21b-9c6a-463c-b770-48de6e814714 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:59.054567 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 516/1031] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 10 21:02:58 2022] POST /identity/v3/users => generated 285 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:02:59.074564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231bb7e-2735-4fa3-81a9-d74638fc2193 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:59.074914 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231bb7e-2735-4fa3-81a9-d74638fc2193 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:59.075126 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231bb7e-2735-4fa3-81a9-d74638fc2193 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:59.078493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 516/1032] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:59.083059 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f7287-943b-4ade-ad8f-d79f5997a6b7 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:59.083369 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f7287-943b-4ade-ad8f-d79f5997a6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:59.083650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f7287-943b-4ade-ad8f-d79f5997a6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:59.102341 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-e20f7287-943b-4ade-ad8f-d79f5997a6b7 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:59.103619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e20f7287-943b-4ade-ad8f-d79f5997a6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:59.178635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 517/1033] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:02:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:02:59.198212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231bb7e-2735-4fa3-81a9-d74638fc2193 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:59.304477 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231bb7e-2735-4fa3-81a9-d74638fc2193 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:59.338037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583d56f-48d0-42b3-910b-48f8962c696c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:59.338878 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583d56f-48d0-42b3-910b-48f8962c696c None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:59.339164 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583d56f-48d0-42b3-910b-48f8962c696c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:59.339440 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583d56f-48d0-42b3-910b-48f8962c696c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:59.351070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583d56f-48d0-42b3-910b-48f8962c696c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:02:59.359290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-e583d56f-48d0-42b3-910b-48f8962c696c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 21:02:59.359290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:59.359290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:59.359290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:59.359290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:59.359290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:59.359290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:59.359290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:59.359290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:59.359290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:59.359290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:59.359290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:59.359290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:02:59.359290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:02:59.359290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:02:59.359290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:02:59.360210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:02:59.360210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:02:59.360210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:02:59.360210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:02:59.360210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:59.360210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:59.360210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:59.360210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:59.360210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:59.360210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:59.360210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:59.360210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:59.360210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:59.360210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:59.360210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:59.360210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:59.361083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:59.361083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:59.361083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:59.361083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:59.361083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:02:59.361083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:02:59.361083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:02:59.361083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:02:59.361083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:02:59.361083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:02:59.361083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 21:02:59.361083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:59.361083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 517/1034] 10.222.0.25 () {56 vars in 1120 bytes} [Tue May 10 21:02:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:59.367493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f7287-943b-4ade-ad8f-d79f5997a6b7 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:59.466456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f7287-943b-4ade-ad8f-d79f5997a6b7 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:59.500068 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab1fed-e4d7-48cd-9b14-5d4919073b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:59.500738 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab1fed-e4d7-48cd-9b14-5d4919073b64 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:59.501024 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab1fed-e4d7-48cd-9b14-5d4919073b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:59.501329 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab1fed-e4d7-48cd-9b14-5d4919073b64 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:59.502082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab1fed-e4d7-48cd-9b14-5d4919073b64 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:59.502390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab1fed-e4d7-48cd-9b14-5d4919073b64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:59.503784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab1fed-e4d7-48cd-9b14-5d4919073b64 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:59.517146 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 518/1035] 10.222.0.25 () {56 vars in 1115 bytes} [Tue May 10 21:02:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:59.518367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583d56f-48d0-42b3-910b-48f8962c696c None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:59.616138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583d56f-48d0-42b3-910b-48f8962c696c None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:59.650090 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16169258-83a6-4125-b34a-cfe6f95e6f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:59.650914 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16169258-83a6-4125-b34a-cfe6f95e6f38 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:59.651199 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16169258-83a6-4125-b34a-cfe6f95e6f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:59.651472 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16169258-83a6-4125-b34a-cfe6f95e6f38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:59.662057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16169258-83a6-4125-b34a-cfe6f95e6f38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:59.663511 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16169258-83a6-4125-b34a-cfe6f95e6f38 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:59.680421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-16169258-83a6-4125-b34a-cfe6f95e6f38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:59.680421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:59.680421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:59.680421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:59.680421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:59.680421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:59.680421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:59.680421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:59.680421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:59.680421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:59.680421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:59.680421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:59.680421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:02:59.680421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:02:59.680421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:02:59.681342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:02:59.681342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:59.681342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:59.681342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:59.681342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:59.681342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:59.681342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:59.681342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:59.681342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:59.681342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:59.681342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:59.681342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:59.681342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:59.681342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:59.681342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:02:59.681342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:02:59.681342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:02:59.687192 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:02:59.687192 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:02:59.687192 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:02:59.687192 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:02:59.687192 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 518/1036] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:02:59.687496 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab1fed-e4d7-48cd-9b14-5d4919073b64 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:59.781099 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab1fed-e4d7-48cd-9b14-5d4919073b64 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:59.813555 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e90a6-5268-4cd7-98fd-4f3e866e8eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:59.814212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e90a6-5268-4cd7-98fd-4f3e866e8eff None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:59.814520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e90a6-5268-4cd7-98fd-4f3e866e8eff None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:59.814796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e90a6-5268-4cd7-98fd-4f3e866e8eff None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:59.815508 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e90a6-5268-4cd7-98fd-4f3e866e8eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:02:59.815813 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e90a6-5268-4cd7-98fd-4f3e866e8eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:59.817863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e90a6-5268-4cd7-98fd-4f3e866e8eff None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:59.833480 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 519/1037] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:02:59.834638 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16169258-83a6-4125-b34a-cfe6f95e6f38 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:59.939099 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16169258-83a6-4125-b34a-cfe6f95e6f38 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:59.970982 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6da2e-3957-45c6-ac2b-a9d9bee07d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:59.971773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6da2e-3957-45c6-ac2b-a9d9bee07d5c None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:59.972052 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6da2e-3957-45c6-ac2b-a9d9bee07d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:59.972328 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6da2e-3957-45c6-ac2b-a9d9bee07d5c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:59.979609 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6da2e-3957-45c6-ac2b-a9d9bee07d5c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:59.981016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6da2e-3957-45c6-ac2b-a9d9bee07d5c None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:59.995205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-07d6da2e-3957-45c6-ac2b-a9d9bee07d5c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 21:02:59.995205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:02:59.995205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:02:59.995205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:02:59.995205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:02:59.995205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:02:59.995205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:02:59.995205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:02:59.995205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:02:59.995205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:02:59.995205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:02:59.995205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:02:59.995205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:02:59.995205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:02:59.995205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:02:59.995205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:02:59.996215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:02:59.996215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:02:59.996215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:02:59.996215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:59.996215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:02:59.996215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:02:59.996215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:02:59.996215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:02:59.996215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:02:59.996215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:02:59.996215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:02:59.996215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:02:59.996215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:02:59.996215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:02:59.996215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:02:59.996215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:02:59.996215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:02:59.996215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:00.003814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:00.003814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:00.003814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:03:00.003814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:03:00.003814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:03:00.003814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:03:00.003814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:03:00.003814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:03:00.003814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 21:03:00.003814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:03:00.003814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 519/1038] 10.222.0.25 () {56 vars in 1093 bytes} [Tue May 10 21:02:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:03:00.005192 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e90a6-5268-4cd7-98fd-4f3e866e8eff None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:00.101285 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e90a6-5268-4cd7-98fd-4f3e866e8eff None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:00.133931 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04261ec3-b485-4a65-b118-cbe2710cafcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:00.134633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04261ec3-b485-4a65-b118-cbe2710cafcd None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:00.134924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04261ec3-b485-4a65-b118-cbe2710cafcd None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:00.135201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04261ec3-b485-4a65-b118-cbe2710cafcd None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:00.136043 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04261ec3-b485-4a65-b118-cbe2710cafcd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:00.136358 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04261ec3-b485-4a65-b118-cbe2710cafcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:00.137778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04261ec3-b485-4a65-b118-cbe2710cafcd None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:00.155267 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 520/1039] 10.222.0.25 () {56 vars in 1133 bytes} [Tue May 10 21:03:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:00.160867 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6da2e-3957-45c6-ac2b-a9d9bee07d5c None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:00.260446 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6da2e-3957-45c6-ac2b-a9d9bee07d5c None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:00.293569 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6281c89-02f8-4ba1-8de9-d5751feefbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:00.294218 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6281c89-02f8-4ba1-8de9-d5751feefbeb None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:00.294523 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6281c89-02f8-4ba1-8de9-d5751feefbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:00.294800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6281c89-02f8-4ba1-8de9-d5751feefbeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:00.359113 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6281c89-02f8-4ba1-8de9-d5751feefbeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:00.360546 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6281c89-02f8-4ba1-8de9-d5751feefbeb None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:00.460467 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 520/1040] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:03:00 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 21:03:00.465929 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04261ec3-b485-4a65-b118-cbe2710cafcd None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:00.559294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04261ec3-b485-4a65-b118-cbe2710cafcd None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:00.596232 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9eec94-8f1e-49ea-abd8-570ce6f30dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:00.597024 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eec94-8f1e-49ea-abd8-570ce6f30dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:00.597308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eec94-8f1e-49ea-abd8-570ce6f30dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:00.597580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eec94-8f1e-49ea-abd8-570ce6f30dd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:00.608141 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9eec94-8f1e-49ea-abd8-570ce6f30dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:00.609718 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9eec94-8f1e-49ea-abd8-570ce6f30dd7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:00.611307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aa71e-a1ba-4fd1-a0d7-4ac6a1541c20 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:00.611604 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aa71e-a1ba-4fd1-a0d7-4ac6a1541c20 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:00.611888 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aa71e-a1ba-4fd1-a0d7-4ac6a1541c20 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:00.613366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 521/1041] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:03:00.619484 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bc449-8b03-4036-aa44-b59552d9414c None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:00.620081 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bc449-8b03-4036-aa44-b59552d9414c None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:00.620081 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bc449-8b03-4036-aa44-b59552d9414c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:00.628452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-dc9eec94-8f1e-49ea-abd8-570ce6f30dd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:03:00.628452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:00.628452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:00.628452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:00.628452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:00.628452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:00.628452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:00.628452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:00.628452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:00.628452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:00.628452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:00.628452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:00.628452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:03:00.628452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:03:00.628452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:03:00.630063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:03:00.630063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:00.630063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:00.630063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:00.630063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:00.630063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:00.630063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:00.630063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:00.630063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:03:00.630063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:00.630063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:00.630063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:00.630063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:00.630063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:00.630063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:00.630063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:00.630063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:00.635298 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:03:00.635298 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:03:00.635298 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:03:00.635298 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:03:00.635298 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 521/1042] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:03:00.636263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9eec94-8f1e-49ea-abd8-570ce6f30dd7 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:00.637862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-528bc449-8b03-4036-aa44-b59552d9414c None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:00.639077 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-528bc449-8b03-4036-aa44-b59552d9414c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:00.713299 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 522/1043] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:03:00.734678 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9eec94-8f1e-49ea-abd8-570ce6f30dd7 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:00.736548 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bc449-8b03-4036-aa44-b59552d9414c None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:00.769296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef5d76-c8d4-4c2f-87d7-5a647f5c1355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:00.770258 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef5d76-c8d4-4c2f-87d7-5a647f5c1355 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:00.770568 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef5d76-c8d4-4c2f-87d7-5a647f5c1355 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:00.770843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef5d76-c8d4-4c2f-87d7-5a647f5c1355 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:00.771579 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef5d76-c8d4-4c2f-87d7-5a647f5c1355 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:00.771883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef5d76-c8d4-4c2f-87d7-5a647f5c1355 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:00.773231 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef5d76-c8d4-4c2f-87d7-5a647f5c1355 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:00.784289 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 522/1044] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:00.789817 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef5d76-c8d4-4c2f-87d7-5a647f5c1355 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:00.835743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bc449-8b03-4036-aa44-b59552d9414c None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:00.877102 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3ef81-6f1b-4508-9155-7ec331fbd791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:00.878511 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3ef81-6f1b-4508-9155-7ec331fbd791 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:00.878968 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3ef81-6f1b-4508-9155-7ec331fbd791 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:00.879990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3ef81-6f1b-4508-9155-7ec331fbd791 None admin] PATH_INFO: `/v3/services/image` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:00.880794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3ef81-6f1b-4508-9155-7ec331fbd791 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:00.882315 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3ef81-6f1b-4508-9155-7ec331fbd791 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:00.893937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-b9e3ef81-6f1b-4508-9155-7ec331fbd791 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 21:03:00.893937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:00.893937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:03:00.893937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:03:00.893937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:03:00.893937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:03:00.893937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:03:00.893937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:03:00.893937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 21:03:00.893937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:03:00.893937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:03:00.893937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:03:00.893937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:00.893937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:00.893937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:00.893937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:00.893937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:00.895273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:00.895273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:00.895273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:00.895273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:00.895273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:00.895273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:00.895273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:03:00.895273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:03:00.895273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:03:00.895273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:03:00.895273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:00.895273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:00.895273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:00.895273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:00.895273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:00.895273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:00.896343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:00.896343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:03:00.896343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:00.896343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:00.896343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:00.896343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:00.896343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:00.896343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:00.896343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:00.896343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:00.896343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:03:00.896343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:03:00.896343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 21:03:00.896343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:03:00.903534 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef5d76-c8d4-4c2f-87d7-5a647f5c1355 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:00.903688 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 523/1045] 10.222.0.25 () {56 vars in 1105 bytes} [Tue May 10 21:03:00 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:03:00.904640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3ef81-6f1b-4508-9155-7ec331fbd791 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:00.935339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca6542-5792-4909-9171-e8e16faa117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:00.936134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca6542-5792-4909-9171-e8e16faa117b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:00.936419 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca6542-5792-4909-9171-e8e16faa117b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:00.936702 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca6542-5792-4909-9171-e8e16faa117b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:00.943917 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca6542-5792-4909-9171-e8e16faa117b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:00.945371 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca6542-5792-4909-9171-e8e16faa117b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:00.959915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-10ca6542-5792-4909-9171-e8e16faa117b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:03:00.959915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:00.959915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:00.959915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:00.959915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:00.959915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:00.959915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:00.959915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:00.959915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:00.959915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:00.959915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:00.959915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:00.959915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:03:00.959915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:03:00.959915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:03:00.961015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:03:00.961015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:00.961015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:00.961015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:00.961015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:00.961015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:00.961015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:00.961015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:00.961015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:03:00.961015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:00.961015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:00.961015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:00.961015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:00.961015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:00.961015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:00.961015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:00.961015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:00.961950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:03:00.961950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:03:00.961950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:03:00.961950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:03:00.961950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:03:00.961950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:03:00.961950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:03:00.961950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:03:00.961950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 523/1046] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:03:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:03:00.966886 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca6542-5792-4909-9171-e8e16faa117b None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:01.008202 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3ef81-6f1b-4508-9155-7ec331fbd791 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:01.042184 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf7f8b-18c1-4b0f-8497-7febc4598cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:01.042880 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf7f8b-18c1-4b0f-8497-7febc4598cab None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:01.043420 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf7f8b-18c1-4b0f-8497-7febc4598cab None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:01.043698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf7f8b-18c1-4b0f-8497-7febc4598cab None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:01.044398 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf7f8b-18c1-4b0f-8497-7febc4598cab None admin] RBAC: Adding query filter params (name=image) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:01.044709 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf7f8b-18c1-4b0f-8497-7febc4598cab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:01.046053 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf7f8b-18c1-4b0f-8497-7febc4598cab None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:01.050821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 524/1047] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:03:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:01.057687 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf7f8b-18c1-4b0f-8497-7febc4598cab None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:01.068020 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca6542-5792-4909-9171-e8e16faa117b None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:01.103860 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62805b3-83c2-4ea5-b5f6-5a060b75b3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:01.104527 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62805b3-83c2-4ea5-b5f6-5a060b75b3ba None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:01.104838 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62805b3-83c2-4ea5-b5f6-5a060b75b3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:01.105118 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62805b3-83c2-4ea5-b5f6-5a060b75b3ba None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:01.105906 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62805b3-83c2-4ea5-b5f6-5a060b75b3ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:01.106216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62805b3-83c2-4ea5-b5f6-5a060b75b3ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:01.107663 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62805b3-83c2-4ea5-b5f6-5a060b75b3ba None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:01.124650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 524/1048] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:03:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:01.125923 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62805b3-83c2-4ea5-b5f6-5a060b75b3ba None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:01.156081 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf7f8b-18c1-4b0f-8497-7febc4598cab None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:01.192923 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68672db2-921a-41c8-91cc-e40f185d2527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:01.193593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68672db2-921a-41c8-91cc-e40f185d2527 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:01.193882 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68672db2-921a-41c8-91cc-e40f185d2527 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:01.194164 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68672db2-921a-41c8-91cc-e40f185d2527 None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:01.194905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68672db2-921a-41c8-91cc-e40f185d2527 None admin] RBAC: Adding query filter params (type=image) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:01.195214 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68672db2-921a-41c8-91cc-e40f185d2527 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:01.196581 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68672db2-921a-41c8-91cc-e40f185d2527 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:01.201423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 525/1049] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:03:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:01.206991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68672db2-921a-41c8-91cc-e40f185d2527 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:01.230274 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62805b3-83c2-4ea5-b5f6-5a060b75b3ba None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:01.263993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecabab-dda0-4be2-a30a-83a25936cd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:01.264649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecabab-dda0-4be2-a30a-83a25936cd6d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:01.264936 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecabab-dda0-4be2-a30a-83a25936cd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:01.265213 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecabab-dda0-4be2-a30a-83a25936cd6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:01.266047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecabab-dda0-4be2-a30a-83a25936cd6d None admin] RBAC: Adding query filter params (role.id=be44cff8846d48519c82b28f7c2d2c90, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=c4c16a3b07c64a22bfc3df2a5a90c3f3) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:01.266375 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecabab-dda0-4be2-a30a-83a25936cd6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:01.267796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecabab-dda0-4be2-a30a-83a25936cd6d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:01.274004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 525/1050] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:03:01 2022] GET /identity/v3/role_assignments?user.id=c4c16a3b07c64a22bfc3df2a5a90c3f3&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=be44cff8846d48519c82b28f7c2d2c90 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:01.310123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68672db2-921a-41c8-91cc-e40f185d2527 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:01.345847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57c463-3078-4bc1-91c9-21a1922a47a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:01.346551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57c463-3078-4bc1-91c9-21a1922a47a9 None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:01.347087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57c463-3078-4bc1-91c9-21a1922a47a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:01.347087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57c463-3078-4bc1-91c9-21a1922a47a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:01.348427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57c463-3078-4bc1-91c9-21a1922a47a9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:01.349317 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a41395-b126-452b-9657-15d78f8c0745 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:01.349563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a41395-b126-452b-9657-15d78f8c0745 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:01.349819 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57c463-3078-4bc1-91c9-21a1922a47a9 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:01.349922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a41395-b126-452b-9657-15d78f8c0745 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:01.351421 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 526/1051] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:03:01.357053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0d6ef-4a69-4ed7-8634-b45c5e91e6b1 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:01.357241 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0d6ef-4a69-4ed7-8634-b45c5e91e6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:01.357520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0d6ef-4a69-4ed7-8634-b45c5e91e6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:01.376352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-3ad0d6ef-4a69-4ed7-8634-b45c5e91e6b1 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:01.377719 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3ad0d6ef-4a69-4ed7-8634-b45c5e91e6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:01.449976 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 527/1052] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:03:01.460095 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 526/1053] 10.222.0.25 () {60 vars in 1144 bytes} [Tue May 10 21:03:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:03:01.474686 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0d6ef-4a69-4ed7-8634-b45c5e91e6b1 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:01.580799 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0d6ef-4a69-4ed7-8634-b45c5e91e6b1 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:01.625235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62767d77-2695-4cef-92c4-4077eb81438a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:01.626294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62767d77-2695-4cef-92c4-4077eb81438a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:01.626769 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62767d77-2695-4cef-92c4-4077eb81438a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:01.627197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62767d77-2695-4cef-92c4-4077eb81438a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:01.639204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62767d77-2695-4cef-92c4-4077eb81438a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:03:01.648053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-62767d77-2695-4cef-92c4-4077eb81438a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:03:01.648053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:01.648053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:01.648053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:01.648053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:01.648053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:01.648053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:01.648053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:01.648053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:01.648053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:01.648053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:01.648053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:01.648053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:03:01.648053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:03:01.648053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:03:01.648053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:03:01.649228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:03:01.649228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:03:01.649228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:03:01.649228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:03:01.649228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:01.649228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:01.649228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:01.649228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:01.649228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:01.649228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:01.649228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:01.649228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:03:01.649228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:01.649228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:01.649228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:01.649228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:01.650203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:01.650203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:01.650203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:01.650203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:01.650203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:03:01.650203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:03:01.650203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:03:01.650203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:03:01.650203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:03:01.650203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:03:01.650203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:03:01.650203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:03:01.651854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 528/1054] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:03:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:03:01.657844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57c463-3078-4bc1-91c9-21a1922a47a9 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:01.757078 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57c463-3078-4bc1-91c9-21a1922a47a9 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:01.789651 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717b8a4-ae99-4809-8e54-4fd14792f490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:01.790324 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717b8a4-ae99-4809-8e54-4fd14792f490 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:01.790643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717b8a4-ae99-4809-8e54-4fd14792f490 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:01.790913 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717b8a4-ae99-4809-8e54-4fd14792f490 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:01.791658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717b8a4-ae99-4809-8e54-4fd14792f490 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:01.791954 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717b8a4-ae99-4809-8e54-4fd14792f490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:01.793569 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717b8a4-ae99-4809-8e54-4fd14792f490 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:01.801819 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 527/1055] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:03:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:01.807244 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62767d77-2695-4cef-92c4-4077eb81438a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:01.904630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62767d77-2695-4cef-92c4-4077eb81438a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:01.936640 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c3e69-5a78-4338-83d4-e594b9859428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:01.937516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c3e69-5a78-4338-83d4-e594b9859428 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:01.937798 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c3e69-5a78-4338-83d4-e594b9859428 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:01.938071 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c3e69-5a78-4338-83d4-e594b9859428 None admin] PATH_INFO: `/v3/users/c1ac8bfb943e41eaafc2e395e9c9299b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:01.951773 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c3e69-5a78-4338-83d4-e594b9859428 None admin] RBAC: Authorizing `identity:get_user(user_id=c1ac8bfb943e41eaafc2e395e9c9299b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:01.953235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c3e69-5a78-4338-83d4-e594b9859428 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:01.960307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 529/1056] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:03:01 2022] GET /identity/v3/users/c1ac8bfb943e41eaafc2e395e9c9299b => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:01.961508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717b8a4-ae99-4809-8e54-4fd14792f490 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:02.059326 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717b8a4-ae99-4809-8e54-4fd14792f490 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:02.092110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec9ae6-2f81-4856-854b-2a94493fca1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:02.093129 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec9ae6-2f81-4856-854b-2a94493fca1f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:02.093619 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec9ae6-2f81-4856-854b-2a94493fca1f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:02.094099 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec9ae6-2f81-4856-854b-2a94493fca1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:02.159186 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec9ae6-2f81-4856-854b-2a94493fca1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:02.161001 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec9ae6-2f81-4856-854b-2a94493fca1f None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:02.257497 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 528/1057] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:03:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 21:03:02.262916 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c3e69-5a78-4338-83d4-e594b9859428 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:02.361868 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c3e69-5a78-4338-83d4-e594b9859428 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:02.398061 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7d68e-d5f4-4610-871e-da8a278c45b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:02.399016 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7d68e-d5f4-4610-871e-da8a278c45b1 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:02.399307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7d68e-d5f4-4610-871e-da8a278c45b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:02.399587 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7d68e-d5f4-4610-871e-da8a278c45b1 None admin] PATH_INFO: `/v3/projects/cc45723e89f44a32af23bf4edbb33f45` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:02.400769 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7d68e-d5f4-4610-871e-da8a278c45b1 None admin] RBAC: Authorizing `identity:get_project(project_id=cc45723e89f44a32af23bf4edbb33f45)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:02.402182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7d68e-d5f4-4610-871e-da8a278c45b1 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:02.404119 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 530/1058] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:03:02 2022] GET /identity/v3/projects/cc45723e89f44a32af23bf4edbb33f45 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:02.410974 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec9ae6-2f81-4856-854b-2a94493fca1f None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:02.505969 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec9ae6-2f81-4856-854b-2a94493fca1f None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:02.538586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc967540-10c4-493e-af5a-aad60131e3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:02.539244 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc967540-10c4-493e-af5a-aad60131e3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:02.539529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc967540-10c4-493e-af5a-aad60131e3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:02.539805 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc967540-10c4-493e-af5a-aad60131e3c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:02.540624 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc967540-10c4-493e-af5a-aad60131e3c5 None admin] RBAC: Adding query filter params (role.id=5cd001edc58744738aa57180c0be68a9, scope.project.id=cc45723e89f44a32af23bf4edbb33f45, user.id=c1ac8bfb943e41eaafc2e395e9c9299b) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:02.540936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc967540-10c4-493e-af5a-aad60131e3c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:02.542370 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc967540-10c4-493e-af5a-aad60131e3c5 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:02.554492 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 529/1059] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:03:02 2022] GET /identity/v3/role_assignments?user.id=c1ac8bfb943e41eaafc2e395e9c9299b&scope.project.id=cc45723e89f44a32af23bf4edbb33f45&role.id=5cd001edc58744738aa57180c0be68a9 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:03.493394 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091deb93-aa30-4178-bd94-7d2173277117 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:03.493921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091deb93-aa30-4178-bd94-7d2173277117 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:03.493921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091deb93-aa30-4178-bd94-7d2173277117 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:03.495366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 531/1060] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:03.500306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589fb5d-a820-4d13-9bad-facfbc9982f0 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:03.500684 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589fb5d-a820-4d13-9bad-facfbc9982f0 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:03.500865 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589fb5d-a820-4d13-9bad-facfbc9982f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:03.517608 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-9589fb5d-a820-4d13-9bad-facfbc9982f0 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:03.518796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-9589fb5d-a820-4d13-9bad-facfbc9982f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:03.589806 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 530/1061] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:03:03.612717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091deb93-aa30-4178-bd94-7d2173277117 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:03.712926 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091deb93-aa30-4178-bd94-7d2173277117 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:03.737416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794e2b9-b42e-4426-a731-40672eb98ecc None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:03.737712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794e2b9-b42e-4426-a731-40672eb98ecc None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:03.737991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794e2b9-b42e-4426-a731-40672eb98ecc None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:03.742492 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 531/1062] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:03:03.744924 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038144e-84de-473c-a8ec-af7d2c6e3c00 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:03.745154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038144e-84de-473c-a8ec-af7d2c6e3c00 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:03.745436 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038144e-84de-473c-a8ec-af7d2c6e3c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:03.749422 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ee369-7103-4965-a773-74bb1c90f467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:03.750231 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ee369-7103-4965-a773-74bb1c90f467 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:03.750534 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ee369-7103-4965-a773-74bb1c90f467 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:03.750807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ee369-7103-4965-a773-74bb1c90f467 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:03.761124 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ee369-7103-4965-a773-74bb1c90f467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:03:03.761927 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-6038144e-84de-473c-a8ec-af7d2c6e3c00 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:03.763207 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-6038144e-84de-473c-a8ec-af7d2c6e3c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:03.769205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-cb3ee369-7103-4965-a773-74bb1c90f467 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 21:03:03.769205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:03.769205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:03.769205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:03.769205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:03.769205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:03.769205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:03.769205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:03.769205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:03.769205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:03.769205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:03.769205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:03.769205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:03:03.769205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:03:03.769205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:03:03.769205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:03:03.770881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:03:03.770881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:03:03.770881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:03:03.770881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:03:03.770881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:03.770881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:03.770881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:03.770881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:03.770881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:03.770881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:03.770881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:03.770881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:03:03.770881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:03.770881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:03.770881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:03.770881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:03.771763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:03.771763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:03.771763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:03.771763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:03.771763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:03:03.771763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:03:03.771763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:03:03.771763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:03:03.771763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:03:03.771763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:03:03.771763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 21:03:03.771763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:03:03.771763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 532/1063] 10.222.0.25 () {56 vars in 1120 bytes} [Tue May 10 21:03:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:03:03.776760 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ee369-7103-4965-a773-74bb1c90f467 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:03.831757 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 532/1064] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:03:03.855785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038144e-84de-473c-a8ec-af7d2c6e3c00 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:03.877457 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ee369-7103-4965-a773-74bb1c90f467 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:03.910857 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810f99d-88a1-4886-b37c-68e62edbaa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:03.911472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810f99d-88a1-4886-b37c-68e62edbaa99 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:03.911763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810f99d-88a1-4886-b37c-68e62edbaa99 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:03.912048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810f99d-88a1-4886-b37c-68e62edbaa99 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:03.912827 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810f99d-88a1-4886-b37c-68e62edbaa99 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:03.913142 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810f99d-88a1-4886-b37c-68e62edbaa99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:03.914513 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810f99d-88a1-4886-b37c-68e62edbaa99 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:03.922420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 533/1065] 10.222.0.25 () {56 vars in 1115 bytes} [Tue May 10 21:03:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:03.928116 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810f99d-88a1-4886-b37c-68e62edbaa99 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:03.961603 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038144e-84de-473c-a8ec-af7d2c6e3c00 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:03.993640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2458137-a2b7-49c2-9a07-78d6614e0e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:03.994306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2458137-a2b7-49c2-9a07-78d6614e0e85 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:03.994618 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2458137-a2b7-49c2-9a07-78d6614e0e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:03.994893 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2458137-a2b7-49c2-9a07-78d6614e0e85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:04.026723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810f99d-88a1-4886-b37c-68e62edbaa99 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:04.057834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d0ead-e1f0-4b3d-b805-53cc8fd0241b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:04.058645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d0ead-e1f0-4b3d-b805-53cc8fd0241b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:04.058929 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d0ead-e1f0-4b3d-b805-53cc8fd0241b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:04.059114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2458137-a2b7-49c2-9a07-78d6614e0e85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:04.059221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d0ead-e1f0-4b3d-b805-53cc8fd0241b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:04.060551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2458137-a2b7-49c2-9a07-78d6614e0e85 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:04.070544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d0ead-e1f0-4b3d-b805-53cc8fd0241b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:04.071984 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d0ead-e1f0-4b3d-b805-53cc8fd0241b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:04.089177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-a02d0ead-e1f0-4b3d-b805-53cc8fd0241b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:03:04.089177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:04.089177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:04.089177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:04.089177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:04.089177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:04.089177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:04.089177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:04.089177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:04.089177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:04.089177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:04.089177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:04.089177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:03:04.089177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:03:04.089177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:03:04.090313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:03:04.090313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:04.090313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:04.090313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:04.090313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:04.090313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:04.090313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:04.090313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:04.090313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:03:04.090313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:04.090313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:04.090313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:04.090313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:04.090313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:04.090313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:04.090313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:04.090313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:04.095552 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:03:04.095552 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:03:04.095552 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:03:04.095552 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:03:04.095552 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 534/1066] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:03:04.096803 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d0ead-e1f0-4b3d-b805-53cc8fd0241b None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:04.162658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 533/1067] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:03:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 21:03:04.168779 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2458137-a2b7-49c2-9a07-78d6614e0e85 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:04.195307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d0ead-e1f0-4b3d-b805-53cc8fd0241b None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:04.229436 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122843a-ca63-4da7-b0cf-83c17f601c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:04.230098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122843a-ca63-4da7-b0cf-83c17f601c16 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:04.230382 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122843a-ca63-4da7-b0cf-83c17f601c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:04.230686 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122843a-ca63-4da7-b0cf-83c17f601c16 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:04.231407 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122843a-ca63-4da7-b0cf-83c17f601c16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:04.231708 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122843a-ca63-4da7-b0cf-83c17f601c16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:04.233052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122843a-ca63-4da7-b0cf-83c17f601c16 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:04.245252 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 535/1068] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:04.250858 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122843a-ca63-4da7-b0cf-83c17f601c16 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:04.274735 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2458137-a2b7-49c2-9a07-78d6614e0e85 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:04.309239 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656b395-5840-43f8-ba42-ecb780222f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:04.310254 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656b395-5840-43f8-ba42-ecb780222f5f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:04.310796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656b395-5840-43f8-ba42-ecb780222f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:04.311227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656b395-5840-43f8-ba42-ecb780222f5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:04.321865 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656b395-5840-43f8-ba42-ecb780222f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:04.323324 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656b395-5840-43f8-ba42-ecb780222f5f None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:04.340535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-e656b395-5840-43f8-ba42-ecb780222f5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:03:04.340535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:04.340535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:04.340535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:04.340535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:04.340535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:04.340535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:04.340535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:04.340535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:04.340535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:04.340535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:04.340535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:04.340535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:03:04.340535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:03:04.340535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:03:04.341502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:03:04.341502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:04.341502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:04.341502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:04.341502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:04.341502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:04.341502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:04.341502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:04.341502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:03:04.341502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:04.341502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:04.341502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:04.341502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:04.341502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:04.341502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:04.341502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:04.341502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:04.347808 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:03:04.347808 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:03:04.347808 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:03:04.347808 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:03:04.347808 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 534/1069] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:03:04.347808 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656b395-5840-43f8-ba42-ecb780222f5f None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:04.354408 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122843a-ca63-4da7-b0cf-83c17f601c16 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:04.397707 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b23c4-0b08-41dd-a671-ba2467c4e6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:04.398529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b23c4-0b08-41dd-a671-ba2467c4e6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:04.398815 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b23c4-0b08-41dd-a671-ba2467c4e6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:04.399551 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b23c4-0b08-41dd-a671-ba2467c4e6a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:04.409248 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b23c4-0b08-41dd-a671-ba2467c4e6a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:04.410751 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b23c4-0b08-41dd-a671-ba2467c4e6a4 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:04.430890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-206b23c4-0b08-41dd-a671-ba2467c4e6a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 21:03:04.430890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:04.430890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:04.430890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:04.430890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:04.430890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:04.430890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:04.430890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:04.430890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:04.430890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:04.430890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:04.430890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:04.430890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:03:04.430890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:03:04.430890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:03:04.430890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:03:04.431925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:04.431925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:04.431925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:03:04.431925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:03:04.431925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:03:04.431925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:03:04.431925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:04.431925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:04.431925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:04.431925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:04.431925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:04.431925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:03:04.431925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:04.431925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:04.431925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:04.431925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:04.431925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:04.431925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:04.432895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:04.432895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:04.432895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:03:04.432895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:03:04.432895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:03:04.432895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:03:04.432895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:03:04.432895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:03:04.432895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 21:03:04.432895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:03:04.434389 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 536/1070] 10.222.0.25 () {56 vars in 1093 bytes} [Tue May 10 21:03:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:03:04.437583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b23c4-0b08-41dd-a671-ba2467c4e6a4 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:04.449700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656b395-5840-43f8-ba42-ecb780222f5f None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:04.483089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6e964-8a8a-4057-90a2-023f70277372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:04.483759 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6e964-8a8a-4057-90a2-023f70277372 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:04.484047 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6e964-8a8a-4057-90a2-023f70277372 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:04.484381 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6e964-8a8a-4057-90a2-023f70277372 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:04.485072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6e964-8a8a-4057-90a2-023f70277372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:04.485378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6e964-8a8a-4057-90a2-023f70277372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:04.486778 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6e964-8a8a-4057-90a2-023f70277372 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:04.499172 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 535/1071] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:04.538715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b23c4-0b08-41dd-a671-ba2467c4e6a4 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:04.575392 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1157966-7f02-4573-a56d-60b67e481069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:04.575989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1157966-7f02-4573-a56d-60b67e481069 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:04.576269 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1157966-7f02-4573-a56d-60b67e481069 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:04.576542 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1157966-7f02-4573-a56d-60b67e481069 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:04.577408 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1157966-7f02-4573-a56d-60b67e481069 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:04.577723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1157966-7f02-4573-a56d-60b67e481069 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:04.579278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1157966-7f02-4573-a56d-60b67e481069 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:04.599865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 537/1072] 10.222.0.25 () {56 vars in 1133 bytes} [Tue May 10 21:03:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:04.605881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6e964-8a8a-4057-90a2-023f70277372 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:04.713799 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6e964-8a8a-4057-90a2-023f70277372 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:04.749146 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a43cd-1c3c-4940-bbed-a71b448d321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:04.750487 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a43cd-1c3c-4940-bbed-a71b448d321e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:04.750802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a43cd-1c3c-4940-bbed-a71b448d321e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:04.751080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a43cd-1c3c-4940-bbed-a71b448d321e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:04.762332 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a43cd-1c3c-4940-bbed-a71b448d321e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:04.763816 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a43cd-1c3c-4940-bbed-a71b448d321e None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:04.781061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-885a43cd-1c3c-4940-bbed-a71b448d321e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:03:04.781061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:04.781061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:04.781061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:04.781061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:04.781061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:04.781061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:04.781061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:04.781061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:04.781061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:04.781061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:04.781061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:04.781061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:03:04.781061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:03:04.781061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:03:04.782026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:03:04.782026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:04.782026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:04.782026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:04.782026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:04.782026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:04.782026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:04.782026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:04.782026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:03:04.782026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:04.782026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:04.782026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:04.782026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:04.782026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:04.782026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:04.782026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:04.782026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:04.783046 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:03:04.783046 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:03:04.783046 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:03:04.783046 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:03:04.783046 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 536/1073] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:03:04.788696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a43cd-1c3c-4940-bbed-a71b448d321e None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:04.789272 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5598f4a-e748-43ec-9494-1b3211637adb None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:04.789684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5598f4a-e748-43ec-9494-1b3211637adb None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:04.789964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5598f4a-e748-43ec-9494-1b3211637adb None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:04.791450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 538/1074] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:04.797008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690db75c-9389-467b-a1b6-02acfef3be7c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:04.797306 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690db75c-9389-467b-a1b6-02acfef3be7c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:04.797584 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690db75c-9389-467b-a1b6-02acfef3be7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:04.818642 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-690db75c-9389-467b-a1b6-02acfef3be7c None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:04.819850 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-690db75c-9389-467b-a1b6-02acfef3be7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:04.889180 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 539/1075] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:03:04.891956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a43cd-1c3c-4940-bbed-a71b448d321e None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:04.912060 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690db75c-9389-467b-a1b6-02acfef3be7c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:04.924191 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf35428-c783-4403-97a5-a3669d508cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:04.924851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf35428-c783-4403-97a5-a3669d508cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:04.925129 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf35428-c783-4403-97a5-a3669d508cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:04.925402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf35428-c783-4403-97a5-a3669d508cc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:04.926804 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf35428-c783-4403-97a5-a3669d508cc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:04.927109 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf35428-c783-4403-97a5-a3669d508cc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:04.928452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf35428-c783-4403-97a5-a3669d508cc4 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:04.939699 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 537/1076] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:04.945329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf35428-c783-4403-97a5-a3669d508cc4 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:05.006222 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690db75c-9389-467b-a1b6-02acfef3be7c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:05.039241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf35428-c783-4403-97a5-a3669d508cc4 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:05.039539 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df874528-756b-4d76-859d-b9d1e7d6e49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:05.040330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df874528-756b-4d76-859d-b9d1e7d6e49b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:05.040616 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df874528-756b-4d76-859d-b9d1e7d6e49b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:05.040892 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df874528-756b-4d76-859d-b9d1e7d6e49b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:05.050902 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df874528-756b-4d76-859d-b9d1e7d6e49b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:03:05.058894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-df874528-756b-4d76-859d-b9d1e7d6e49b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:03:05.058894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:05.058894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:05.058894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:05.058894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:05.058894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:05.058894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:05.058894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:05.058894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:05.058894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:05.058894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:05.058894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:05.058894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:03:05.058894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:03:05.058894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:03:05.058894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:03:05.059948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:03:05.059948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:03:05.059948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:03:05.059948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:03:05.059948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:05.059948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:05.059948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:05.059948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:05.059948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:05.059948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:05.059948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:05.059948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:03:05.059948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:05.059948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:05.059948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:05.059948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:05.060812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:05.060812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:05.060812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:05.060812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:05.060812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:03:05.060812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:03:05.060812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:03:05.060812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:03:05.060812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:03:05.060812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:03:05.060812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:03:05.060812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:03:05.060812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 540/1077] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:03:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:03:05.066011 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df874528-756b-4d76-859d-b9d1e7d6e49b None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:05.072964 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af943b3-41fa-4e04-8b0e-220564fa6e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:05.073758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af943b3-41fa-4e04-8b0e-220564fa6e31 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:05.074040 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af943b3-41fa-4e04-8b0e-220564fa6e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:05.074312 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af943b3-41fa-4e04-8b0e-220564fa6e31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:05.080859 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af943b3-41fa-4e04-8b0e-220564fa6e31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:05.083296 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af943b3-41fa-4e04-8b0e-220564fa6e31 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:05.096556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-9af943b3-41fa-4e04-8b0e-220564fa6e31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:03:05.096556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:05.096556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:05.096556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:05.096556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:05.096556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:05.096556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:05.096556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:05.096556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:05.096556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:05.096556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:05.096556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:05.096556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:03:05.096556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:03:05.096556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:03:05.097633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:03:05.097633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:05.097633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:05.097633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:05.097633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:05.097633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:05.097633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:05.097633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:05.097633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:03:05.097633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:05.097633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:05.097633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:05.097633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:05.097633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:05.097633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:05.097633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:05.097633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:05.099235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:03:05.099235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:03:05.099235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:03:05.099235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:03:05.099235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:03:05.099235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:03:05.099235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:03:05.099235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:03:05.099235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 538/1078] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:03:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:03:05.104321 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af943b3-41fa-4e04-8b0e-220564fa6e31 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:05.159253 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df874528-756b-4d76-859d-b9d1e7d6e49b None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:05.190493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e5f08-a7e9-4a5a-b33d-9b38ef7eba96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:05.191150 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e5f08-a7e9-4a5a-b33d-9b38ef7eba96 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:05.191561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e5f08-a7e9-4a5a-b33d-9b38ef7eba96 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:05.191836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e5f08-a7e9-4a5a-b33d-9b38ef7eba96 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:05.192571 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e5f08-a7e9-4a5a-b33d-9b38ef7eba96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:05.192874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e5f08-a7e9-4a5a-b33d-9b38ef7eba96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:05.194226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e5f08-a7e9-4a5a-b33d-9b38ef7eba96 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:05.199790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af943b3-41fa-4e04-8b0e-220564fa6e31 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:05.202007 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 541/1079] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:03:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:05.208098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e5f08-a7e9-4a5a-b33d-9b38ef7eba96 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:05.233214 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a7adf-b4cd-4de3-845d-99098b12652b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:05.233875 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a7adf-b4cd-4de3-845d-99098b12652b None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:05.234171 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a7adf-b4cd-4de3-845d-99098b12652b None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:05.234458 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a7adf-b4cd-4de3-845d-99098b12652b None admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:05.235245 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a7adf-b4cd-4de3-845d-99098b12652b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:05.235552 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a7adf-b4cd-4de3-845d-99098b12652b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:05.236965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a7adf-b4cd-4de3-845d-99098b12652b None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:05.248543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 539/1080] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:05.254461 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a7adf-b4cd-4de3-845d-99098b12652b None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:05.302009 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e5f08-a7e9-4a5a-b33d-9b38ef7eba96 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:05.333247 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff387473-676e-4882-a9ad-25d8c3b66797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:05.334110 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff387473-676e-4882-a9ad-25d8c3b66797 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:05.334389 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff387473-676e-4882-a9ad-25d8c3b66797 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:05.334693 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff387473-676e-4882-a9ad-25d8c3b66797 None admin] PATH_INFO: `/v3/users/c1ac8bfb943e41eaafc2e395e9c9299b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:05.335877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff387473-676e-4882-a9ad-25d8c3b66797 None admin] RBAC: Authorizing `identity:get_user(user_id=c1ac8bfb943e41eaafc2e395e9c9299b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:05.337278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff387473-676e-4882-a9ad-25d8c3b66797 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:05.339104 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 542/1081] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:03:05 2022] GET /identity/v3/users/c1ac8bfb943e41eaafc2e395e9c9299b => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:05.344303 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff387473-676e-4882-a9ad-25d8c3b66797 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:05.348514 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a7adf-b4cd-4de3-845d-99098b12652b None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:05.382351 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f8422-dab3-428b-8cf3-727265ee5d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:05.383254 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f8422-dab3-428b-8cf3-727265ee5d6b None admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:05.388652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f8422-dab3-428b-8cf3-727265ee5d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:05.388652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f8422-dab3-428b-8cf3-727265ee5d6b None admin] PATH_INFO: `/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/c4c16a3b07c64a22bfc3df2a5a90c3f3/roles/be44cff8846d48519c82b28f7c2d2c90` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:05.388652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f8422-dab3-428b-8cf3-727265ee5d6b None admin] RBAC: Authorizing `identity:create_grant(project_id=385eeb55a9ae42eba674de1e83d96e0d, user_id=c4c16a3b07c64a22bfc3df2a5a90c3f3, role_id=be44cff8846d48519c82b28f7c2d2c90)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:05.388652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f8422-dab3-428b-8cf3-727265ee5d6b None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:05.438726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff387473-676e-4882-a9ad-25d8c3b66797 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:05.470817 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd80fb8-f1d7-4ffd-a328-f6d020d43f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:05.471656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd80fb8-f1d7-4ffd-a328-f6d020d43f6b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:05.471943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd80fb8-f1d7-4ffd-a328-f6d020d43f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:05.472211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd80fb8-f1d7-4ffd-a328-f6d020d43f6b None admin] PATH_INFO: `/v3/projects/cc45723e89f44a32af23bf4edbb33f45` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:05.473919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd80fb8-f1d7-4ffd-a328-f6d020d43f6b None admin] RBAC: Authorizing `identity:get_project(project_id=cc45723e89f44a32af23bf4edbb33f45)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:05.475351 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd80fb8-f1d7-4ffd-a328-f6d020d43f6b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:05.475860 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 540/1082] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:03:05 2022] PUT /identity/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/c4c16a3b07c64a22bfc3df2a5a90c3f3/roles/be44cff8846d48519c82b28f7c2d2c90 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:03:05.481449 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 543/1083] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:03:05 2022] GET /identity/v3/projects/cc45723e89f44a32af23bf4edbb33f45 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:05.483127 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f8422-dab3-428b-8cf3-727265ee5d6b None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:05.591468 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f8422-dab3-428b-8cf3-727265ee5d6b None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:05.628739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2843037-12fd-4b96-89d6-486184965e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:05.630163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2843037-12fd-4b96-89d6-486184965e10 None admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:05.630475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2843037-12fd-4b96-89d6-486184965e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:05.630768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2843037-12fd-4b96-89d6-486184965e10 None admin] PATH_INFO: `/v3/projects/cc45723e89f44a32af23bf4edbb33f45/users/c1ac8bfb943e41eaafc2e395e9c9299b/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:05.632829 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2843037-12fd-4b96-89d6-486184965e10 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc45723e89f44a32af23bf4edbb33f45, user_id=c1ac8bfb943e41eaafc2e395e9c9299b, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:05.634288 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2843037-12fd-4b96-89d6-486184965e10 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:05.682128 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 541/1084] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:03:05 2022] PUT /identity/v3/projects/cc45723e89f44a32af23bf4edbb33f45/users/c1ac8bfb943e41eaafc2e395e9c9299b/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:03:07.701130 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dd143-a8a3-4939-b192-81b0c05f8233 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:07.701699 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dd143-a8a3-4939-b192-81b0c05f8233 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:07.701699 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dd143-a8a3-4939-b192-81b0c05f8233 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:07.703217 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 544/1085] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:07.709330 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6a7de-b609-457c-b6f2-42b1d70391e7 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:07.709874 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6a7de-b609-457c-b6f2-42b1d70391e7 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:07.709968 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6a7de-b609-457c-b6f2-42b1d70391e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:07.728054 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-2bc6a7de-b609-457c-b6f2-42b1d70391e7 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:07.729274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-2bc6a7de-b609-457c-b6f2-42b1d70391e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:07.794941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 542/1086] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:03:07.818424 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dd143-a8a3-4939-b192-81b0c05f8233 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:07.889948 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94deeb-3447-4bdf-8f4e-db5ae9b5be13 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:07.890242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94deeb-3447-4bdf-8f4e-db5ae9b5be13 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:07.890559 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94deeb-3447-4bdf-8f4e-db5ae9b5be13 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:07.891929 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 543/1087] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:03:07.897171 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daa2c5-63f2-4e40-986f-f230bf89c935 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:07.897454 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daa2c5-63f2-4e40-986f-f230bf89c935 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:07.897731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daa2c5-63f2-4e40-986f-f230bf89c935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:07.914020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-a2daa2c5-63f2-4e40-986f-f230bf89c935 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:07.915211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a2daa2c5-63f2-4e40-986f-f230bf89c935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:07.915990 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dd143-a8a3-4939-b192-81b0c05f8233 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:07.948785 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80517ba0-d2f2-4a75-869d-cf60585ca32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:07.949595 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80517ba0-d2f2-4a75-869d-cf60585ca32a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:07.949883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80517ba0-d2f2-4a75-869d-cf60585ca32a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:07.950171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80517ba0-d2f2-4a75-869d-cf60585ca32a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:07.960093 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80517ba0-d2f2-4a75-869d-cf60585ca32a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:03:07.968078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-80517ba0-d2f2-4a75-869d-cf60585ca32a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 21:03:07.968078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:07.968078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:07.968078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:07.968078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:07.968078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:07.968078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:07.968078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:07.968078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:07.968078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:07.968078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:07.968078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:07.968078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:03:07.968078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:03:07.968078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:03:07.968078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:03:07.969022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:03:07.969022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:03:07.969022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:03:07.969022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:03:07.969022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:07.969022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:07.969022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:07.969022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:07.969022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:07.969022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:07.969022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:07.969022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:03:07.969022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:07.969022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:07.969022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:07.969022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:07.969878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:07.969878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:07.969878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:07.969878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:07.969878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:03:07.969878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:03:07.969878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:03:07.969878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:03:07.969878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:03:07.969878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:03:07.969878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 21:03:07.969878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:03:07.969878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 545/1088] 10.222.0.25 () {56 vars in 1120 bytes} [Tue May 10 21:03:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:03:07.975690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80517ba0-d2f2-4a75-869d-cf60585ca32a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:07.978759 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 544/1089] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:03:08.001847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daa2c5-63f2-4e40-986f-f230bf89c935 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:08.070089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80517ba0-d2f2-4a75-869d-cf60585ca32a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:08.095490 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daa2c5-63f2-4e40-986f-f230bf89c935 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:08.102056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc333d-78b0-4c05-94c5-b6ffb46c3f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:08.102753 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc333d-78b0-4c05-94c5-b6ffb46c3f9e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:08.103045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc333d-78b0-4c05-94c5-b6ffb46c3f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:08.103327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc333d-78b0-4c05-94c5-b6ffb46c3f9e None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:08.104072 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc333d-78b0-4c05-94c5-b6ffb46c3f9e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:08.104383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc333d-78b0-4c05-94c5-b6ffb46c3f9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:08.105745 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc333d-78b0-4c05-94c5-b6ffb46c3f9e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:08.113350 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 546/1090] 10.222.0.25 () {56 vars in 1115 bytes} [Tue May 10 21:03:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:08.118972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc333d-78b0-4c05-94c5-b6ffb46c3f9e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:08.128075 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15135c0-48c4-4a49-8938-112de4e78a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:08.128966 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15135c0-48c4-4a49-8938-112de4e78a14 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:08.129289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15135c0-48c4-4a49-8938-112de4e78a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:08.129566 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15135c0-48c4-4a49-8938-112de4e78a14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:08.139368 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15135c0-48c4-4a49-8938-112de4e78a14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:03:08.147605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-e15135c0-48c4-4a49-8938-112de4e78a14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:03:08.147605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:08.147605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:08.147605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:08.147605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:08.147605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:08.147605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:08.147605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:08.147605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:08.147605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:08.147605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:08.147605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:08.147605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:03:08.147605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:03:08.147605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:03:08.147605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:03:08.148670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:03:08.148670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:03:08.148670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:03:08.148670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:03:08.148670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:08.148670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:08.148670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:08.148670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:08.148670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:08.148670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:08.148670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:08.148670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:03:08.148670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:08.148670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:08.148670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:08.148670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:08.149544 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:08.149544 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:08.149544 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:08.149544 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:08.149544 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:03:08.149544 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:03:08.149544 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:03:08.149544 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:03:08.149544 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:03:08.149544 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:03:08.149544 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:03:08.149544 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:03:08.150850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 545/1091] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:03:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:03:08.154523 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15135c0-48c4-4a49-8938-112de4e78a14 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:08.212020 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc333d-78b0-4c05-94c5-b6ffb46c3f9e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:08.248327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7db6f-bf9c-43fb-9f1d-62c8b75f0b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:08.249219 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7db6f-bf9c-43fb-9f1d-62c8b75f0b02 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:08.249643 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7db6f-bf9c-43fb-9f1d-62c8b75f0b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:08.249984 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7db6f-bf9c-43fb-9f1d-62c8b75f0b02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:08.254619 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15135c0-48c4-4a49-8938-112de4e78a14 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:08.260899 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7db6f-bf9c-43fb-9f1d-62c8b75f0b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:08.262373 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7db6f-bf9c-43fb-9f1d-62c8b75f0b02 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:08.279354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-81c7db6f-bf9c-43fb-9f1d-62c8b75f0b02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:03:08.279354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:08.279354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:08.279354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:08.279354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:08.279354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:08.279354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:08.279354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:08.279354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:08.279354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:08.279354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:08.279354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:08.279354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:03:08.279354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:03:08.279354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:03:08.280516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:03:08.280516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:08.280516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:08.280516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:08.280516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:08.280516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:08.280516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:08.280516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:08.280516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:03:08.280516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:08.280516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:08.280516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:08.280516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:08.280516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:08.280516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:08.280516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:08.280516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:08.281493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:03:08.281493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:03:08.281493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:03:08.281493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:03:08.281493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 547/1092] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:03:08.286827 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7db6f-bf9c-43fb-9f1d-62c8b75f0b02 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:08.288521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d791701-cb00-4fa1-b64f-74a697e7ca4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:08.289268 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d791701-cb00-4fa1-b64f-74a697e7ca4c None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:08.289552 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d791701-cb00-4fa1-b64f-74a697e7ca4c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:08.289825 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d791701-cb00-4fa1-b64f-74a697e7ca4c None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:08.290602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d791701-cb00-4fa1-b64f-74a697e7ca4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:08.290943 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d791701-cb00-4fa1-b64f-74a697e7ca4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:08.292368 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d791701-cb00-4fa1-b64f-74a697e7ca4c None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:08.301207 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 546/1093] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:03:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:08.306815 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d791701-cb00-4fa1-b64f-74a697e7ca4c None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:08.380894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7db6f-bf9c-43fb-9f1d-62c8b75f0b02 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:08.400423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d791701-cb00-4fa1-b64f-74a697e7ca4c None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:08.413049 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bed2e-582f-4ae1-a5b8-5a317f9ec400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:08.413713 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bed2e-582f-4ae1-a5b8-5a317f9ec400 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:08.413996 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bed2e-582f-4ae1-a5b8-5a317f9ec400 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:08.414274 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bed2e-582f-4ae1-a5b8-5a317f9ec400 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:08.415032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bed2e-582f-4ae1-a5b8-5a317f9ec400 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:08.419450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bed2e-582f-4ae1-a5b8-5a317f9ec400 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:08.419450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bed2e-582f-4ae1-a5b8-5a317f9ec400 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:08.428589 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 548/1094] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:08.433931 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a40fb5-451a-4ae7-a90a-c7d253a6b8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:08.434098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bed2e-582f-4ae1-a5b8-5a317f9ec400 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:08.434834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a40fb5-451a-4ae7-a90a-c7d253a6b8aa None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:08.435116 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a40fb5-451a-4ae7-a90a-c7d253a6b8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:08.435393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a40fb5-451a-4ae7-a90a-c7d253a6b8aa None admin] PATH_INFO: `/v3/users/c1ac8bfb943e41eaafc2e395e9c9299b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:08.436598 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a40fb5-451a-4ae7-a90a-c7d253a6b8aa None admin] RBAC: Authorizing `identity:get_user(user_id=c1ac8bfb943e41eaafc2e395e9c9299b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:08.438013 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a40fb5-451a-4ae7-a90a-c7d253a6b8aa None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:08.439718 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 547/1095] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:03:08 2022] GET /identity/v3/users/c1ac8bfb943e41eaafc2e395e9c9299b => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:08.445891 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a40fb5-451a-4ae7-a90a-c7d253a6b8aa None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:08.563367 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bed2e-582f-4ae1-a5b8-5a317f9ec400 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:08.564634 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a40fb5-451a-4ae7-a90a-c7d253a6b8aa None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:08.596408 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71f263-5459-4e6d-b6cd-1a4231969c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:08.597192 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71f263-5459-4e6d-b6cd-1a4231969c5b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:08.597506 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71f263-5459-4e6d-b6cd-1a4231969c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:08.597780 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71f263-5459-4e6d-b6cd-1a4231969c5b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:08.597949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be617fda-3fb6-4960-bc05-f5033545f748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:08.598698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be617fda-3fb6-4960-bc05-f5033545f748 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:08.598983 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be617fda-3fb6-4960-bc05-f5033545f748 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:08.599258 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be617fda-3fb6-4960-bc05-f5033545f748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:08.604949 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71f263-5459-4e6d-b6cd-1a4231969c5b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:08.607674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71f263-5459-4e6d-b6cd-1a4231969c5b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:08.620518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-5a71f263-5459-4e6d-b6cd-1a4231969c5b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 21:03:08.620518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:08.620518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:08.620518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:08.620518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:08.620518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:08.620518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:08.620518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:08.620518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:08.620518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:08.620518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:08.620518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:08.620518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:03:08.620518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:03:08.620518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:03:08.620518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:03:08.621515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:08.621515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:08.621515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:03:08.621515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:03:08.621515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:03:08.621515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:03:08.621515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:08.621515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:08.621515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:08.621515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:08.621515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:08.621515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:03:08.621515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:08.621515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:08.621515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:08.621515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:08.621515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:08.621515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:08.622535 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:08.622535 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:08.622535 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:03:08.622535 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:03:08.622535 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:03:08.622535 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:03:08.622535 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:03:08.622535 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:03:08.622535 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 21:03:08.622535 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:03:08.622535 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 549/1096] 10.222.0.25 () {56 vars in 1093 bytes} [Tue May 10 21:03:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 21:03:08.627335 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71f263-5459-4e6d-b6cd-1a4231969c5b None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:08.664941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be617fda-3fb6-4960-bc05-f5033545f748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:08.666379 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be617fda-3fb6-4960-bc05-f5033545f748 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:08.723156 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71f263-5459-4e6d-b6cd-1a4231969c5b None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:08.756115 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183dc5d-44a7-4de6-841e-185eb1203051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:08.756785 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183dc5d-44a7-4de6-841e-185eb1203051 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:08.757073 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183dc5d-44a7-4de6-841e-185eb1203051 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:08.757350 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183dc5d-44a7-4de6-841e-185eb1203051 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:08.758185 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183dc5d-44a7-4de6-841e-185eb1203051 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:08.758522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183dc5d-44a7-4de6-841e-185eb1203051 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:08.759002 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 548/1097] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:03:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 21:03:08.760043 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183dc5d-44a7-4de6-841e-185eb1203051 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:08.766389 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be617fda-3fb6-4960-bc05-f5033545f748 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:08.783226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 550/1098] 10.222.0.25 () {56 vars in 1133 bytes} [Tue May 10 21:03:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:08.784336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183dc5d-44a7-4de6-841e-185eb1203051 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:08.861384 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be617fda-3fb6-4960-bc05-f5033545f748 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:08.883045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183dc5d-44a7-4de6-841e-185eb1203051 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:08.894904 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1b636-9adc-4082-8e6e-161760cd0760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:08.895759 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1b636-9adc-4082-8e6e-161760cd0760 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:08.896045 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1b636-9adc-4082-8e6e-161760cd0760 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:08.896315 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1b636-9adc-4082-8e6e-161760cd0760 None admin] PATH_INFO: `/v3/projects/cc45723e89f44a32af23bf4edbb33f45` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:08.897486 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1b636-9adc-4082-8e6e-161760cd0760 None admin] RBAC: Authorizing `identity:get_project(project_id=cc45723e89f44a32af23bf4edbb33f45)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:08.898936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1b636-9adc-4082-8e6e-161760cd0760 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:08.900602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 549/1099] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:03:08 2022] GET /identity/v3/projects/cc45723e89f44a32af23bf4edbb33f45 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:08.906411 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1b636-9adc-4082-8e6e-161760cd0760 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:08.915044 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f63573-fbc7-4571-8cad-3f99c5d933b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:08.915690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f63573-fbc7-4571-8cad-3f99c5d933b0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:08.915973 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f63573-fbc7-4571-8cad-3f99c5d933b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:08.916249 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f63573-fbc7-4571-8cad-3f99c5d933b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:08.978852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f63573-fbc7-4571-8cad-3f99c5d933b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:08.980292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f63573-fbc7-4571-8cad-3f99c5d933b0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:08.998686 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1b636-9adc-4082-8e6e-161760cd0760 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:09.030736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f2345-a53e-4d2d-8578-9599228a9716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:09.031377 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f2345-a53e-4d2d-8578-9599228a9716 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:09.031663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f2345-a53e-4d2d-8578-9599228a9716 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:09.031940 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f2345-a53e-4d2d-8578-9599228a9716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:09.032760 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f2345-a53e-4d2d-8578-9599228a9716 None admin] RBAC: Adding query filter params (role.id=5cd001edc58744738aa57180c0be68a9, scope.project.id=cc45723e89f44a32af23bf4edbb33f45, user.id=c1ac8bfb943e41eaafc2e395e9c9299b) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:09.033070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f2345-a53e-4d2d-8578-9599228a9716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:09.034487 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f2345-a53e-4d2d-8578-9599228a9716 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:09.040100 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 550/1100] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:03:08 2022] GET /identity/v3/role_assignments?user.id=c1ac8bfb943e41eaafc2e395e9c9299b&scope.project.id=cc45723e89f44a32af23bf4edbb33f45&role.id=5cd001edc58744738aa57180c0be68a9 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:09.076173 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 551/1101] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:03:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 21:03:09.082244 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f2345-a53e-4d2d-8578-9599228a9716 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:09.186898 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f2345-a53e-4d2d-8578-9599228a9716 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:09.220887 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551e589-bf65-4525-9353-4fc2365f07e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:09.221693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551e589-bf65-4525-9353-4fc2365f07e0 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:09.221978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551e589-bf65-4525-9353-4fc2365f07e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:09.223589 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551e589-bf65-4525-9353-4fc2365f07e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:09.233938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551e589-bf65-4525-9353-4fc2365f07e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:09.235441 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551e589-bf65-4525-9353-4fc2365f07e0 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:09.252720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-2551e589-bf65-4525-9353-4fc2365f07e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:03:09.252720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:09.252720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:09.252720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:09.252720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:09.252720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:09.252720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:09.252720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:09.252720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:09.252720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:09.252720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:09.252720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:09.252720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:03:09.252720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:03:09.252720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:03:09.254286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:03:09.254286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:09.254286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:09.254286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:09.254286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:09.254286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:09.254286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:09.254286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:09.254286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:03:09.254286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:09.254286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:09.254286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:09.254286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:09.254286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:09.254286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:09.254286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:09.254286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:09.255327 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:03:09.255327 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:03:09.255327 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:03:09.255327 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:03:09.255327 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 551/1102] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:03:09.260123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f63573-fbc7-4571-8cad-3f99c5d933b0 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:09.353921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f63573-fbc7-4571-8cad-3f99c5d933b0 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:09.387057 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70b6e9-e930-4ce1-a1e7-a53afb0e9dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:09.387716 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70b6e9-e930-4ce1-a1e7-a53afb0e9dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:09.388000 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70b6e9-e930-4ce1-a1e7-a53afb0e9dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:09.388273 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70b6e9-e930-4ce1-a1e7-a53afb0e9dd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:09.388982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70b6e9-e930-4ce1-a1e7-a53afb0e9dd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:09.389310 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70b6e9-e930-4ce1-a1e7-a53afb0e9dd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:09.390690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70b6e9-e930-4ce1-a1e7-a53afb0e9dd3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:09.402186 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 552/1103] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:09.407725 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551e589-bf65-4525-9353-4fc2365f07e0 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:09.503036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551e589-bf65-4525-9353-4fc2365f07e0 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:09.535874 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57196566-2459-4826-b6c3-c654e0d04d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:09.536677 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57196566-2459-4826-b6c3-c654e0d04d22 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:09.536959 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57196566-2459-4826-b6c3-c654e0d04d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:09.537232 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57196566-2459-4826-b6c3-c654e0d04d22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:09.544203 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57196566-2459-4826-b6c3-c654e0d04d22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:09.545629 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57196566-2459-4826-b6c3-c654e0d04d22 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:09.560271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-57196566-2459-4826-b6c3-c654e0d04d22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:03:09.560271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:09.560271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:09.560271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:09.560271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:09.560271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:09.560271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:09.560271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:09.560271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:09.560271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:09.560271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:09.560271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:09.560271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:03:09.560271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:03:09.560271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:03:09.561364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:03:09.561364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:09.561364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:09.561364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:09.561364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:09.561364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:09.561364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:09.561364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:09.561364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:03:09.561364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:09.561364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:09.561364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:09.561364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:09.561364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:09.561364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:09.561364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:09.561364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:09.562284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:03:09.562284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:03:09.562284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:03:09.562284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:03:09.562284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:03:09.562284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:03:09.562284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:03:09.562284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:03:09.562284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 552/1104] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:03:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:03:09.567851 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70b6e9-e930-4ce1-a1e7-a53afb0e9dd3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:09.661888 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70b6e9-e930-4ce1-a1e7-a53afb0e9dd3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:09.695098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99536217-4653-4c39-ab17-f9792a437712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:09.695757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99536217-4653-4c39-ab17-f9792a437712 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:09.696040 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99536217-4653-4c39-ab17-f9792a437712 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:09.696373 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99536217-4653-4c39-ab17-f9792a437712 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:09.697158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99536217-4653-4c39-ab17-f9792a437712 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:09.697471 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99536217-4653-4c39-ab17-f9792a437712 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:09.698941 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99536217-4653-4c39-ab17-f9792a437712 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:09.710474 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 553/1105] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:03:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:09.716339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57196566-2459-4826-b6c3-c654e0d04d22 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:09.812049 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57196566-2459-4826-b6c3-c654e0d04d22 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:09.845229 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3582bcf-925c-4f1d-8fef-cf6353c80db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:09.845886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3582bcf-925c-4f1d-8fef-cf6353c80db4 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:09.846169 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3582bcf-925c-4f1d-8fef-cf6353c80db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:09.846465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3582bcf-925c-4f1d-8fef-cf6353c80db4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:09.847329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3582bcf-925c-4f1d-8fef-cf6353c80db4 None admin] RBAC: Adding query filter params (role.id=be44cff8846d48519c82b28f7c2d2c90, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=c4c16a3b07c64a22bfc3df2a5a90c3f3) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:09.847661 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3582bcf-925c-4f1d-8fef-cf6353c80db4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:09.849059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3582bcf-925c-4f1d-8fef-cf6353c80db4 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:09.855551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 553/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:03:09 2022] GET /identity/v3/role_assignments?user.id=c4c16a3b07c64a22bfc3df2a5a90c3f3&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=be44cff8846d48519c82b28f7c2d2c90 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:11.297426 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e87020-cd2e-4288-938b-b8c6d5f96398 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:11.297978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e87020-cd2e-4288-938b-b8c6d5f96398 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:11.297978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e87020-cd2e-4288-938b-b8c6d5f96398 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:11.299368 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 554/1107] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:11.305235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccbd1e-d5b9-462b-90b2-c53f82b94bbb None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:11.305658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccbd1e-d5b9-462b-90b2-c53f82b94bbb None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:11.305790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccbd1e-d5b9-462b-90b2-c53f82b94bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:11.322879 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-53ccbd1e-d5b9-462b-90b2-c53f82b94bbb None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:11.324052 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-53ccbd1e-d5b9-462b-90b2-c53f82b94bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:11.388438 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 554/1108] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:03:11.413521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e87020-cd2e-4288-938b-b8c6d5f96398 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:11.508808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e87020-cd2e-4288-938b-b8c6d5f96398 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:11.542201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d3be4-d000-4b76-8360-852f32c0fca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:11.543261 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d3be4-d000-4b76-8360-852f32c0fca7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:11.543544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d3be4-d000-4b76-8360-852f32c0fca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:11.543819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d3be4-d000-4b76-8360-852f32c0fca7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:11.544997 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d3be4-d000-4b76-8360-852f32c0fca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:11.546468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d3be4-d000-4b76-8360-852f32c0fca7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:11.548112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 555/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:03:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:11.554557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccbd1e-d5b9-462b-90b2-c53f82b94bbb None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:11.649381 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccbd1e-d5b9-462b-90b2-c53f82b94bbb None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:11.682567 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb271b-6938-4989-a865-eb57015c5f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:11.683228 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb271b-6938-4989-a865-eb57015c5f4b None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:11.683514 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb271b-6938-4989-a865-eb57015c5f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:11.683793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb271b-6938-4989-a865-eb57015c5f4b None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:11.684495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb271b-6938-4989-a865-eb57015c5f4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:11.685907 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb271b-6938-4989-a865-eb57015c5f4b None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:11.771615 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 555/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 10 21:03:11 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:03:14.011733 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8635216-b093-4b18-a268-4b52e27202c0 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:14.012259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8635216-b093-4b18-a268-4b52e27202c0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:14.012368 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8635216-b093-4b18-a268-4b52e27202c0 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:14.013641 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 556/1111] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:14.018726 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f8f77-9f9e-4f36-af0a-f8fb5c745e8b None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:14.019672 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f8f77-9f9e-4f36-af0a-f8fb5c745e8b None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:14.019881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f8f77-9f9e-4f36-af0a-f8fb5c745e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:14.036634 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-999f8f77-9f9e-4f36-af0a-f8fb5c745e8b None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:14.037794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-999f8f77-9f9e-4f36-af0a-f8fb5c745e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:14.099888 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 556/1112] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:03:14.122329 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8635216-b093-4b18-a268-4b52e27202c0 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:14.216775 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8635216-b093-4b18-a268-4b52e27202c0 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:14.248590 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3e3db-4650-4c82-8a6c-a5fc6b03e696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:14.249436 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3e3db-4650-4c82-8a6c-a5fc6b03e696 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:14.249721 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3e3db-4650-4c82-8a6c-a5fc6b03e696 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:14.249996 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3e3db-4650-4c82-8a6c-a5fc6b03e696 None admin] PATH_INFO: `/v3/roles/c1ddef32606649809bb218b686f472c5` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:14.251478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3e3db-4650-4c82-8a6c-a5fc6b03e696 None admin] RBAC: Authorizing `identity:get_role(role_id=c1ddef32606649809bb218b686f472c5)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:14.252820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3e3db-4650-4c82-8a6c-a5fc6b03e696 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:14.254251 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 557/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:03:14 2022] GET /identity/v3/roles/c1ddef32606649809bb218b686f472c5 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:14.259889 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f8f77-9f9e-4f36-af0a-f8fb5c745e8b None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:14.351692 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f8f77-9f9e-4f36-af0a-f8fb5c745e8b None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:14.383349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c01f1a-b7b7-4707-83de-b91d9d7e4ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:14.388528 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c01f1a-b7b7-4707-83de-b91d9d7e4ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:14.388528 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c01f1a-b7b7-4707-83de-b91d9d7e4ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:14.388528 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c01f1a-b7b7-4707-83de-b91d9d7e4ee4 None admin] PATH_INFO: `/v3/users/27de1ad150d74ac5825c92deedb9fb75` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:14.397560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c01f1a-b7b7-4707-83de-b91d9d7e4ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=27de1ad150d74ac5825c92deedb9fb75)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:14.399014 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c01f1a-b7b7-4707-83de-b91d9d7e4ee4 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:14.400600 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 557/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:03:14 2022] GET /identity/v3/users/27de1ad150d74ac5825c92deedb9fb75 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:14.406209 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3e3db-4650-4c82-8a6c-a5fc6b03e696 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:14.499025 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3e3db-4650-4c82-8a6c-a5fc6b03e696 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:14.531247 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cbcc4-ca02-4deb-a73e-f817650bddef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:14.531887 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cbcc4-ca02-4deb-a73e-f817650bddef None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:14.532169 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cbcc4-ca02-4deb-a73e-f817650bddef None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:14.532447 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cbcc4-ca02-4deb-a73e-f817650bddef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:14.595314 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cbcc4-ca02-4deb-a73e-f817650bddef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:14.596734 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cbcc4-ca02-4deb-a73e-f817650bddef None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:14.718616 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 558/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:03:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 21:03:14.719320 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c01f1a-b7b7-4707-83de-b91d9d7e4ee4 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:14.805057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c01f1a-b7b7-4707-83de-b91d9d7e4ee4 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:14.836812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ba49b-a79c-4c37-859a-c703434b1823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:14.837681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ba49b-a79c-4c37-859a-c703434b1823 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:14.837967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ba49b-a79c-4c37-859a-c703434b1823 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:14.838250 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ba49b-a79c-4c37-859a-c703434b1823 None admin] PATH_INFO: `/v3/projects/cc45723e89f44a32af23bf4edbb33f45` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:14.839448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ba49b-a79c-4c37-859a-c703434b1823 None admin] RBAC: Authorizing `identity:get_project(project_id=cc45723e89f44a32af23bf4edbb33f45)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:14.840863 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ba49b-a79c-4c37-859a-c703434b1823 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:14.842695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 558/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:03:14 2022] GET /identity/v3/projects/cc45723e89f44a32af23bf4edbb33f45 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:14.848667 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cbcc4-ca02-4deb-a73e-f817650bddef None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:14.939897 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cbcc4-ca02-4deb-a73e-f817650bddef None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:14.971271 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17658214-821d-4706-9409-6eadb64d43a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:14.972008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17658214-821d-4706-9409-6eadb64d43a6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:14.972250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17658214-821d-4706-9409-6eadb64d43a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:14.972439 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17658214-821d-4706-9409-6eadb64d43a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:14.973256 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17658214-821d-4706-9409-6eadb64d43a6 None admin] RBAC: Adding query filter params (role.id=c1ddef32606649809bb218b686f472c5, scope.project.id=cc45723e89f44a32af23bf4edbb33f45, user.id=27de1ad150d74ac5825c92deedb9fb75) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:14.973561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17658214-821d-4706-9409-6eadb64d43a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:14.974994 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17658214-821d-4706-9409-6eadb64d43a6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:14.980111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 559/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:03:14 2022] GET /identity/v3/role_assignments?user.id=27de1ad150d74ac5825c92deedb9fb75&scope.project.id=cc45723e89f44a32af23bf4edbb33f45&role.id=c1ddef32606649809bb218b686f472c5 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:17.144058 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac5750-b9cb-49e3-a118-8163bf542949 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:17.144598 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac5750-b9cb-49e3-a118-8163bf542949 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:17.144699 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac5750-b9cb-49e3-a118-8163bf542949 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:17.146044 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 559/1118] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:17.151188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc8ee7-e3e0-4171-b9ed-4dfd59dee7dc None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:17.151579 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc8ee7-e3e0-4171-b9ed-4dfd59dee7dc None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:17.151755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc8ee7-e3e0-4171-b9ed-4dfd59dee7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:17.168618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-dffc8ee7-e3e0-4171-b9ed-4dfd59dee7dc None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:17.169808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-dffc8ee7-e3e0-4171-b9ed-4dfd59dee7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:17.233150 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 560/1119] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:03:17.257056 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac5750-b9cb-49e3-a118-8163bf542949 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:17.353464 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac5750-b9cb-49e3-a118-8163bf542949 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:17.386503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa062b-c6b7-47bf-a51e-00e156ad4141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:17.387337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa062b-c6b7-47bf-a51e-00e156ad4141 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:17.387620 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa062b-c6b7-47bf-a51e-00e156ad4141 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:17.387896 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa062b-c6b7-47bf-a51e-00e156ad4141 None admin] PATH_INFO: `/v3/roles/c1ddef32606649809bb218b686f472c5` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:17.389347 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa062b-c6b7-47bf-a51e-00e156ad4141 None admin] RBAC: Authorizing `identity:get_role(role_id=c1ddef32606649809bb218b686f472c5)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:17.390731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa062b-c6b7-47bf-a51e-00e156ad4141 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:17.392052 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 560/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:03:17 2022] GET /identity/v3/roles/c1ddef32606649809bb218b686f472c5 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:17.397675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc8ee7-e3e0-4171-b9ed-4dfd59dee7dc None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:17.491377 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc8ee7-e3e0-4171-b9ed-4dfd59dee7dc None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:17.522512 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92c29a-0313-4e60-8818-b4641cc5a667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:17.523374 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92c29a-0313-4e60-8818-b4641cc5a667 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:17.523659 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92c29a-0313-4e60-8818-b4641cc5a667 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:17.523936 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92c29a-0313-4e60-8818-b4641cc5a667 None admin] PATH_INFO: `/v3/users/27de1ad150d74ac5825c92deedb9fb75` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:17.525111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92c29a-0313-4e60-8818-b4641cc5a667 None admin] RBAC: Authorizing `identity:get_user(user_id=27de1ad150d74ac5825c92deedb9fb75)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:17.526561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92c29a-0313-4e60-8818-b4641cc5a667 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:17.528165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 561/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:03:17 2022] GET /identity/v3/users/27de1ad150d74ac5825c92deedb9fb75 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:17.533750 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa062b-c6b7-47bf-a51e-00e156ad4141 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:17.631733 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa062b-c6b7-47bf-a51e-00e156ad4141 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:17.663477 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9825e6-1cc7-477d-8516-695da6bc5855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:17.664254 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9825e6-1cc7-477d-8516-695da6bc5855 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:17.664537 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9825e6-1cc7-477d-8516-695da6bc5855 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:17.664810 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9825e6-1cc7-477d-8516-695da6bc5855 None admin] PATH_INFO: `/v3/projects/cc45723e89f44a32af23bf4edbb33f45` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:17.665971 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9825e6-1cc7-477d-8516-695da6bc5855 None admin] RBAC: Authorizing `identity:get_project(project_id=cc45723e89f44a32af23bf4edbb33f45)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:17.667665 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9825e6-1cc7-477d-8516-695da6bc5855 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:17.669302 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 561/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:03:17 2022] GET /identity/v3/projects/cc45723e89f44a32af23bf4edbb33f45 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:17.675739 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92c29a-0313-4e60-8818-b4641cc5a667 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:17.769858 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92c29a-0313-4e60-8818-b4641cc5a667 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:17.801594 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e9947-7293-4431-9e43-f735dbffe4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:17.802479 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e9947-7293-4431-9e43-f735dbffe4d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:17.802765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e9947-7293-4431-9e43-f735dbffe4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:17.803036 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e9947-7293-4431-9e43-f735dbffe4d7 None admin] PATH_INFO: `/v3/projects/cc45723e89f44a32af23bf4edbb33f45/users/27de1ad150d74ac5825c92deedb9fb75/roles/c1ddef32606649809bb218b686f472c5` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:17.805180 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e9947-7293-4431-9e43-f735dbffe4d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc45723e89f44a32af23bf4edbb33f45, user_id=27de1ad150d74ac5825c92deedb9fb75, role_id=c1ddef32606649809bb218b686f472c5)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:17.806606 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e9947-7293-4431-9e43-f735dbffe4d7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:17.920174 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 562/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:03:17 2022] PUT /identity/v3/projects/cc45723e89f44a32af23bf4edbb33f45/users/27de1ad150d74ac5825c92deedb9fb75/roles/c1ddef32606649809bb218b686f472c5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:03:20.120991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfb54b-4f9a-47d3-a073-cbc35906b1ea None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:20.121530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfb54b-4f9a-47d3-a073-cbc35906b1ea None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:20.121530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfb54b-4f9a-47d3-a073-cbc35906b1ea None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:20.122927 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 562/1124] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:20.128826 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56098040-c1cf-44cf-ac13-7de55e3281f2 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:20.129368 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56098040-c1cf-44cf-ac13-7de55e3281f2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:20.129490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56098040-c1cf-44cf-ac13-7de55e3281f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:20.145466 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-56098040-c1cf-44cf-ac13-7de55e3281f2 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:20.146683 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-56098040-c1cf-44cf-ac13-7de55e3281f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:20.209499 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 563/1125] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:03:20.232142 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfb54b-4f9a-47d3-a073-cbc35906b1ea None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:20.329534 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfb54b-4f9a-47d3-a073-cbc35906b1ea None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:20.360258 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e368f53-6a09-4fa5-9f1f-8f2c70b26a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:20.361097 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e368f53-6a09-4fa5-9f1f-8f2c70b26a06 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:20.361382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e368f53-6a09-4fa5-9f1f-8f2c70b26a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:20.361653 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e368f53-6a09-4fa5-9f1f-8f2c70b26a06 None admin] PATH_INFO: `/v3/roles/c1ddef32606649809bb218b686f472c5` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:20.363680 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e368f53-6a09-4fa5-9f1f-8f2c70b26a06 None admin] RBAC: Authorizing `identity:get_role(role_id=c1ddef32606649809bb218b686f472c5)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:20.365021 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e368f53-6a09-4fa5-9f1f-8f2c70b26a06 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:20.366338 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 563/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:03:20 2022] GET /identity/v3/roles/c1ddef32606649809bb218b686f472c5 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:20.371992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56098040-c1cf-44cf-ac13-7de55e3281f2 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:20.463686 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56098040-c1cf-44cf-ac13-7de55e3281f2 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:20.495462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66881be9-abd5-4956-9770-4fcbd82b326e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:20.496317 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66881be9-abd5-4956-9770-4fcbd82b326e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:20.496595 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66881be9-abd5-4956-9770-4fcbd82b326e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:20.496866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66881be9-abd5-4956-9770-4fcbd82b326e None admin] PATH_INFO: `/v3/users/27de1ad150d74ac5825c92deedb9fb75` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:20.498026 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66881be9-abd5-4956-9770-4fcbd82b326e None admin] RBAC: Authorizing `identity:get_user(user_id=27de1ad150d74ac5825c92deedb9fb75)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:20.499452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66881be9-abd5-4956-9770-4fcbd82b326e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:20.501047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 564/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:03:20 2022] GET /identity/v3/users/27de1ad150d74ac5825c92deedb9fb75 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:20.506662 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e368f53-6a09-4fa5-9f1f-8f2c70b26a06 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:20.599399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e368f53-6a09-4fa5-9f1f-8f2c70b26a06 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:20.630811 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edaf6a-49d1-473c-a466-ca65dafb4c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:20.631377 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edaf6a-49d1-473c-a466-ca65dafb4c91 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:20.631658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edaf6a-49d1-473c-a466-ca65dafb4c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:20.631930 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edaf6a-49d1-473c-a466-ca65dafb4c91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:20.693678 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edaf6a-49d1-473c-a466-ca65dafb4c91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:20.695139 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edaf6a-49d1-473c-a466-ca65dafb4c91 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:20.786790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 564/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:03:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 21:03:20.792883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66881be9-abd5-4956-9770-4fcbd82b326e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:20.887514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66881be9-abd5-4956-9770-4fcbd82b326e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:20.920573 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87a147-68f9-4c28-9015-0ca8d9f3e2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:20.921446 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87a147-68f9-4c28-9015-0ca8d9f3e2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:20.921732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87a147-68f9-4c28-9015-0ca8d9f3e2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:20.922006 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87a147-68f9-4c28-9015-0ca8d9f3e2e2 None admin] PATH_INFO: `/v3/projects/cc45723e89f44a32af23bf4edbb33f45` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:20.923193 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87a147-68f9-4c28-9015-0ca8d9f3e2e2 None admin] RBAC: Authorizing `identity:get_project(project_id=cc45723e89f44a32af23bf4edbb33f45)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:20.924625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87a147-68f9-4c28-9015-0ca8d9f3e2e2 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:20.926579 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 565/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:03:20 2022] GET /identity/v3/projects/cc45723e89f44a32af23bf4edbb33f45 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:20.932616 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edaf6a-49d1-473c-a466-ca65dafb4c91 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:21.024720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edaf6a-49d1-473c-a466-ca65dafb4c91 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:21.056930 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4aff76-0ed5-4303-8895-e4df1326c59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:21.057565 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aff76-0ed5-4303-8895-e4df1326c59c None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:21.057844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aff76-0ed5-4303-8895-e4df1326c59c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:21.058116 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aff76-0ed5-4303-8895-e4df1326c59c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:21.058980 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4aff76-0ed5-4303-8895-e4df1326c59c None admin] RBAC: Adding query filter params (role.id=c1ddef32606649809bb218b686f472c5, scope.project.id=cc45723e89f44a32af23bf4edbb33f45, user.id=27de1ad150d74ac5825c92deedb9fb75) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:21.059287 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4aff76-0ed5-4303-8895-e4df1326c59c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:21.060688 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4aff76-0ed5-4303-8895-e4df1326c59c None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:21.066290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 565/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:03:20 2022] GET /identity/v3/role_assignments?user.id=27de1ad150d74ac5825c92deedb9fb75&scope.project.id=cc45723e89f44a32af23bf4edbb33f45&role.id=c1ddef32606649809bb218b686f472c5 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:03:23.308212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c4d09-0313-452a-ad3a-3bfb7909f06d None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:23.308768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c4d09-0313-452a-ad3a-3bfb7909f06d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:23.308768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c4d09-0313-452a-ad3a-3bfb7909f06d None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:23.310118 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 566/1131] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:23.316068 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ca100-ab5c-454a-a2d9-6f05b58b89e1 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:23.316489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ca100-ab5c-454a-a2d9-6f05b58b89e1 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:23.316611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ca100-ab5c-454a-a2d9-6f05b58b89e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:23.333472 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-7e6ca100-ab5c-454a-a2d9-6f05b58b89e1 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:23.334677 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-7e6ca100-ab5c-454a-a2d9-6f05b58b89e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:23.397284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 566/1132] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:03:23.420599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c4d09-0313-452a-ad3a-3bfb7909f06d None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:23.515902 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c4d09-0313-452a-ad3a-3bfb7909f06d None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:23.547586 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d051d8-27e8-4969-ad93-176827294f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:23.548361 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d051d8-27e8-4969-ad93-176827294f9c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:23.548646 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d051d8-27e8-4969-ad93-176827294f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:23.548917 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d051d8-27e8-4969-ad93-176827294f9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:23.550675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d051d8-27e8-4969-ad93-176827294f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:23.552085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d051d8-27e8-4969-ad93-176827294f9c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:23.553656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 567/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:03:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:23.559390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ca100-ab5c-454a-a2d9-6f05b58b89e1 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:23.650746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ca100-ab5c-454a-a2d9-6f05b58b89e1 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:23.683159 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c75d1-721d-4f1e-b4ed-8d03803bbe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:23.683799 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c75d1-721d-4f1e-b4ed-8d03803bbe5f None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:23.684083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c75d1-721d-4f1e-b4ed-8d03803bbe5f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:23.684358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c75d1-721d-4f1e-b4ed-8d03803bbe5f None admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:23.685063 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c75d1-721d-4f1e-b4ed-8d03803bbe5f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:23.686494 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c75d1-721d-4f1e-b4ed-8d03803bbe5f None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:23.782512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 567/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 10 21:03:23 2022] POST /identity/v3/projects => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:03:26.051932 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea908f-d9f4-4b1b-85e3-3425b7e82070 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:26.052495 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea908f-d9f4-4b1b-85e3-3425b7e82070 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:26.052495 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea908f-d9f4-4b1b-85e3-3425b7e82070 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:26.053859 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 568/1135] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:26.059155 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b4e5d-8463-44d9-bc8f-ac7ccddfd790 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:26.059555 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b4e5d-8463-44d9-bc8f-ac7ccddfd790 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:26.059717 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b4e5d-8463-44d9-bc8f-ac7ccddfd790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:26.076437 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-8e2b4e5d-8463-44d9-bc8f-ac7ccddfd790 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:26.077602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-8e2b4e5d-8463-44d9-bc8f-ac7ccddfd790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:26.139636 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 568/1136] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:03:26.164452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea908f-d9f4-4b1b-85e3-3425b7e82070 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:26.263103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea908f-d9f4-4b1b-85e3-3425b7e82070 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:26.295173 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab02057-b415-4d74-99ab-da249a7c91c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:26.295947 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab02057-b415-4d74-99ab-da249a7c91c6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:26.296232 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab02057-b415-4d74-99ab-da249a7c91c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:26.296506 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab02057-b415-4d74-99ab-da249a7c91c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:26.297662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab02057-b415-4d74-99ab-da249a7c91c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:26.299763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab02057-b415-4d74-99ab-da249a7c91c6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:26.301759 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 569/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:03:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:26.307347 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b4e5d-8463-44d9-bc8f-ac7ccddfd790 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:26.400651 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b4e5d-8463-44d9-bc8f-ac7ccddfd790 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:26.433921 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fe1e0-e81f-4a8b-b4d5-8b7f32edbc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:26.434623 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fe1e0-e81f-4a8b-b4d5-8b7f32edbc61 None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:26.434908 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fe1e0-e81f-4a8b-b4d5-8b7f32edbc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:26.438886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fe1e0-e81f-4a8b-b4d5-8b7f32edbc61 None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:26.438886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fe1e0-e81f-4a8b-b4d5-8b7f32edbc61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:26.438886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fe1e0-e81f-4a8b-b4d5-8b7f32edbc61 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:26.512879 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 569/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 10 21:03:26 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:03:28.743900 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec26619-37fd-42fc-9ac5-f4198f312dc5 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:28.744472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec26619-37fd-42fc-9ac5-f4198f312dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:28.744472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec26619-37fd-42fc-9ac5-f4198f312dc5 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:28.745873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 570/1139] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:28.751018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9d8a9-21c0-4511-a744-6b13dbc4d58b None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:28.751394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9d8a9-21c0-4511-a744-6b13dbc4d58b None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:28.751587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9d8a9-21c0-4511-a744-6b13dbc4d58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:28.769022 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-e2b9d8a9-21c0-4511-a744-6b13dbc4d58b None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:28.770195 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e2b9d8a9-21c0-4511-a744-6b13dbc4d58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:28.833279 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 570/1140] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:03:28.856333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec26619-37fd-42fc-9ac5-f4198f312dc5 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:28.950327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec26619-37fd-42fc-9ac5-f4198f312dc5 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:28.981585 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845468e-9779-4611-a582-cad7bab118b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:28.982361 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845468e-9779-4611-a582-cad7bab118b4 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:28.982674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845468e-9779-4611-a582-cad7bab118b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:28.982952 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845468e-9779-4611-a582-cad7bab118b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:28.992494 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845468e-9779-4611-a582-cad7bab118b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:03:29.000076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-f845468e-9779-4611-a582-cad7bab118b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:03:29.000076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:29.000076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:29.000076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:29.000076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:29.000076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:29.000076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:29.000076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:29.000076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:29.000076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:29.000076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:29.000076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:29.000076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:03:29.000076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:03:29.000076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:03:29.000076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:03:29.001207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:03:29.001207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:03:29.001207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:03:29.001207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:03:29.001207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:29.001207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:29.001207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:29.001207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:29.001207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:29.001207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:29.001207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:29.001207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:03:29.001207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:29.001207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:29.001207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:29.001207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:29.002883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:29.002883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:29.002883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:29.002883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:29.002883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:03:29.002883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:03:29.002883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:03:29.002883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:03:29.002883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:03:29.002883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:03:29.002883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:03:29.002883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:03:29.002883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 571/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:03:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:03:29.007725 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9d8a9-21c0-4511-a744-6b13dbc4d58b None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:29.101301 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9d8a9-21c0-4511-a744-6b13dbc4d58b None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:29.133629 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71755d8-3327-4156-9ec2-f0dd0e94cd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:29.134285 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71755d8-3327-4156-9ec2-f0dd0e94cd2b None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:29.134604 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71755d8-3327-4156-9ec2-f0dd0e94cd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:29.134875 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71755d8-3327-4156-9ec2-f0dd0e94cd2b None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:29.135617 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71755d8-3327-4156-9ec2-f0dd0e94cd2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:29.135923 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71755d8-3327-4156-9ec2-f0dd0e94cd2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:29.137274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71755d8-3327-4156-9ec2-f0dd0e94cd2b None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:29.144960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 571/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:03:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:29.150508 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845468e-9779-4611-a582-cad7bab118b4 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:29.243346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845468e-9779-4611-a582-cad7bab118b4 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:29.274671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7924efa-f9a0-4764-a383-e4067cb5821c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:29.275460 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7924efa-f9a0-4764-a383-e4067cb5821c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:29.275747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7924efa-f9a0-4764-a383-e4067cb5821c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:29.276023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7924efa-f9a0-4764-a383-e4067cb5821c None admin] PATH_INFO: `/v3/users/6d2abf887568433a88cddc033639d69c` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:29.288271 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7924efa-f9a0-4764-a383-e4067cb5821c None admin] RBAC: Authorizing `identity:get_user(user_id=6d2abf887568433a88cddc033639d69c)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:29.289684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7924efa-f9a0-4764-a383-e4067cb5821c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:29.291564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 572/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:03:29 2022] GET /identity/v3/users/6d2abf887568433a88cddc033639d69c => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:29.297132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71755d8-3327-4156-9ec2-f0dd0e94cd2b None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:29.393872 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71755d8-3327-4156-9ec2-f0dd0e94cd2b None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:29.426088 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7e8e5-251f-4d94-bd95-1f7e62e45366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:29.426770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7e8e5-251f-4d94-bd95-1f7e62e45366 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:29.427036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7e8e5-251f-4d94-bd95-1f7e62e45366 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:29.427308 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7e8e5-251f-4d94-bd95-1f7e62e45366 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:29.490320 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7e8e5-251f-4d94-bd95-1f7e62e45366 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:29.491764 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7e8e5-251f-4d94-bd95-1f7e62e45366 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:29.583902 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 572/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:03:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 21:03:29.589659 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7924efa-f9a0-4764-a383-e4067cb5821c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:29.683335 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7924efa-f9a0-4764-a383-e4067cb5821c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:29.714636 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed248893-40a0-429a-a656-9248070b5ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:29.715481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed248893-40a0-429a-a656-9248070b5ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:29.715764 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed248893-40a0-429a-a656-9248070b5ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:29.716039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed248893-40a0-429a-a656-9248070b5ff0 None admin] PATH_INFO: `/v3/projects/ada5b09736f9484eaa97fb2653529c3a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:29.717199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed248893-40a0-429a-a656-9248070b5ff0 None admin] RBAC: Authorizing `identity:get_project(project_id=ada5b09736f9484eaa97fb2653529c3a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:29.718629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed248893-40a0-429a-a656-9248070b5ff0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:29.720277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 573/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:03:29 2022] GET /identity/v3/projects/ada5b09736f9484eaa97fb2653529c3a => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:29.726829 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7e8e5-251f-4d94-bd95-1f7e62e45366 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:29.821125 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7e8e5-251f-4d94-bd95-1f7e62e45366 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:29.853807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ed301-01e3-40f3-8ebc-abcec5c2b2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:29.854479 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ed301-01e3-40f3-8ebc-abcec5c2b2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:29.854765 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ed301-01e3-40f3-8ebc-abcec5c2b2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:29.855094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ed301-01e3-40f3-8ebc-abcec5c2b2f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:29.855916 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ed301-01e3-40f3-8ebc-abcec5c2b2f5 None admin] RBAC: Adding query filter params (role.id=5cd001edc58744738aa57180c0be68a9, scope.project.id=ada5b09736f9484eaa97fb2653529c3a, user.id=6d2abf887568433a88cddc033639d69c) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:29.856222 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ed301-01e3-40f3-8ebc-abcec5c2b2f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:29.857639 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ed301-01e3-40f3-8ebc-abcec5c2b2f5 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:29.863078 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 573/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:03:29 2022] GET /identity/v3/role_assignments?user.id=6d2abf887568433a88cddc033639d69c&scope.project.id=ada5b09736f9484eaa97fb2653529c3a&role.id=5cd001edc58744738aa57180c0be68a9 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:32.048253 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56de13c-83df-4e6b-b74c-727af4f3a1d9 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:32.049301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56de13c-83df-4e6b-b74c-727af4f3a1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:32.049400 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56de13c-83df-4e6b-b74c-727af4f3a1d9 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:32.050805 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 574/1147] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:32.055956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773d67-e8b2-479b-8597-b205fccd1fbe None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:32.056378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773d67-e8b2-479b-8597-b205fccd1fbe None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:32.056515 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773d67-e8b2-479b-8597-b205fccd1fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:32.073312 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-24773d67-e8b2-479b-8597-b205fccd1fbe None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:32.074495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-24773d67-e8b2-479b-8597-b205fccd1fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:32.136846 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 574/1148] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:03:32.159103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56de13c-83df-4e6b-b74c-727af4f3a1d9 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:32.254754 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56de13c-83df-4e6b-b74c-727af4f3a1d9 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:32.285698 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c103be0-58f6-44ed-b866-37961841bbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:32.286490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c103be0-58f6-44ed-b866-37961841bbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:32.286777 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c103be0-58f6-44ed-b866-37961841bbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:32.287054 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c103be0-58f6-44ed-b866-37961841bbc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:32.296825 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c103be0-58f6-44ed-b866-37961841bbc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:03:32.304922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-5c103be0-58f6-44ed-b866-37961841bbc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:03:32.304922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:32.304922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:32.304922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:32.304922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:32.304922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:32.304922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:32.304922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:32.304922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:32.304922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:32.304922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:32.304922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:32.304922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:03:32.304922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:03:32.304922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:03:32.304922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:03:32.306039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:03:32.306039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:03:32.306039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:03:32.306039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:03:32.306039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:32.306039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:32.306039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:32.306039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:32.306039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:32.306039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:32.306039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:32.306039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:03:32.306039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:32.306039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:32.306039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:32.306039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:32.307127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:32.307127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:32.307127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:32.307127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:32.307127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:03:32.307127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:03:32.307127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:03:32.307127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:03:32.307127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:03:32.307127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:03:32.307127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:03:32.307127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:03:32.307127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 575/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:03:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:03:32.311888 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24773d67-e8b2-479b-8597-b205fccd1fbe None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:32.404262 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24773d67-e8b2-479b-8597-b205fccd1fbe None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:32.437018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8c9e7-c474-4f11-95ce-a5866fbbeb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:32.437666 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8c9e7-c474-4f11-95ce-a5866fbbeb8b None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:32.437949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8c9e7-c474-4f11-95ce-a5866fbbeb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:32.438222 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8c9e7-c474-4f11-95ce-a5866fbbeb8b None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:32.438985 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8c9e7-c474-4f11-95ce-a5866fbbeb8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:32.439287 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8c9e7-c474-4f11-95ce-a5866fbbeb8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:32.440741 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8c9e7-c474-4f11-95ce-a5866fbbeb8b None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:32.448269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 575/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:03:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:32.453934 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c103be0-58f6-44ed-b866-37961841bbc2 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:32.548460 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c103be0-58f6-44ed-b866-37961841bbc2 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:32.579907 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef6647-ad49-46ad-8fac-10ae97e3fa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:32.581176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef6647-ad49-46ad-8fac-10ae97e3fa13 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:32.581463 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef6647-ad49-46ad-8fac-10ae97e3fa13 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:32.581740 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef6647-ad49-46ad-8fac-10ae97e3fa13 None admin] PATH_INFO: `/v3/users/6d2abf887568433a88cddc033639d69c` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:32.582950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef6647-ad49-46ad-8fac-10ae97e3fa13 None admin] RBAC: Authorizing `identity:get_user(user_id=6d2abf887568433a88cddc033639d69c)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:32.584352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef6647-ad49-46ad-8fac-10ae97e3fa13 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:32.585955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 576/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:03:32 2022] GET /identity/v3/users/6d2abf887568433a88cddc033639d69c => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:32.591558 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8c9e7-c474-4f11-95ce-a5866fbbeb8b None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:32.687705 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8c9e7-c474-4f11-95ce-a5866fbbeb8b None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:32.718940 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db1e09-dd4e-4924-a612-4122bbb61ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:32.719779 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db1e09-dd4e-4924-a612-4122bbb61ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:32.720065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db1e09-dd4e-4924-a612-4122bbb61ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:32.720342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db1e09-dd4e-4924-a612-4122bbb61ce8 None admin] PATH_INFO: `/v3/projects/ada5b09736f9484eaa97fb2653529c3a` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:32.722054 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db1e09-dd4e-4924-a612-4122bbb61ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=ada5b09736f9484eaa97fb2653529c3a)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:32.723488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db1e09-dd4e-4924-a612-4122bbb61ce8 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:32.725129 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 576/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:03:32 2022] GET /identity/v3/projects/ada5b09736f9484eaa97fb2653529c3a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:32.730744 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef6647-ad49-46ad-8fac-10ae97e3fa13 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:32.832119 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef6647-ad49-46ad-8fac-10ae97e3fa13 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:32.863686 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9ad4a-96e3-4e27-bdf3-5272a150e6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:32.864557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9ad4a-96e3-4e27-bdf3-5272a150e6ee None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:32.864833 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9ad4a-96e3-4e27-bdf3-5272a150e6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:32.865125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9ad4a-96e3-4e27-bdf3-5272a150e6ee None admin] PATH_INFO: `/v3/projects/ada5b09736f9484eaa97fb2653529c3a/users/6d2abf887568433a88cddc033639d69c/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:32.867057 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9ad4a-96e3-4e27-bdf3-5272a150e6ee None admin] RBAC: Authorizing `identity:create_grant(project_id=ada5b09736f9484eaa97fb2653529c3a, user_id=6d2abf887568433a88cddc033639d69c, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:32.868454 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9ad4a-96e3-4e27-bdf3-5272a150e6ee None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:32.941357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 577/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:03:32 2022] PUT /identity/v3/projects/ada5b09736f9484eaa97fb2653529c3a/users/6d2abf887568433a88cddc033639d69c/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:03:35.121727 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96de623-c1be-4e8c-aaec-c7f3fb8a93a2 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:35.122292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96de623-c1be-4e8c-aaec-c7f3fb8a93a2 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:35.122292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96de623-c1be-4e8c-aaec-c7f3fb8a93a2 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:35.123645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 577/1154] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:35.128799 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee82f8-e154-4454-b748-5934bae50fb9 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:35.129174 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee82f8-e154-4454-b748-5934bae50fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:35.129350 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee82f8-e154-4454-b748-5934bae50fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:35.146128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-21ee82f8-e154-4454-b748-5934bae50fb9 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:35.147315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-21ee82f8-e154-4454-b748-5934bae50fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:35.209573 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 578/1155] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:03:35.232549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96de623-c1be-4e8c-aaec-c7f3fb8a93a2 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:35.326821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96de623-c1be-4e8c-aaec-c7f3fb8a93a2 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:35.359145 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936b2ab-25f2-4581-b748-5cd7c1cb9ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:35.359909 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936b2ab-25f2-4581-b748-5cd7c1cb9ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:35.360189 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936b2ab-25f2-4581-b748-5cd7c1cb9ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:35.360458 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936b2ab-25f2-4581-b748-5cd7c1cb9ea7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:35.370525 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936b2ab-25f2-4581-b748-5cd7c1cb9ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:03:35.378771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-3936b2ab-25f2-4581-b748-5cd7c1cb9ea7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:03:35.378771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:35.378771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:35.378771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:35.378771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:35.378771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:35.378771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:35.378771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:35.378771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:35.378771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:35.378771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:35.378771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:35.378771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:03:35.378771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:03:35.378771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:03:35.378771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:03:35.379922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:03:35.379922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:03:35.379922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:03:35.379922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:03:35.379922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:35.379922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:35.379922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:35.379922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:35.379922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:35.379922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:35.379922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:35.379922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:03:35.379922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:35.379922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:35.379922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:35.379922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:35.380793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:35.380793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:35.380793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:35.380793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:35.380793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:03:35.380793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:03:35.380793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:03:35.380793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:03:35.380793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:03:35.380793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:03:35.380793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:03:35.380793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:03:35.380793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 578/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:03:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:03:35.385729 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee82f8-e154-4454-b748-5934bae50fb9 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:35.478837 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee82f8-e154-4454-b748-5934bae50fb9 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:35.510138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1862e-8abe-425c-b6a5-578470fe21e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:35.510824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1862e-8abe-425c-b6a5-578470fe21e8 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:35.511114 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1862e-8abe-425c-b6a5-578470fe21e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:35.511394 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1862e-8abe-425c-b6a5-578470fe21e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:35.512143 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1862e-8abe-425c-b6a5-578470fe21e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:35.512450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1862e-8abe-425c-b6a5-578470fe21e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:35.513796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1862e-8abe-425c-b6a5-578470fe21e8 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:35.521983 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 579/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:03:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:35.527639 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936b2ab-25f2-4581-b748-5cd7c1cb9ea7 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:35.621276 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936b2ab-25f2-4581-b748-5cd7c1cb9ea7 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:35.653508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c44179-5edb-449b-af7d-ba1215be1aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:35.654309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c44179-5edb-449b-af7d-ba1215be1aaa None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:35.654620 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c44179-5edb-449b-af7d-ba1215be1aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:35.654898 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c44179-5edb-449b-af7d-ba1215be1aaa None admin] PATH_INFO: `/v3/users/6d2abf887568433a88cddc033639d69c` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:35.656201 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c44179-5edb-449b-af7d-ba1215be1aaa None admin] RBAC: Authorizing `identity:get_user(user_id=6d2abf887568433a88cddc033639d69c)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:35.657553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c44179-5edb-449b-af7d-ba1215be1aaa None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:35.659217 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 579/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:03:35 2022] GET /identity/v3/users/6d2abf887568433a88cddc033639d69c => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:35.664845 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1862e-8abe-425c-b6a5-578470fe21e8 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:35.758800 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1862e-8abe-425c-b6a5-578470fe21e8 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:35.790133 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ed1d0-ae3e-4b92-9492-94954f10bff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:35.791040 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ed1d0-ae3e-4b92-9492-94954f10bff3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:35.791334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ed1d0-ae3e-4b92-9492-94954f10bff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:35.791614 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ed1d0-ae3e-4b92-9492-94954f10bff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:35.854595 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ed1d0-ae3e-4b92-9492-94954f10bff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:35.856028 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ed1d0-ae3e-4b92-9492-94954f10bff3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:35.948216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 580/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:03:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 21:03:35.954027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c44179-5edb-449b-af7d-ba1215be1aaa None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:36.046611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c44179-5edb-449b-af7d-ba1215be1aaa None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:36.078229 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f80aa3-6657-4d40-b380-22863be3d94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:36.079098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f80aa3-6657-4d40-b380-22863be3d94e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:36.079379 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f80aa3-6657-4d40-b380-22863be3d94e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:36.079652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f80aa3-6657-4d40-b380-22863be3d94e None admin] PATH_INFO: `/v3/projects/ada5b09736f9484eaa97fb2653529c3a` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:36.080856 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f80aa3-6657-4d40-b380-22863be3d94e None admin] RBAC: Authorizing `identity:get_project(project_id=ada5b09736f9484eaa97fb2653529c3a)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:36.082256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f80aa3-6657-4d40-b380-22863be3d94e None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:36.083903 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 580/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:03:35 2022] GET /identity/v3/projects/ada5b09736f9484eaa97fb2653529c3a => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:36.089792 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ed1d0-ae3e-4b92-9492-94954f10bff3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:36.182644 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ed1d0-ae3e-4b92-9492-94954f10bff3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:36.213763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc25b48-deed-449f-921a-12400cf373c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:36.214343 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc25b48-deed-449f-921a-12400cf373c4 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:36.214655 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc25b48-deed-449f-921a-12400cf373c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:36.214933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc25b48-deed-449f-921a-12400cf373c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:36.215758 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc25b48-deed-449f-921a-12400cf373c4 None admin] RBAC: Adding query filter params (role.id=5cd001edc58744738aa57180c0be68a9, scope.project.id=ada5b09736f9484eaa97fb2653529c3a, user.id=6d2abf887568433a88cddc033639d69c) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:36.216067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc25b48-deed-449f-921a-12400cf373c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:36.217482 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc25b48-deed-449f-921a-12400cf373c4 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:36.223617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 581/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:03:36 2022] GET /identity/v3/role_assignments?user.id=6d2abf887568433a88cddc033639d69c&scope.project.id=ada5b09736f9484eaa97fb2653529c3a&role.id=5cd001edc58744738aa57180c0be68a9 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:38.574797 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada00e9-3ec3-45cc-8a25-0dcc5ada9e03 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:38.575362 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada00e9-3ec3-45cc-8a25-0dcc5ada9e03 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:38.575362 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada00e9-3ec3-45cc-8a25-0dcc5ada9e03 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:38.576687 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 581/1162] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:38.582226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5f37c-cf53-45b8-8c7e-824129ec8fe6 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:38.582679 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5f37c-cf53-45b8-8c7e-824129ec8fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:38.582885 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5f37c-cf53-45b8-8c7e-824129ec8fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:38.599606 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-50f5f37c-cf53-45b8-8c7e-824129ec8fe6 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:38.600819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-50f5f37c-cf53-45b8-8c7e-824129ec8fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:38.663339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 582/1163] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:03:38.685827 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada00e9-3ec3-45cc-8a25-0dcc5ada9e03 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:38.782296 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada00e9-3ec3-45cc-8a25-0dcc5ada9e03 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:38.815166 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753d6a8-53c6-4441-826b-f21141ad3aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:38.815794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753d6a8-53c6-4441-826b-f21141ad3aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:38.816080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753d6a8-53c6-4441-826b-f21141ad3aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:38.816356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753d6a8-53c6-4441-826b-f21141ad3aa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:38.880192 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753d6a8-53c6-4441-826b-f21141ad3aa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:38.881642 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753d6a8-53c6-4441-826b-f21141ad3aa1 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:38.977498 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 582/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:03:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 21:03:38.983575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5f37c-cf53-45b8-8c7e-824129ec8fe6 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:39.076382 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5f37c-cf53-45b8-8c7e-824129ec8fe6 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:39.108787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907d4e8-95a8-4bd5-b683-02903f9c9e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:39.109575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907d4e8-95a8-4bd5-b683-02903f9c9e54 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:39.109859 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907d4e8-95a8-4bd5-b683-02903f9c9e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:39.110137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907d4e8-95a8-4bd5-b683-02903f9c9e54 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:39.116596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907d4e8-95a8-4bd5-b683-02903f9c9e54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:39.118011 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907d4e8-95a8-4bd5-b683-02903f9c9e54 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:39.132484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-2907d4e8-95a8-4bd5-b683-02903f9c9e54 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 21:03:39.132484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:39.132484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 10 21:03:39.132484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 10 21:03:39.132484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:03:39.132484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:03:39.132484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:03:39.132484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:03:39.132484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 10 21:03:39.132484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:03:39.132484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:03:39.132484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:03:39.132484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:39.132484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:39.132484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:39.132484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:39.132484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:39.133735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:39.133735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:39.133735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:39.133735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:39.133735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:39.133735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:39.133735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:03:39.133735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:03:39.133735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:03:39.133735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:03:39.133735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:39.133735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:39.133735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:39.133735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:39.133735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:39.133735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:39.135067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:39.135067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:03:39.135067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:39.135067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:39.135067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:39.135067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:39.135067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:39.135067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:39.135067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:39.135067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:39.135067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 10 21:03:39.135067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:03:39.135067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 21:03:39.135067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:03:39.135067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 583/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Tue May 10 21:03:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:03:39.139439 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753d6a8-53c6-4441-826b-f21141ad3aa1 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:39.232851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753d6a8-53c6-4441-826b-f21141ad3aa1 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:39.265456 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3844cd-3a88-4765-a39a-2c682408cbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:39.266105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3844cd-3a88-4765-a39a-2c682408cbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:39.266390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3844cd-3a88-4765-a39a-2c682408cbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:39.266696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3844cd-3a88-4765-a39a-2c682408cbf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:39.268057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3844cd-3a88-4765-a39a-2c682408cbf6 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:39.268364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3844cd-3a88-4765-a39a-2c682408cbf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:39.269746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3844cd-3a88-4765-a39a-2c682408cbf6 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:39.276631 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 583/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Tue May 10 21:03:39 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:41.461028 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e630d-9c9d-40dc-90c7-ff3e3f847bc0 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:41.461599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e630d-9c9d-40dc-90c7-ff3e3f847bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:41.461599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e630d-9c9d-40dc-90c7-ff3e3f847bc0 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:41.462984 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 584/1167] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:41.468135 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f8df4-8544-48ba-a23a-be6dc1c3abdf None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:41.468565 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f8df4-8544-48ba-a23a-be6dc1c3abdf None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:41.468698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f8df4-8544-48ba-a23a-be6dc1c3abdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:41.484861 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-8e9f8df4-8544-48ba-a23a-be6dc1c3abdf None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:41.486048 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-8e9f8df4-8544-48ba-a23a-be6dc1c3abdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:41.547945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 584/1168] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:03:41.570633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e630d-9c9d-40dc-90c7-ff3e3f847bc0 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:41.666464 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e630d-9c9d-40dc-90c7-ff3e3f847bc0 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:41.697980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11470634-bef3-479c-b499-bc8ee99061f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:41.698646 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11470634-bef3-479c-b499-bc8ee99061f7 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:41.698933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11470634-bef3-479c-b499-bc8ee99061f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:41.699212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11470634-bef3-479c-b499-bc8ee99061f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:41.699949 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11470634-bef3-479c-b499-bc8ee99061f7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:41.701297 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11470634-bef3-479c-b499-bc8ee99061f7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:41.765057 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 585/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Tue May 10 21:03:41 2022] POST /identity/v3/domains => generated 267 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:03:44.011644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c569-17c7-4230-a55d-7fb8c270f79f None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:44.012189 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c569-17c7-4230-a55d-7fb8c270f79f None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:44.012189 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c569-17c7-4230-a55d-7fb8c270f79f None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:44.013547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 585/1170] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:44.019252 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a75cb-dc2c-4f5d-9d4f-3bea00c9a2f8 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:44.019682 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a75cb-dc2c-4f5d-9d4f-3bea00c9a2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:44.019825 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a75cb-dc2c-4f5d-9d4f-3bea00c9a2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:44.036467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-1d4a75cb-dc2c-4f5d-9d4f-3bea00c9a2f8 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:44.037643 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1d4a75cb-dc2c-4f5d-9d4f-3bea00c9a2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:44.100785 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 586/1171] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:03:44.123946 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5c569-17c7-4230-a55d-7fb8c270f79f None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:44.219252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5c569-17c7-4230-a55d-7fb8c270f79f None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:44.251285 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6f09c-04bb-4568-9105-b4a41613c45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:44.252132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6f09c-04bb-4568-9105-b4a41613c45e None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:44.252413 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6f09c-04bb-4568-9105-b4a41613c45e None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:44.252689 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6f09c-04bb-4568-9105-b4a41613c45e None admin] PATH_INFO: `/v3/domains/9d9159dde31941c5b79fd0d1d756e0e8` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:44.262553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6f09c-04bb-4568-9105-b4a41613c45e None admin] RBAC: Authorizing `identity:get_domain(domain_id=9d9159dde31941c5b79fd0d1d756e0e8)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:44.263987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6f09c-04bb-4568-9105-b4a41613c45e None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:44.265607 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 586/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Tue May 10 21:03:44 2022] GET /identity/v3/domains/9d9159dde31941c5b79fd0d1d756e0e8 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:44.271793 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a75cb-dc2c-4f5d-9d4f-3bea00c9a2f8 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:44.365524 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a75cb-dc2c-4f5d-9d4f-3bea00c9a2f8 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:44.398524 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6c00b-0984-40fd-aa43-2c37b1364a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:44.399174 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6c00b-0984-40fd-aa43-2c37b1364a17 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:44.399461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6c00b-0984-40fd-aa43-2c37b1364a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:44.399739 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6c00b-0984-40fd-aa43-2c37b1364a17 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:44.400457 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6c00b-0984-40fd-aa43-2c37b1364a17 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:44.401859 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6c00b-0984-40fd-aa43-2c37b1364a17 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:44.501633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 587/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 10 21:03:44 2022] POST /identity/v3/projects => generated 361 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:03:46.744539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd7ee8-e3a3-414e-9301-7a5cebac8743 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:46.745101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd7ee8-e3a3-414e-9301-7a5cebac8743 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:46.745101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd7ee8-e3a3-414e-9301-7a5cebac8743 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:46.746464 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 587/1174] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:46.751730 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e0a91-91f1-4222-b5c2-bd204e173fb6 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:46.752168 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e0a91-91f1-4222-b5c2-bd204e173fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:46.752317 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e0a91-91f1-4222-b5c2-bd204e173fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:46.768957 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-054e0a91-91f1-4222-b5c2-bd204e173fb6 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:46.770127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-054e0a91-91f1-4222-b5c2-bd204e173fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:46.834870 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 588/1175] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:03:46.860197 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd7ee8-e3a3-414e-9301-7a5cebac8743 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:46.957111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd7ee8-e3a3-414e-9301-7a5cebac8743 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:46.989584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621b13a-516c-42e0-8004-9dcd67829107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:46.990430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621b13a-516c-42e0-8004-9dcd67829107 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:46.990743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621b13a-516c-42e0-8004-9dcd67829107 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:46.991019 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621b13a-516c-42e0-8004-9dcd67829107 None admin] PATH_INFO: `/v3/domains/9d9159dde31941c5b79fd0d1d756e0e8` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:46.992184 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621b13a-516c-42e0-8004-9dcd67829107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9d9159dde31941c5b79fd0d1d756e0e8)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:46.993604 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621b13a-516c-42e0-8004-9dcd67829107 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:46.995245 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 588/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Tue May 10 21:03:46 2022] GET /identity/v3/domains/9d9159dde31941c5b79fd0d1d756e0e8 => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:47.000969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e0a91-91f1-4222-b5c2-bd204e173fb6 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:47.093428 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e0a91-91f1-4222-b5c2-bd204e173fb6 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:47.124823 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85804b3f-1946-4993-8cae-e49b47c1e174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:47.125471 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85804b3f-1946-4993-8cae-e49b47c1e174 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:47.125755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85804b3f-1946-4993-8cae-e49b47c1e174 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:47.126031 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85804b3f-1946-4993-8cae-e49b47c1e174 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:47.126759 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85804b3f-1946-4993-8cae-e49b47c1e174 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:47.128158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85804b3f-1946-4993-8cae-e49b47c1e174 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:47.209049 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 589/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 10 21:03:46 2022] POST /identity/v3/users => generated 311 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:03:49.462600 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59088652-5850-4449-a147-bb85aa3e3708 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:49.463139 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59088652-5850-4449-a147-bb85aa3e3708 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:49.463139 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59088652-5850-4449-a147-bb85aa3e3708 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:49.464499 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 589/1178] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:49.469664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91a4c9-9247-4923-b3be-585a54be1ad7 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:49.470192 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91a4c9-9247-4923-b3be-585a54be1ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:49.470712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91a4c9-9247-4923-b3be-585a54be1ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:49.487773 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-0a91a4c9-9247-4923-b3be-585a54be1ad7 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:49.488939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0a91a4c9-9247-4923-b3be-585a54be1ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:49.551825 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 590/1179] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:03:49.574771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59088652-5850-4449-a147-bb85aa3e3708 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:49.669980 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59088652-5850-4449-a147-bb85aa3e3708 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:49.702124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83c4fd-0490-4ee9-8c48-9e6f00fbce03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:49.702915 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83c4fd-0490-4ee9-8c48-9e6f00fbce03 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:49.703194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83c4fd-0490-4ee9-8c48-9e6f00fbce03 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:49.703463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83c4fd-0490-4ee9-8c48-9e6f00fbce03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:49.712987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83c4fd-0490-4ee9-8c48-9e6f00fbce03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:03:49.720911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-4f83c4fd-0490-4ee9-8c48-9e6f00fbce03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:03:49.720911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:49.720911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:49.720911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:49.720911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:49.720911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:49.720911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:49.720911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:49.720911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:49.720911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:49.720911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:49.720911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:49.720911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:03:49.720911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:03:49.720911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:03:49.720911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:03:49.722018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:03:49.722018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:03:49.722018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:03:49.722018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:03:49.722018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:49.722018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:49.722018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:49.722018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:49.722018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:49.722018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:49.722018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:49.722018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:03:49.722018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:49.722018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:49.722018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:49.722018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:49.723083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:49.723083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:49.723083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:49.723083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:49.723083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:03:49.723083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:03:49.723083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:03:49.723083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:03:49.723083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:03:49.723083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:03:49.723083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:03:49.723083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:03:49.723083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 590/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:03:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:03:49.728073 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91a4c9-9247-4923-b3be-585a54be1ad7 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:49.820936 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91a4c9-9247-4923-b3be-585a54be1ad7 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:49.853294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd494d-54f2-4126-9b37-f96762ee96fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:49.853961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd494d-54f2-4126-9b37-f96762ee96fd None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:49.854246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd494d-54f2-4126-9b37-f96762ee96fd None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:49.854557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd494d-54f2-4126-9b37-f96762ee96fd None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:49.855307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd494d-54f2-4126-9b37-f96762ee96fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:49.855615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd494d-54f2-4126-9b37-f96762ee96fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:49.856960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd494d-54f2-4126-9b37-f96762ee96fd None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:49.865358 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 591/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:03:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:49.871148 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83c4fd-0490-4ee9-8c48-9e6f00fbce03 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:49.965254 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83c4fd-0490-4ee9-8c48-9e6f00fbce03 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:49.996800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86dfb3-0bbb-477b-b1aa-0f8a1e12e3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:49.997642 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86dfb3-0bbb-477b-b1aa-0f8a1e12e3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:49.997921 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86dfb3-0bbb-477b-b1aa-0f8a1e12e3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:49.998194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86dfb3-0bbb-477b-b1aa-0f8a1e12e3f4 None admin] PATH_INFO: `/v3/users/80fb91c0b13e43168c28c7105b5d8fa1` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:50.010314 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86dfb3-0bbb-477b-b1aa-0f8a1e12e3f4 None admin] RBAC: Authorizing `identity:get_user(user_id=80fb91c0b13e43168c28c7105b5d8fa1)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:50.011919 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86dfb3-0bbb-477b-b1aa-0f8a1e12e3f4 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:50.013497 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 591/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:03:49 2022] GET /identity/v3/users/80fb91c0b13e43168c28c7105b5d8fa1 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:50.019704 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd494d-54f2-4126-9b37-f96762ee96fd None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:50.112595 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd494d-54f2-4126-9b37-f96762ee96fd None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:50.143601 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dee917-6e36-4cc8-a827-709d6e6849b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:50.144230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dee917-6e36-4cc8-a827-709d6e6849b9 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:50.144516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dee917-6e36-4cc8-a827-709d6e6849b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:50.144796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dee917-6e36-4cc8-a827-709d6e6849b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:50.210753 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dee917-6e36-4cc8-a827-709d6e6849b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:50.212184 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dee917-6e36-4cc8-a827-709d6e6849b9 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:50.303369 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 592/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:03:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 21:03:50.309849 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86dfb3-0bbb-477b-b1aa-0f8a1e12e3f4 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:50.402320 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86dfb3-0bbb-477b-b1aa-0f8a1e12e3f4 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:50.433934 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed3d89-0a0c-45c6-bcce-b4c97d0146e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:50.434801 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed3d89-0a0c-45c6-bcce-b4c97d0146e2 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:50.435083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed3d89-0a0c-45c6-bcce-b4c97d0146e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:50.435356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed3d89-0a0c-45c6-bcce-b4c97d0146e2 None admin] PATH_INFO: `/v3/projects/e200a0d0bf2241e680e3a2c32f97f831` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:50.436511 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed3d89-0a0c-45c6-bcce-b4c97d0146e2 None admin] RBAC: Authorizing `identity:get_project(project_id=e200a0d0bf2241e680e3a2c32f97f831)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:50.437912 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed3d89-0a0c-45c6-bcce-b4c97d0146e2 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:50.440204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 592/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:03:50 2022] GET /identity/v3/projects/e200a0d0bf2241e680e3a2c32f97f831 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:50.446106 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dee917-6e36-4cc8-a827-709d6e6849b9 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:50.536865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dee917-6e36-4cc8-a827-709d6e6849b9 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:50.568510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4d480-6b19-4822-93b2-95ccbb04591f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:50.569088 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4d480-6b19-4822-93b2-95ccbb04591f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:50.569373 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4d480-6b19-4822-93b2-95ccbb04591f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:50.569650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4d480-6b19-4822-93b2-95ccbb04591f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:50.570495 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4d480-6b19-4822-93b2-95ccbb04591f None admin] RBAC: Adding query filter params (role.id=5cd001edc58744738aa57180c0be68a9, scope.project.id=e200a0d0bf2241e680e3a2c32f97f831, user.id=80fb91c0b13e43168c28c7105b5d8fa1) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:50.570808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4d480-6b19-4822-93b2-95ccbb04591f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:50.572214 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4d480-6b19-4822-93b2-95ccbb04591f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:50.577380 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 593/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:03:50 2022] GET /identity/v3/role_assignments?user.id=80fb91c0b13e43168c28c7105b5d8fa1&scope.project.id=e200a0d0bf2241e680e3a2c32f97f831&role.id=5cd001edc58744738aa57180c0be68a9 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:52.744722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e388f-6ec0-4395-a35b-c5fae8170ef3 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:52.745276 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e388f-6ec0-4395-a35b-c5fae8170ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:52.745276 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e388f-6ec0-4395-a35b-c5fae8170ef3 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:52.746634 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 593/1186] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:52.751751 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42270c-f3fe-4cf6-ad22-c99bf212994c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:52.752148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42270c-f3fe-4cf6-ad22-c99bf212994c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:52.752309 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42270c-f3fe-4cf6-ad22-c99bf212994c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:52.768293 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-fc42270c-f3fe-4cf6-ad22-c99bf212994c None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:52.769474 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fc42270c-f3fe-4cf6-ad22-c99bf212994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:52.832988 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 594/1187] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:03:52.855706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e388f-6ec0-4395-a35b-c5fae8170ef3 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:52.952401 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e388f-6ec0-4395-a35b-c5fae8170ef3 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:52.984800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731e75e-bc9a-47ed-9ecb-04bc41ea2d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:52.985658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731e75e-bc9a-47ed-9ecb-04bc41ea2d8b None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:52.985938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731e75e-bc9a-47ed-9ecb-04bc41ea2d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:52.986207 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731e75e-bc9a-47ed-9ecb-04bc41ea2d8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:52.995759 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731e75e-bc9a-47ed-9ecb-04bc41ea2d8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:03:53.003945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-6731e75e-bc9a-47ed-9ecb-04bc41ea2d8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:03:53.003945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:53.003945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:53.003945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:53.003945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:53.003945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:53.003945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:53.003945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:53.003945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:53.003945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:53.003945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:53.003945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:53.003945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:03:53.003945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:03:53.003945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:03:53.003945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:03:53.005057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:03:53.005057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:03:53.005057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:03:53.005057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:03:53.005057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:53.005057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:53.005057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:53.005057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:53.005057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:53.005057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:53.005057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:53.005057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:03:53.005057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:53.005057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:53.005057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:53.005057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:53.006104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:53.006104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:53.006104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:53.006104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:53.006104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:03:53.006104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:03:53.006104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:03:53.006104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:03:53.006104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:03:53.006104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:03:53.006104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:03:53.006104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:03:53.006104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 594/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:03:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:03:53.011287 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42270c-f3fe-4cf6-ad22-c99bf212994c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:53.102656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42270c-f3fe-4cf6-ad22-c99bf212994c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:53.133823 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23dbf5-e6c7-4889-a30b-8417e3bd105b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:53.134492 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23dbf5-e6c7-4889-a30b-8417e3bd105b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:53.134779 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23dbf5-e6c7-4889-a30b-8417e3bd105b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:53.135054 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23dbf5-e6c7-4889-a30b-8417e3bd105b None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:53.135790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23dbf5-e6c7-4889-a30b-8417e3bd105b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:53.136098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23dbf5-e6c7-4889-a30b-8417e3bd105b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:53.137425 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23dbf5-e6c7-4889-a30b-8417e3bd105b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:53.145451 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 595/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:03:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:53.151144 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731e75e-bc9a-47ed-9ecb-04bc41ea2d8b None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:53.243939 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731e75e-bc9a-47ed-9ecb-04bc41ea2d8b None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:53.275066 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432aef9-6077-4dfc-b0f8-da35e0938a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:53.275844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432aef9-6077-4dfc-b0f8-da35e0938a1b None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:53.276125 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432aef9-6077-4dfc-b0f8-da35e0938a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:53.276395 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432aef9-6077-4dfc-b0f8-da35e0938a1b None admin] PATH_INFO: `/v3/users/80fb91c0b13e43168c28c7105b5d8fa1` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:53.277552 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432aef9-6077-4dfc-b0f8-da35e0938a1b None admin] RBAC: Authorizing `identity:get_user(user_id=80fb91c0b13e43168c28c7105b5d8fa1)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:53.278984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432aef9-6077-4dfc-b0f8-da35e0938a1b None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:53.280537 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 595/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:03:53 2022] GET /identity/v3/users/80fb91c0b13e43168c28c7105b5d8fa1 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:53.287246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23dbf5-e6c7-4889-a30b-8417e3bd105b None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:53.383308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23dbf5-e6c7-4889-a30b-8417e3bd105b None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:53.415833 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c26ae-3f13-4671-a8d5-1b444c537993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:53.416672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c26ae-3f13-4671-a8d5-1b444c537993 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:53.416956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c26ae-3f13-4671-a8d5-1b444c537993 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:53.417233 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c26ae-3f13-4671-a8d5-1b444c537993 None admin] PATH_INFO: `/v3/projects/e200a0d0bf2241e680e3a2c32f97f831` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:53.418391 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c26ae-3f13-4671-a8d5-1b444c537993 None admin] RBAC: Authorizing `identity:get_project(project_id=e200a0d0bf2241e680e3a2c32f97f831)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:53.419807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c26ae-3f13-4671-a8d5-1b444c537993 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:53.421451 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 596/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:03:53 2022] GET /identity/v3/projects/e200a0d0bf2241e680e3a2c32f97f831 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:53.427549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432aef9-6077-4dfc-b0f8-da35e0938a1b None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:53.522499 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432aef9-6077-4dfc-b0f8-da35e0938a1b None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:53.553269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf9c55-709e-4984-895d-7fa31401c51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:53.554074 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf9c55-709e-4984-895d-7fa31401c51a None admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:53.554351 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf9c55-709e-4984-895d-7fa31401c51a None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:53.554645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf9c55-709e-4984-895d-7fa31401c51a None admin] PATH_INFO: `/v3/projects/e200a0d0bf2241e680e3a2c32f97f831/users/80fb91c0b13e43168c28c7105b5d8fa1/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:53.556568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf9c55-709e-4984-895d-7fa31401c51a None admin] RBAC: Authorizing `identity:create_grant(project_id=e200a0d0bf2241e680e3a2c32f97f831, user_id=80fb91c0b13e43168c28c7105b5d8fa1, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:53.557967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf9c55-709e-4984-895d-7fa31401c51a None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:53.642992 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 596/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:03:53 2022] PUT /identity/v3/projects/e200a0d0bf2241e680e3a2c32f97f831/users/80fb91c0b13e43168c28c7105b5d8fa1/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:03:55.825967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d982a-1379-4a49-b59a-f5b4271eab27 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:55.826520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d982a-1379-4a49-b59a-f5b4271eab27 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:55.826637 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d982a-1379-4a49-b59a-f5b4271eab27 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:55.827925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 597/1193] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:55.833967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd2272-31d5-4e0a-b1e1-b06dc84f70bb None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:55.834423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd2272-31d5-4e0a-b1e1-b06dc84f70bb None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:55.834583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd2272-31d5-4e0a-b1e1-b06dc84f70bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:55.851359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-85fd2272-31d5-4e0a-b1e1-b06dc84f70bb None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:55.852532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-85fd2272-31d5-4e0a-b1e1-b06dc84f70bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:55.915148 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 597/1194] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:03:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:03:55.937586 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d982a-1379-4a49-b59a-f5b4271eab27 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:56.034514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d982a-1379-4a49-b59a-f5b4271eab27 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:56.067508 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5661275-9c43-42cf-aca4-40482bbb887d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:56.068289 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5661275-9c43-42cf-aca4-40482bbb887d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:56.068573 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5661275-9c43-42cf-aca4-40482bbb887d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:56.068851 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5661275-9c43-42cf-aca4-40482bbb887d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:56.078429 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5661275-9c43-42cf-aca4-40482bbb887d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:03:56.085980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-c5661275-9c43-42cf-aca4-40482bbb887d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:03:56.085980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:03:56.085980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:03:56.085980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:03:56.085980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:03:56.085980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:03:56.085980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:03:56.085980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:03:56.085980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:03:56.085980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:03:56.085980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:03:56.085980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:03:56.085980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:03:56.085980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:03:56.085980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:03:56.085980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:03:56.087166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:03:56.087166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:03:56.087166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:03:56.087166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:03:56.087166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:03:56.087166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:03:56.087166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:03:56.087166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:03:56.087166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:03:56.087166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:03:56.087166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:03:56.087166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:03:56.087166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:03:56.087166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:03:56.087166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:03:56.087166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:03:56.088221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:03:56.088221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:03:56.088221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:03:56.088221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:03:56.088221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:03:56.088221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:03:56.088221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:03:56.088221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:03:56.088221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:03:56.088221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:03:56.088221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:03:56.088221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:03:56.088221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 598/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:03:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:03:56.093020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd2272-31d5-4e0a-b1e1-b06dc84f70bb None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:56.185001 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd2272-31d5-4e0a-b1e1-b06dc84f70bb None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:56.216790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cace9-7a89-4c41-ac86-6e318ff8c3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:56.217437 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cace9-7a89-4c41-ac86-6e318ff8c3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:56.217719 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cace9-7a89-4c41-ac86-6e318ff8c3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:56.217991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cace9-7a89-4c41-ac86-6e318ff8c3d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:56.218751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cace9-7a89-4c41-ac86-6e318ff8c3d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:56.219149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cace9-7a89-4c41-ac86-6e318ff8c3d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:56.220484 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cace9-7a89-4c41-ac86-6e318ff8c3d5 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:56.228017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 598/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:03:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:56.233525 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5661275-9c43-42cf-aca4-40482bbb887d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:56.328140 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5661275-9c43-42cf-aca4-40482bbb887d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:56.358462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a0e31-1657-49ba-9148-910f326ac126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:56.359317 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a0e31-1657-49ba-9148-910f326ac126 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:56.360131 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a0e31-1657-49ba-9148-910f326ac126 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:56.360406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a0e31-1657-49ba-9148-910f326ac126 None admin] PATH_INFO: `/v3/users/80fb91c0b13e43168c28c7105b5d8fa1` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:56.361565 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a0e31-1657-49ba-9148-910f326ac126 None admin] RBAC: Authorizing `identity:get_user(user_id=80fb91c0b13e43168c28c7105b5d8fa1)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:56.363018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a0e31-1657-49ba-9148-910f326ac126 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:56.364596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 599/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 10 21:03:56 2022] GET /identity/v3/users/80fb91c0b13e43168c28c7105b5d8fa1 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:56.370245 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cace9-7a89-4c41-ac86-6e318ff8c3d5 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:56.464820 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cace9-7a89-4c41-ac86-6e318ff8c3d5 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:56.496875 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4596b-5d1f-4c4c-b00e-5ee9f67c267c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:56.497501 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4596b-5d1f-4c4c-b00e-5ee9f67c267c None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:56.497780 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4596b-5d1f-4c4c-b00e-5ee9f67c267c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:56.498052 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4596b-5d1f-4c4c-b00e-5ee9f67c267c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:56.560944 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4596b-5d1f-4c4c-b00e-5ee9f67c267c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:56.562369 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4596b-5d1f-4c4c-b00e-5ee9f67c267c None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:56.652372 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 599/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:03:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 21:03:56.658807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a0e31-1657-49ba-9148-910f326ac126 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:56.752361 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a0e31-1657-49ba-9148-910f326ac126 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:56.784257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c054cb2-9dbc-4783-ba93-468801a64148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:56.785103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c054cb2-9dbc-4783-ba93-468801a64148 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:56.785390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c054cb2-9dbc-4783-ba93-468801a64148 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:56.785666 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c054cb2-9dbc-4783-ba93-468801a64148 None admin] PATH_INFO: `/v3/projects/e200a0d0bf2241e680e3a2c32f97f831` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:56.786876 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c054cb2-9dbc-4783-ba93-468801a64148 None admin] RBAC: Authorizing `identity:get_project(project_id=e200a0d0bf2241e680e3a2c32f97f831)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:56.788287 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c054cb2-9dbc-4783-ba93-468801a64148 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:56.790210 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 600/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 10 21:03:56 2022] GET /identity/v3/projects/e200a0d0bf2241e680e3a2c32f97f831 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:03:56.796045 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4596b-5d1f-4c4c-b00e-5ee9f67c267c None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:56.897346 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4596b-5d1f-4c4c-b00e-5ee9f67c267c None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:56.930191 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d21c40-ecdf-4188-ad51-b4c4443c03a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:56.930801 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d21c40-ecdf-4188-ad51-b4c4443c03a7 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:56.931085 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d21c40-ecdf-4188-ad51-b4c4443c03a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:56.931359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d21c40-ecdf-4188-ad51-b4c4443c03a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:56.932176 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d21c40-ecdf-4188-ad51-b4c4443c03a7 None admin] RBAC: Adding query filter params (role.id=5cd001edc58744738aa57180c0be68a9, scope.project.id=e200a0d0bf2241e680e3a2c32f97f831, user.id=80fb91c0b13e43168c28c7105b5d8fa1) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:03:56.932482 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d21c40-ecdf-4188-ad51-b4c4443c03a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:56.933885 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d21c40-ecdf-4188-ad51-b4c4443c03a7 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:56.940031 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 600/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:03:56 2022] GET /identity/v3/role_assignments?user.id=80fb91c0b13e43168c28c7105b5d8fa1&scope.project.id=e200a0d0bf2241e680e3a2c32f97f831&role.id=5cd001edc58744738aa57180c0be68a9 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:11.836251 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb83bd-7dba-4f64-95c6-c53160ff8be6 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:11.836884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb83bd-7dba-4f64-95c6-c53160ff8be6 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:11.836884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb83bd-7dba-4f64-95c6-c53160ff8be6 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:11.838200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 601/1201] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:05:11.843960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b07f1-c4aa-4ddb-8e01-1bf1052cde81 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:11.844362 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b07f1-c4aa-4ddb-8e01-1bf1052cde81 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:11.844544 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b07f1-c4aa-4ddb-8e01-1bf1052cde81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:11.861521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-e33b07f1-c4aa-4ddb-8e01-1bf1052cde81 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:05:11.862713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e33b07f1-c4aa-4ddb-8e01-1bf1052cde81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:05:11.927368 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 601/1202] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:05:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:05:11.951727 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb83bd-7dba-4f64-95c6-c53160ff8be6 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:12.051078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb83bd-7dba-4f64-95c6-c53160ff8be6 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:12.083420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8df81-1185-4825-b259-54433be2e07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:12.084204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8df81-1185-4825-b259-54433be2e07c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:12.084488 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8df81-1185-4825-b259-54433be2e07c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:12.084763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8df81-1185-4825-b259-54433be2e07c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:12.097862 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8df81-1185-4825-b259-54433be2e07c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:12.097862 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8df81-1185-4825-b259-54433be2e07c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:12.114311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-a8a8df81-1185-4825-b259-54433be2e07c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:12.114311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:12.114311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:12.114311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:12.114311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:12.114311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:12.114311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:12.114311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:12.114311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:12.114311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:12.114311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:12.114311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:12.114311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:05:12.114311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:05:12.114311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:05:12.115478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:05:12.115478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:12.115478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:12.115478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:12.115478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:12.115478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:12.115478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:12.115478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:12.115478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:05:12.115478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:12.115478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:12.115478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:12.115478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:12.115478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:12.115478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:12.115478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:12.115478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:12.116537 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:05:12.116537 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:05:12.116537 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:12.116537 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:05:12.116537 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 602/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:12.121469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b07f1-c4aa-4ddb-8e01-1bf1052cde81 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:12.216069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b07f1-c4aa-4ddb-8e01-1bf1052cde81 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:12.248992 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a3be5-f9a2-4438-abfe-6c936a7eb3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:12.249648 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a3be5-f9a2-4438-abfe-6c936a7eb3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:12.249969 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a3be5-f9a2-4438-abfe-6c936a7eb3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:12.250249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a3be5-f9a2-4438-abfe-6c936a7eb3c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:12.250995 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a3be5-f9a2-4438-abfe-6c936a7eb3c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:12.251304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a3be5-f9a2-4438-abfe-6c936a7eb3c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:12.252658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a3be5-f9a2-4438-abfe-6c936a7eb3c3 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:12.263373 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 602/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:12.269440 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8df81-1185-4825-b259-54433be2e07c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:12.365148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8df81-1185-4825-b259-54433be2e07c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:12.396982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6bd841-e062-4eae-94e2-f8de2023522b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:12.397633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bd841-e062-4eae-94e2-f8de2023522b None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:12.397914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bd841-e062-4eae-94e2-f8de2023522b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:12.398190 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bd841-e062-4eae-94e2-f8de2023522b None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:12.398927 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6bd841-e062-4eae-94e2-f8de2023522b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:12.400371 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6bd841-e062-4eae-94e2-f8de2023522b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:12.471898 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 603/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 10 21:05:12 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:05:14.701680 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c15af-5716-45ee-acc0-7d2f29c5a6e4 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:14.702265 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c15af-5716-45ee-acc0-7d2f29c5a6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:14.702265 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c15af-5716-45ee-acc0-7d2f29c5a6e4 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:14.703731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 603/1206] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:05:14.708980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137fbeb-3151-4f67-8352-647728b16616 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:14.709435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137fbeb-3151-4f67-8352-647728b16616 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:14.709577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137fbeb-3151-4f67-8352-647728b16616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:14.726001 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2137fbeb-3151-4f67-8352-647728b16616 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:05:14.727217 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2137fbeb-3151-4f67-8352-647728b16616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:05:14.791251 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 604/1207] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:05:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:05:14.815428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c15af-5716-45ee-acc0-7d2f29c5a6e4 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:14.914754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c15af-5716-45ee-acc0-7d2f29c5a6e4 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:14.947983 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f71ae2-a4ae-439e-8206-033539e9f19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:14.948774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f71ae2-a4ae-439e-8206-033539e9f19b None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:14.949058 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f71ae2-a4ae-439e-8206-033539e9f19b None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:14.949336 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f71ae2-a4ae-439e-8206-033539e9f19b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:14.959388 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f71ae2-a4ae-439e-8206-033539e9f19b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:05:14.966962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-86f71ae2-a4ae-439e-8206-033539e9f19b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:05:14.966962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:14.966962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:14.966962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:14.966962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:14.966962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:14.966962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:14.966962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:14.966962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:14.966962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:14.966962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:14.966962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:14.966962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:05:14.966962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:05:14.966962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:05:14.966962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:05:14.969493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:05:14.969493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:05:14.969493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:05:14.969493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:05:14.969493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:14.969493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:14.969493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:14.969493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:14.969493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:14.969493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:14.969493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:14.969493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:05:14.969493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:14.969493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:14.969493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:14.969493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:14.970364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:14.970364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:14.970364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:14.970364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:14.970364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:05:14.970364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:05:14.970364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:05:14.970364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:05:14.970364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:05:14.970364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:05:14.970364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:05:14.970364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:14.970364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 604/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:05:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:14.974356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137fbeb-3151-4f67-8352-647728b16616 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:15.070332 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137fbeb-3151-4f67-8352-647728b16616 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:15.102882 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b535bf-71c1-418d-b81a-2011f25c75ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:15.103547 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b535bf-71c1-418d-b81a-2011f25c75ff None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:15.103875 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b535bf-71c1-418d-b81a-2011f25c75ff None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:15.104154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b535bf-71c1-418d-b81a-2011f25c75ff None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:15.104900 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b535bf-71c1-418d-b81a-2011f25c75ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:15.105205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b535bf-71c1-418d-b81a-2011f25c75ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:15.106589 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b535bf-71c1-418d-b81a-2011f25c75ff None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:15.114890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 605/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:05:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:15.120475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f71ae2-a4ae-439e-8206-033539e9f19b None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:15.216032 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f71ae2-a4ae-439e-8206-033539e9f19b None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:15.249784 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ebd0b-d3d1-41d9-bbdb-705a88ecb651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:15.250664 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ebd0b-d3d1-41d9-bbdb-705a88ecb651 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:15.250948 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ebd0b-d3d1-41d9-bbdb-705a88ecb651 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:15.251219 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ebd0b-d3d1-41d9-bbdb-705a88ecb651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:15.261239 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ebd0b-d3d1-41d9-bbdb-705a88ecb651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:15.262685 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ebd0b-d3d1-41d9-bbdb-705a88ecb651 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:15.279337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-016ebd0b-d3d1-41d9-bbdb-705a88ecb651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:15.279337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:15.279337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:15.279337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:15.279337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:15.279337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:15.279337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:15.279337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:15.279337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:15.279337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:15.279337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:15.279337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:15.279337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:05:15.279337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:05:15.279337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:05:15.281790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:05:15.281790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:15.281790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:15.281790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:15.281790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:15.281790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:15.281790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:15.281790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:15.281790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:05:15.281790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:15.281790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:15.281790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:15.281790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:15.281790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:15.281790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:15.281790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:15.281790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:15.282967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:05:15.282967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:05:15.282967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:15.282967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:15.282967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 605/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:15.287127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b535bf-71c1-418d-b81a-2011f25c75ff None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:15.393580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b535bf-71c1-418d-b81a-2011f25c75ff None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:15.426618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0cc6c-c416-48a2-820b-d2e7c42fa160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:15.427252 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0cc6c-c416-48a2-820b-d2e7c42fa160 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:15.427536 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0cc6c-c416-48a2-820b-d2e7c42fa160 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:15.427812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0cc6c-c416-48a2-820b-d2e7c42fa160 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:15.428524 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0cc6c-c416-48a2-820b-d2e7c42fa160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:15.428829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0cc6c-c416-48a2-820b-d2e7c42fa160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:15.430202 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0cc6c-c416-48a2-820b-d2e7c42fa160 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:15.441407 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 606/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:15.447178 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ebd0b-d3d1-41d9-bbdb-705a88ecb651 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:15.545021 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ebd0b-d3d1-41d9-bbdb-705a88ecb651 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:15.577917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276e426-dc82-4385-9dc8-d8170c4ed08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:15.578842 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276e426-dc82-4385-9dc8-d8170c4ed08f None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:15.579130 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276e426-dc82-4385-9dc8-d8170c4ed08f None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:15.579408 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276e426-dc82-4385-9dc8-d8170c4ed08f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:15.586632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276e426-dc82-4385-9dc8-d8170c4ed08f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:15.588137 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276e426-dc82-4385-9dc8-d8170c4ed08f None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:15.602824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-8276e426-dc82-4385-9dc8-d8170c4ed08f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 21:05:15.602824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:15.602824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:15.602824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:15.602824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:15.602824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:15.602824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:15.602824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:15.602824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:15.602824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:15.602824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:15.602824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:15.602824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:05:15.602824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:05:15.602824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:05:15.602824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:05:15.603981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:15.603981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:15.603981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:05:15.603981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:05:15.603981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:05:15.603981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:05:15.603981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:15.603981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:15.603981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:15.603981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:15.603981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:15.603981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:05:15.603981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:15.603981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:15.603981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:15.603981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:15.603981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:15.603981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:15.604961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:15.604961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:15.604961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:05:15.604961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:05:15.604961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:05:15.604961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:05:15.604961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:05:15.604961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:05:15.604961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 21:05:15.604961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:15.604961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 606/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:05:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:15.610515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0cc6c-c416-48a2-820b-d2e7c42fa160 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:15.705023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0cc6c-c416-48a2-820b-d2e7c42fa160 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:15.736910 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fd9d6-8cb9-4938-9be9-858c70f3bec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:15.737572 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fd9d6-8cb9-4938-9be9-858c70f3bec0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:15.737855 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fd9d6-8cb9-4938-9be9-858c70f3bec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:15.738129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fd9d6-8cb9-4938-9be9-858c70f3bec0 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:15.738999 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fd9d6-8cb9-4938-9be9-858c70f3bec0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:15.739313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fd9d6-8cb9-4938-9be9-858c70f3bec0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:15.740833 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fd9d6-8cb9-4938-9be9-858c70f3bec0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:15.757608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 607/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Tue May 10 21:05:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:15.763278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276e426-dc82-4385-9dc8-d8170c4ed08f None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:15.862565 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276e426-dc82-4385-9dc8-d8170c4ed08f None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:15.895340 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f2064-7ab5-472f-96cf-933867bf9fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:15.895982 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f2064-7ab5-472f-96cf-933867bf9fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:15.896268 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f2064-7ab5-472f-96cf-933867bf9fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:15.896547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f2064-7ab5-472f-96cf-933867bf9fc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:15.960564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f2064-7ab5-472f-96cf-933867bf9fc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:15.962044 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f2064-7ab5-472f-96cf-933867bf9fc1 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:16.055015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 607/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:05:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 21:05:16.060798 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fd9d6-8cb9-4938-9be9-858c70f3bec0 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:16.157675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fd9d6-8cb9-4938-9be9-858c70f3bec0 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:16.190503 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaad2b-a57b-4018-9f99-dde08feab4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:16.191294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaad2b-a57b-4018-9f99-dde08feab4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:16.191578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaad2b-a57b-4018-9f99-dde08feab4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:16.191855 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaad2b-a57b-4018-9f99-dde08feab4f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:16.201518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfaad2b-a57b-4018-9f99-dde08feab4f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:16.203558 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfaad2b-a57b-4018-9f99-dde08feab4f6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:16.220894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-6bfaad2b-a57b-4018-9f99-dde08feab4f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:16.220894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:16.220894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:16.220894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:16.220894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:16.220894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:16.220894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:16.220894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:16.220894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:16.220894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:16.220894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:16.220894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:16.220894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:05:16.220894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:05:16.220894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:05:16.221969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:05:16.221969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:16.221969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:16.221969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:16.221969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:16.221969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:16.221969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:16.221969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:16.221969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:05:16.221969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:16.221969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:16.221969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:16.221969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:16.221969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:16.221969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:16.221969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:16.221969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:16.223008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:05:16.223008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:05:16.223008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:16.223008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:05:16.226636 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 608/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:16.227722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f2064-7ab5-472f-96cf-933867bf9fc1 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:16.323595 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f2064-7ab5-472f-96cf-933867bf9fc1 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:16.356857 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72397f-fbfc-454d-93f7-9b8789e68eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:16.357524 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72397f-fbfc-454d-93f7-9b8789e68eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:16.357802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72397f-fbfc-454d-93f7-9b8789e68eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:16.358070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72397f-fbfc-454d-93f7-9b8789e68eb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:16.358809 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72397f-fbfc-454d-93f7-9b8789e68eb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:16.359649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72397f-fbfc-454d-93f7-9b8789e68eb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:16.360996 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72397f-fbfc-454d-93f7-9b8789e68eb6 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:16.371695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 608/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:16.378221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaad2b-a57b-4018-9f99-dde08feab4f6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:16.475612 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaad2b-a57b-4018-9f99-dde08feab4f6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:16.508422 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54331a0-3967-4bb5-8825-348fd85eedeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:16.509208 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54331a0-3967-4bb5-8825-348fd85eedeb None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:16.509491 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54331a0-3967-4bb5-8825-348fd85eedeb None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:16.509762 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54331a0-3967-4bb5-8825-348fd85eedeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:16.516458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54331a0-3967-4bb5-8825-348fd85eedeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:16.517891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54331a0-3967-4bb5-8825-348fd85eedeb None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:16.532223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-c54331a0-3967-4bb5-8825-348fd85eedeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:05:16.532223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:16.532223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:16.532223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:16.532223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:16.532223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:16.532223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:16.532223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:16.532223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:16.532223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:16.532223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:16.532223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:16.532223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:05:16.532223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:05:16.532223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:05:16.533172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:05:16.533172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:16.533172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:16.533172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:16.533172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:16.533172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:16.533172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:16.533172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:16.533172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:05:16.533172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:16.533172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:16.533172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:16.533172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:16.533172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:16.533172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:16.533172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:16.533172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:16.534081 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:05:16.534081 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:05:16.534081 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:05:16.534081 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:05:16.534081 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:05:16.534081 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:05:16.534081 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:05:16.534081 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:05:16.534081 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 609/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:05:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:16.539862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72397f-fbfc-454d-93f7-9b8789e68eb6 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:16.635932 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72397f-fbfc-454d-93f7-9b8789e68eb6 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:16.670122 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b6b13-d71e-4a59-8953-507ecb8003cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:16.670800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b6b13-d71e-4a59-8953-507ecb8003cf None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:16.672851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b6b13-d71e-4a59-8953-507ecb8003cf None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:16.672851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b6b13-d71e-4a59-8953-507ecb8003cf None admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:16.672851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b6b13-d71e-4a59-8953-507ecb8003cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:16.673186 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b6b13-d71e-4a59-8953-507ecb8003cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:16.674520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b6b13-d71e-4a59-8953-507ecb8003cf None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:16.686158 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 609/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:05:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:16.692280 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54331a0-3967-4bb5-8825-348fd85eedeb None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:16.788388 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54331a0-3967-4bb5-8825-348fd85eedeb None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:16.819803 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb2c28-80c4-425d-b3dd-9c3fd6b04686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:16.820442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb2c28-80c4-425d-b3dd-9c3fd6b04686 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:16.820723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb2c28-80c4-425d-b3dd-9c3fd6b04686 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:16.820993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb2c28-80c4-425d-b3dd-9c3fd6b04686 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:16.821804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb2c28-80c4-425d-b3dd-9c3fd6b04686 None admin] RBAC: Adding query filter params (role.id=d09c313a1a354ea68cf1013629a4a584, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=9a13ad1e10ff44c4b870b45b7416b70f) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:16.822110 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb2c28-80c4-425d-b3dd-9c3fd6b04686 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:16.823566 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb2c28-80c4-425d-b3dd-9c3fd6b04686 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:16.828958 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 610/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:05:16 2022] GET /identity/v3/role_assignments?user.id=9a13ad1e10ff44c4b870b45b7416b70f&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=d09c313a1a354ea68cf1013629a4a584 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:19.033043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb3bfd-7a1d-408b-81be-ed114c67d790 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:19.033596 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb3bfd-7a1d-408b-81be-ed114c67d790 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:19.033596 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb3bfd-7a1d-408b-81be-ed114c67d790 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:19.035247 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 610/1220] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:05:19.040339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f3dfa-de5d-4891-950e-1572d6a1e1ce None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:19.040740 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f3dfa-de5d-4891-950e-1572d6a1e1ce None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:19.040902 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f3dfa-de5d-4891-950e-1572d6a1e1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:19.057223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6d2f3dfa-de5d-4891-950e-1572d6a1e1ce None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:05:19.061380 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6d2f3dfa-de5d-4891-950e-1572d6a1e1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:05:19.122813 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 611/1221] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:05:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:05:19.146615 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb3bfd-7a1d-408b-81be-ed114c67d790 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:19.244305 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb3bfd-7a1d-408b-81be-ed114c67d790 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:19.277498 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd1133-d28c-4dab-92c9-6d422adcf1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:19.278286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd1133-d28c-4dab-92c9-6d422adcf1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:19.278601 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd1133-d28c-4dab-92c9-6d422adcf1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:19.278881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd1133-d28c-4dab-92c9-6d422adcf1c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:19.289094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd1133-d28c-4dab-92c9-6d422adcf1c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:05:19.297543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-25cd1133-d28c-4dab-92c9-6d422adcf1c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:05:19.297543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:19.297543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:19.297543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:19.297543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:19.297543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:19.297543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:19.297543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:19.297543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:19.297543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:19.297543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:19.297543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:19.297543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:05:19.297543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:05:19.297543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:05:19.297543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:05:19.298743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:05:19.298743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:05:19.298743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:05:19.298743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:05:19.298743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:19.298743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:19.298743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:19.298743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:19.298743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:19.298743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:19.298743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:19.298743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:05:19.298743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:19.298743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:19.298743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:19.298743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:19.300000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:19.300000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:19.300000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:19.300000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:19.300000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:05:19.300000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:05:19.300000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:05:19.300000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:05:19.300000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:05:19.300000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:05:19.300000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:05:19.300000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:19.300000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 611/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:05:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:19.304718 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f3dfa-de5d-4891-950e-1572d6a1e1ce None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:19.404283 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f3dfa-de5d-4891-950e-1572d6a1e1ce None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:19.436423 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e600974-7470-4550-a05b-06798ef19470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:19.437633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e600974-7470-4550-a05b-06798ef19470 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:19.437912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e600974-7470-4550-a05b-06798ef19470 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:19.438182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e600974-7470-4550-a05b-06798ef19470 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:19.438963 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e600974-7470-4550-a05b-06798ef19470 None admin] RBAC: Adding query filter params (name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:19.439270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e600974-7470-4550-a05b-06798ef19470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:19.440658 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e600974-7470-4550-a05b-06798ef19470 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:19.448811 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 612/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:05:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:19.455161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd1133-d28c-4dab-92c9-6d422adcf1c8 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:19.552727 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd1133-d28c-4dab-92c9-6d422adcf1c8 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:19.584053 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385302bc-12d1-4d93-8f86-e7a622df1c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:19.584839 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385302bc-12d1-4d93-8f86-e7a622df1c65 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:19.585124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385302bc-12d1-4d93-8f86-e7a622df1c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:19.585420 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385302bc-12d1-4d93-8f86-e7a622df1c65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:19.596160 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385302bc-12d1-4d93-8f86-e7a622df1c65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:19.597589 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385302bc-12d1-4d93-8f86-e7a622df1c65 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:19.614539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-385302bc-12d1-4d93-8f86-e7a622df1c65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:19.614539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:19.614539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:19.614539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:19.614539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:19.614539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:19.614539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:19.614539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:19.614539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:19.614539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:19.614539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:19.614539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:19.614539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:05:19.614539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:05:19.614539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:05:19.615508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:05:19.615508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:19.615508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:19.615508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:19.615508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:19.615508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:19.615508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:19.615508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:19.615508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:05:19.615508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:19.615508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:19.615508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:19.615508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:19.615508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:19.615508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:19.615508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:19.615508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:19.616627 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:05:19.616627 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:05:19.616627 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:19.616627 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:19.616627 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 612/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:19.621401 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e600974-7470-4550-a05b-06798ef19470 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:19.716674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e600974-7470-4550-a05b-06798ef19470 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:19.748846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde39c04-e4e9-4759-8e41-5a1c1a27d8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:19.749960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde39c04-e4e9-4759-8e41-5a1c1a27d8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:19.750246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde39c04-e4e9-4759-8e41-5a1c1a27d8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:19.750550 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde39c04-e4e9-4759-8e41-5a1c1a27d8e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:19.751261 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde39c04-e4e9-4759-8e41-5a1c1a27d8e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:19.751564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde39c04-e4e9-4759-8e41-5a1c1a27d8e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:19.752900 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde39c04-e4e9-4759-8e41-5a1c1a27d8e5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:19.764025 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 613/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:19.769722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385302bc-12d1-4d93-8f86-e7a622df1c65 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:19.866816 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385302bc-12d1-4d93-8f86-e7a622df1c65 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:19.898603 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff3766-77a9-4b32-8280-0044576c9c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:19.899402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff3766-77a9-4b32-8280-0044576c9c6b None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:19.899688 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff3766-77a9-4b32-8280-0044576c9c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:19.899966 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff3766-77a9-4b32-8280-0044576c9c6b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:19.907793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff3766-77a9-4b32-8280-0044576c9c6b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:19.909475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff3766-77a9-4b32-8280-0044576c9c6b None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:19.923935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-bfff3766-77a9-4b32-8280-0044576c9c6b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 21:05:19.923935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:19.923935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:19.923935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:19.923935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:19.923935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:19.923935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:19.923935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:19.923935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:19.923935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:19.923935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:19.923935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:19.923935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:05:19.923935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:05:19.923935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:05:19.923935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:05:19.925043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:19.925043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:19.925043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:05:19.925043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:05:19.925043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:05:19.925043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:05:19.925043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:19.925043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:19.925043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:19.925043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:19.925043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:19.925043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:05:19.925043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:19.925043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:19.925043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:19.925043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:19.925043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:19.925043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:19.926073 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:19.926073 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:19.926073 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:05:19.926073 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:05:19.926073 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:05:19.926073 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:05:19.926073 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:05:19.926073 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:05:19.926073 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 21:05:19.926073 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:19.926073 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 613/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:05:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:19.930957 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde39c04-e4e9-4759-8e41-5a1c1a27d8e5 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:20.023591 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde39c04-e4e9-4759-8e41-5a1c1a27d8e5 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:20.057135 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b6d9e-9d12-45bb-aea6-ece1ea7dde7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:20.057808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b6d9e-9d12-45bb-aea6-ece1ea7dde7c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:20.058094 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b6d9e-9d12-45bb-aea6-ece1ea7dde7c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:20.058373 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b6d9e-9d12-45bb-aea6-ece1ea7dde7c None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:20.059247 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b6d9e-9d12-45bb-aea6-ece1ea7dde7c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:20.062050 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b6d9e-9d12-45bb-aea6-ece1ea7dde7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:20.062050 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b6d9e-9d12-45bb-aea6-ece1ea7dde7c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:20.077853 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 614/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Tue May 10 21:05:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:20.083595 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff3766-77a9-4b32-8280-0044576c9c6b None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:20.181387 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff3766-77a9-4b32-8280-0044576c9c6b None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:20.214016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b14d41-7272-4e61-9f55-f3b81925a550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:20.214826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b14d41-7272-4e61-9f55-f3b81925a550 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:20.215106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b14d41-7272-4e61-9f55-f3b81925a550 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:20.215372 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b14d41-7272-4e61-9f55-f3b81925a550 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:20.226181 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b14d41-7272-4e61-9f55-f3b81925a550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:20.227625 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b14d41-7272-4e61-9f55-f3b81925a550 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:20.244378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-f1b14d41-7272-4e61-9f55-f3b81925a550 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:20.244378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:20.244378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:20.244378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:20.244378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:20.244378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:20.244378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:20.244378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:20.244378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:20.244378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:20.244378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:20.244378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:20.244378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:05:20.244378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:05:20.244378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:05:20.245444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:05:20.245444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:20.245444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:20.245444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:20.245444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:20.245444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:20.245444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:20.245444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:20.245444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:05:20.245444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:20.245444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:20.245444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:20.245444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:20.245444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:20.245444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:20.245444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:20.245444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:20.246917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:05:20.246917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:05:20.246917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:20.246917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:20.246917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 614/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:20.251277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b6d9e-9d12-45bb-aea6-ece1ea7dde7c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:20.347087 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b6d9e-9d12-45bb-aea6-ece1ea7dde7c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:20.379002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e528a28-7515-41b5-b701-f27caa00db98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:20.379650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e528a28-7515-41b5-b701-f27caa00db98 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:20.379930 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e528a28-7515-41b5-b701-f27caa00db98 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:20.380201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e528a28-7515-41b5-b701-f27caa00db98 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:20.380908 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e528a28-7515-41b5-b701-f27caa00db98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:20.381210 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e528a28-7515-41b5-b701-f27caa00db98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:20.382570 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e528a28-7515-41b5-b701-f27caa00db98 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:20.394315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 615/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:20.399977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b14d41-7272-4e61-9f55-f3b81925a550 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:20.493961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b14d41-7272-4e61-9f55-f3b81925a550 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:20.526708 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c302a4f-f35c-4181-aec9-3a37a9253484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:20.527501 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c302a4f-f35c-4181-aec9-3a37a9253484 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:20.527784 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c302a4f-f35c-4181-aec9-3a37a9253484 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:20.528060 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c302a4f-f35c-4181-aec9-3a37a9253484 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:20.534810 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c302a4f-f35c-4181-aec9-3a37a9253484 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:20.536236 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c302a4f-f35c-4181-aec9-3a37a9253484 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:20.549935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-9c302a4f-f35c-4181-aec9-3a37a9253484 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:05:20.549935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:20.549935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:20.549935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:20.549935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:20.549935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:20.549935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:20.549935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:20.549935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:20.549935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:20.549935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:20.549935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:20.549935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:05:20.549935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:05:20.549935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:05:20.552069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:05:20.552069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:20.552069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:20.552069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:20.552069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:20.552069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:20.552069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:20.552069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:20.552069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:05:20.552069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:20.552069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:20.552069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:20.552069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:20.552069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:20.552069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:20.552069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:20.552069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:20.552992 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:05:20.552992 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:05:20.552992 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:05:20.552992 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:05:20.552992 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:05:20.552992 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:05:20.552992 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:05:20.552992 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:20.552992 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 615/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:05:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:20.556989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e528a28-7515-41b5-b701-f27caa00db98 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:20.655791 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e528a28-7515-41b5-b701-f27caa00db98 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:20.690120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d349e7-6f13-4017-835f-651d0d8a73a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:20.690795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d349e7-6f13-4017-835f-651d0d8a73a7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:20.691079 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d349e7-6f13-4017-835f-651d0d8a73a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:20.691353 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d349e7-6f13-4017-835f-651d0d8a73a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:20.692126 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d349e7-6f13-4017-835f-651d0d8a73a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:20.692433 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d349e7-6f13-4017-835f-651d0d8a73a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:20.693932 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d349e7-6f13-4017-835f-651d0d8a73a7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:20.705316 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 616/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:05:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:20.711331 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c302a4f-f35c-4181-aec9-3a37a9253484 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:20.807318 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c302a4f-f35c-4181-aec9-3a37a9253484 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:20.840693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c1004-6e18-4cb3-bb59-47bde4c96d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:20.841635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c1004-6e18-4cb3-bb59-47bde4c96d93 None admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:20.841912 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c1004-6e18-4cb3-bb59-47bde4c96d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:20.842772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c1004-6e18-4cb3-bb59-47bde4c96d93 None admin] PATH_INFO: `/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/9a13ad1e10ff44c4b870b45b7416b70f/roles/d09c313a1a354ea68cf1013629a4a584` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:20.859829 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c1004-6e18-4cb3-bb59-47bde4c96d93 None admin] RBAC: Authorizing `identity:create_grant(project_id=385eeb55a9ae42eba674de1e83d96e0d, user_id=9a13ad1e10ff44c4b870b45b7416b70f, role_id=d09c313a1a354ea68cf1013629a4a584)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:20.861257 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c1004-6e18-4cb3-bb59-47bde4c96d93 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:20.973894 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 616/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:05:20 2022] PUT /identity/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/9a13ad1e10ff44c4b870b45b7416b70f/roles/d09c313a1a354ea68cf1013629a4a584 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:05:23.187204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d986f-0609-420a-9472-05ad03cf4540 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:23.187733 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d986f-0609-420a-9472-05ad03cf4540 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:23.187733 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d986f-0609-420a-9472-05ad03cf4540 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:23.189163 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 617/1233] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:05:23.194850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d887a-c98f-4c4f-9404-85411f12eacb None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:23.195324 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d887a-c98f-4c4f-9404-85411f12eacb None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:23.195442 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d887a-c98f-4c4f-9404-85411f12eacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:23.211589 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-025d887a-c98f-4c4f-9404-85411f12eacb None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:05:23.212790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-025d887a-c98f-4c4f-9404-85411f12eacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:05:23.275763 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 617/1234] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:05:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:05:23.300466 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d986f-0609-420a-9472-05ad03cf4540 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:23.397339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d986f-0609-420a-9472-05ad03cf4540 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:23.431168 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43135ea5-e39c-4bcf-ba62-dd6daf9bf155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:23.431962 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43135ea5-e39c-4bcf-ba62-dd6daf9bf155 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:23.432250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43135ea5-e39c-4bcf-ba62-dd6daf9bf155 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:23.432538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43135ea5-e39c-4bcf-ba62-dd6daf9bf155 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:23.448741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43135ea5-e39c-4bcf-ba62-dd6daf9bf155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:05:23.450045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-43135ea5-e39c-4bcf-ba62-dd6daf9bf155 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 21:05:23.450045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:23.450045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:23.450045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:23.450045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:23.450045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:23.450045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:23.450045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:23.450045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:23.450045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:23.450045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:23.450045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:23.450045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:05:23.450045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:05:23.450045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:05:23.450045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:05:23.451230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:05:23.451230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:05:23.451230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:05:23.451230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:05:23.451230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:23.451230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:23.451230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:23.451230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:23.451230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:23.451230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:23.451230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:23.451230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:05:23.451230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:23.451230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:23.451230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:23.451230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:23.452406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:23.452406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:23.452406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:23.452406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:23.452406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:05:23.452406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:05:23.452406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:05:23.452406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:05:23.452406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:05:23.452406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:05:23.452406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 21:05:23.452406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:05:23.452406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 618/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 10 21:05:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:23.457449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d887a-c98f-4c4f-9404-85411f12eacb None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:23.554191 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d887a-c98f-4c4f-9404-85411f12eacb None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:23.587683 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98576df5-3f22-4150-b049-e03fc0c032d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:23.588350 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98576df5-3f22-4150-b049-e03fc0c032d9 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:23.588636 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98576df5-3f22-4150-b049-e03fc0c032d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:23.588916 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98576df5-3f22-4150-b049-e03fc0c032d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:23.589711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98576df5-3f22-4150-b049-e03fc0c032d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:23.590020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98576df5-3f22-4150-b049-e03fc0c032d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:23.591414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98576df5-3f22-4150-b049-e03fc0c032d9 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:23.600177 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 618/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 10 21:05:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:23.605959 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43135ea5-e39c-4bcf-ba62-dd6daf9bf155 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:23.703749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43135ea5-e39c-4bcf-ba62-dd6daf9bf155 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:23.736553 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11ffeb-e752-418a-a45e-bb9b37e9cfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:23.737335 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11ffeb-e752-418a-a45e-bb9b37e9cfce None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:23.737618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11ffeb-e752-418a-a45e-bb9b37e9cfce None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:23.737891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11ffeb-e752-418a-a45e-bb9b37e9cfce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:23.747853 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11ffeb-e752-418a-a45e-bb9b37e9cfce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:23.749774 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11ffeb-e752-418a-a45e-bb9b37e9cfce None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:23.766681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-db11ffeb-e752-418a-a45e-bb9b37e9cfce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:23.766681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:23.766681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:23.766681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:23.766681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:23.766681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:23.766681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:23.766681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:23.766681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:23.766681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:23.766681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:23.766681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:23.766681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:05:23.766681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:05:23.766681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:05:23.767602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:05:23.767602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:23.767602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:23.767602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:23.767602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:23.767602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:23.767602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:23.767602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:23.767602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:05:23.767602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:23.767602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:23.767602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:23.767602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:23.767602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:23.767602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:23.767602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:23.767602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:23.768527 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:05:23.768527 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:05:23.768527 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:23.768527 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:05:23.768527 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 619/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:23.773612 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98576df5-3f22-4150-b049-e03fc0c032d9 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:23.872877 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98576df5-3f22-4150-b049-e03fc0c032d9 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:23.905118 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257363f4-0557-419d-a54f-0d070dd5e54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:23.906717 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257363f4-0557-419d-a54f-0d070dd5e54d None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:23.907001 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257363f4-0557-419d-a54f-0d070dd5e54d None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:23.912964 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257363f4-0557-419d-a54f-0d070dd5e54d None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:23.912964 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257363f4-0557-419d-a54f-0d070dd5e54d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:23.912964 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257363f4-0557-419d-a54f-0d070dd5e54d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:23.912964 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257363f4-0557-419d-a54f-0d070dd5e54d None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:23.922079 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 619/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:23.927916 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11ffeb-e752-418a-a45e-bb9b37e9cfce None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:24.023714 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11ffeb-e752-418a-a45e-bb9b37e9cfce None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:24.055880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858628ee-2bed-45aa-a691-613f8fe6eb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:24.056657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858628ee-2bed-45aa-a691-613f8fe6eb23 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:24.056943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858628ee-2bed-45aa-a691-613f8fe6eb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:24.057214 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858628ee-2bed-45aa-a691-613f8fe6eb23 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:24.064522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858628ee-2bed-45aa-a691-613f8fe6eb23 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:24.073676 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858628ee-2bed-45aa-a691-613f8fe6eb23 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:24.080543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-858628ee-2bed-45aa-a691-613f8fe6eb23 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 21:05:24.080543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:24.080543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:24.080543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:24.080543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:24.080543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:24.080543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:24.080543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:24.080543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:24.080543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:24.080543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:24.080543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:24.080543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:05:24.080543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:05:24.080543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:05:24.080543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:05:24.081615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:24.081615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:24.081615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:05:24.081615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:05:24.081615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:05:24.081615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:05:24.081615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:24.081615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:24.081615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:24.081615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:24.081615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:24.081615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:05:24.081615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:24.081615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:24.081615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:24.081615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:24.081615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:24.081615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:24.082687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:24.082687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:24.082687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:05:24.082687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:05:24.082687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:05:24.082687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:05:24.082687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:05:24.082687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:05:24.082687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 21:05:24.082687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:05:24.082687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 620/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:05:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:24.087497 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257363f4-0557-419d-a54f-0d070dd5e54d None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:24.182787 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257363f4-0557-419d-a54f-0d070dd5e54d None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:24.215599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfde19-39ed-4bb3-babd-56fe2fa51124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:24.216272 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfde19-39ed-4bb3-babd-56fe2fa51124 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:24.216557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfde19-39ed-4bb3-babd-56fe2fa51124 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:24.216837 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfde19-39ed-4bb3-babd-56fe2fa51124 None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:24.217793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfde19-39ed-4bb3-babd-56fe2fa51124 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:24.218110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfde19-39ed-4bb3-babd-56fe2fa51124 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:24.220062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfde19-39ed-4bb3-babd-56fe2fa51124 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:24.237274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 620/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Tue May 10 21:05:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:24.243075 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858628ee-2bed-45aa-a691-613f8fe6eb23 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:24.338715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858628ee-2bed-45aa-a691-613f8fe6eb23 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:24.370458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8ba31-00c6-481d-aae9-15b61dfef510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:24.371116 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8ba31-00c6-481d-aae9-15b61dfef510 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:24.371405 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8ba31-00c6-481d-aae9-15b61dfef510 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:24.371684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8ba31-00c6-481d-aae9-15b61dfef510 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:24.435969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8ba31-00c6-481d-aae9-15b61dfef510 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:24.437891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8ba31-00c6-481d-aae9-15b61dfef510 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:24.529963 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 621/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:05:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 21:05:24.536070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfde19-39ed-4bb3-babd-56fe2fa51124 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:24.630916 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfde19-39ed-4bb3-babd-56fe2fa51124 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:24.663643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902017c7-ceaa-4eeb-8da5-d0f2eab4b7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:24.664428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902017c7-ceaa-4eeb-8da5-d0f2eab4b7ba None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:24.664707 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902017c7-ceaa-4eeb-8da5-d0f2eab4b7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:24.664977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902017c7-ceaa-4eeb-8da5-d0f2eab4b7ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:24.674545 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902017c7-ceaa-4eeb-8da5-d0f2eab4b7ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:24.675979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902017c7-ceaa-4eeb-8da5-d0f2eab4b7ba None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:24.693041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-902017c7-ceaa-4eeb-8da5-d0f2eab4b7ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:24.693041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:24.693041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:24.693041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:24.693041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:24.693041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:24.693041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:24.693041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:24.693041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:24.693041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:24.693041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:24.693041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:24.693041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:05:24.693041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:05:24.693041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:05:24.694103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:05:24.694103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:24.694103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:24.694103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:24.694103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:24.694103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:24.694103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:24.694103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:24.694103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:05:24.694103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:24.694103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:24.694103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:24.694103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:24.694103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:24.694103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:24.694103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:24.694103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:24.695306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:05:24.695306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:05:24.695306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:24.695306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:24.695306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 621/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:24.699876 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8ba31-00c6-481d-aae9-15b61dfef510 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:24.794025 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8ba31-00c6-481d-aae9-15b61dfef510 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:24.827485 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752186b2-be01-40bd-a9ef-87caf15086a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:24.828649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752186b2-be01-40bd-a9ef-87caf15086a0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:24.828936 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752186b2-be01-40bd-a9ef-87caf15086a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:24.829215 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752186b2-be01-40bd-a9ef-87caf15086a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:24.829933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752186b2-be01-40bd-a9ef-87caf15086a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:24.830240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752186b2-be01-40bd-a9ef-87caf15086a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:24.831610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752186b2-be01-40bd-a9ef-87caf15086a0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:24.842360 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 622/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:24.848611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902017c7-ceaa-4eeb-8da5-d0f2eab4b7ba None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:24.944236 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902017c7-ceaa-4eeb-8da5-d0f2eab4b7ba None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:24.976885 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb67c05-e4c1-4ea8-9362-9d12f5163578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:24.977695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb67c05-e4c1-4ea8-9362-9d12f5163578 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:24.977980 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb67c05-e4c1-4ea8-9362-9d12f5163578 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:24.978252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb67c05-e4c1-4ea8-9362-9d12f5163578 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:24.985281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb67c05-e4c1-4ea8-9362-9d12f5163578 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:24.986721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb67c05-e4c1-4ea8-9362-9d12f5163578 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:25.000700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-7fb67c05-e4c1-4ea8-9362-9d12f5163578 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:05:25.000700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:25.000700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:25.000700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:25.000700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:25.000700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:25.000700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:25.000700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:25.000700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:25.000700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:25.000700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:25.000700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:25.000700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:05:25.000700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:05:25.000700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:05:25.001762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:05:25.001762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:25.001762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:25.001762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:25.001762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:25.001762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:25.001762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:25.001762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:25.001762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:05:25.001762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:25.001762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:25.001762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:25.001762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:25.001762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:25.001762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:25.001762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:25.001762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:25.002923 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:05:25.002923 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:05:25.002923 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:05:25.002923 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:05:25.002923 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:05:25.002923 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:05:25.002923 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:05:25.002923 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:25.002923 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 622/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:05:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:25.007668 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752186b2-be01-40bd-a9ef-87caf15086a0 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:25.103888 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752186b2-be01-40bd-a9ef-87caf15086a0 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:25.136778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617485ee-520e-46e5-8286-221d2375d425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:25.137424 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617485ee-520e-46e5-8286-221d2375d425 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:25.137948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617485ee-520e-46e5-8286-221d2375d425 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:25.138076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617485ee-520e-46e5-8286-221d2375d425 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:25.138824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617485ee-520e-46e5-8286-221d2375d425 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:25.139129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617485ee-520e-46e5-8286-221d2375d425 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:25.140571 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617485ee-520e-46e5-8286-221d2375d425 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:25.152558 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 623/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:05:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:25.159023 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb67c05-e4c1-4ea8-9362-9d12f5163578 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:25.255714 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb67c05-e4c1-4ea8-9362-9d12f5163578 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:25.287942 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20076ff-afd5-43fd-9365-b1413e22ff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:25.288582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20076ff-afd5-43fd-9365-b1413e22ff86 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:25.288863 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20076ff-afd5-43fd-9365-b1413e22ff86 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:25.289138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20076ff-afd5-43fd-9365-b1413e22ff86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:25.289956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20076ff-afd5-43fd-9365-b1413e22ff86 None admin] RBAC: Adding query filter params (role.id=d09c313a1a354ea68cf1013629a4a584, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=9a13ad1e10ff44c4b870b45b7416b70f) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:25.290262 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20076ff-afd5-43fd-9365-b1413e22ff86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:25.291698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20076ff-afd5-43fd-9365-b1413e22ff86 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:25.298126 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 623/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:05:25 2022] GET /identity/v3/role_assignments?user.id=9a13ad1e10ff44c4b870b45b7416b70f&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=d09c313a1a354ea68cf1013629a4a584 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:27.582726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0b901-00cd-4838-9a0c-b50702bf356c None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:27.583262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0b901-00cd-4838-9a0c-b50702bf356c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:27.583378 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0b901-00cd-4838-9a0c-b50702bf356c None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:27.584659 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 624/1247] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:05:27.589880 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ecc8b-6ac7-42aa-85b8-45f0b0b2c64a None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:27.590292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ecc8b-6ac7-42aa-85b8-45f0b0b2c64a None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:27.590432 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ecc8b-6ac7-42aa-85b8-45f0b0b2c64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:27.607210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-4e7ecc8b-6ac7-42aa-85b8-45f0b0b2c64a None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:05:27.613907 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4e7ecc8b-6ac7-42aa-85b8-45f0b0b2c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:05:27.672313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 624/1248] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:05:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:05:27.695221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0b901-00cd-4838-9a0c-b50702bf356c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:27.790648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0b901-00cd-4838-9a0c-b50702bf356c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:27.823102 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cbb0b-bf3d-4af0-b8fd-b3bb207c820d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:27.823907 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cbb0b-bf3d-4af0-b8fd-b3bb207c820d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:27.824186 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cbb0b-bf3d-4af0-b8fd-b3bb207c820d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:27.824459 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cbb0b-bf3d-4af0-b8fd-b3bb207c820d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:27.834856 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cbb0b-bf3d-4af0-b8fd-b3bb207c820d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:05:27.842529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-f90cbb0b-bf3d-4af0-b8fd-b3bb207c820d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:05:27.842529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:27.842529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:27.842529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:27.842529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:27.842529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:27.842529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:27.842529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:27.842529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:27.842529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:27.842529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:27.842529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:27.842529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:05:27.842529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:05:27.842529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:05:27.842529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:05:27.843563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:05:27.843563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:05:27.843563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:05:27.843563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:05:27.843563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:27.843563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:27.843563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:27.843563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:27.843563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:27.843563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:27.843563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:27.843563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:05:27.843563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:27.843563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:27.843563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:27.843563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:27.845160 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:27.845160 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:27.845160 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:27.845160 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:27.845160 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:05:27.845160 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:05:27.845160 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:05:27.845160 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:05:27.845160 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:05:27.845160 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:05:27.845160 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:05:27.845160 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:05:27.845160 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 625/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:05:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:27.850475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ecc8b-6ac7-42aa-85b8-45f0b0b2c64a None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:27.946429 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ecc8b-6ac7-42aa-85b8-45f0b0b2c64a None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:27.980399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a5bd2-9f16-45da-a5ef-b354c198f1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:27.981060 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a5bd2-9f16-45da-a5ef-b354c198f1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:27.981341 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a5bd2-9f16-45da-a5ef-b354c198f1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:27.981617 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a5bd2-9f16-45da-a5ef-b354c198f1d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:27.982354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a5bd2-9f16-45da-a5ef-b354c198f1d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:27.982686 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a5bd2-9f16-45da-a5ef-b354c198f1d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:27.984493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a5bd2-9f16-45da-a5ef-b354c198f1d4 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:27.992656 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 625/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:05:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:27.998390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cbb0b-bf3d-4af0-b8fd-b3bb207c820d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:28.093651 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cbb0b-bf3d-4af0-b8fd-b3bb207c820d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:28.124295 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a219a3d-4c0a-44d8-a68f-fb0ed7a3be17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:28.125064 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a219a3d-4c0a-44d8-a68f-fb0ed7a3be17 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:28.125345 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a219a3d-4c0a-44d8-a68f-fb0ed7a3be17 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:28.125618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a219a3d-4c0a-44d8-a68f-fb0ed7a3be17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:28.135483 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a219a3d-4c0a-44d8-a68f-fb0ed7a3be17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:28.136898 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a219a3d-4c0a-44d8-a68f-fb0ed7a3be17 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:28.154010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-8a219a3d-4c0a-44d8-a68f-fb0ed7a3be17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:28.154010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:28.154010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:28.154010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:28.154010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:28.154010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:28.154010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:28.154010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:28.154010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:28.154010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:28.154010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:28.154010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:28.154010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:05:28.154010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:05:28.154010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:05:28.155684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:05:28.155684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:28.155684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:28.155684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:28.155684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:28.155684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:28.155684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:28.155684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:28.155684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:05:28.155684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:28.155684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:28.155684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:28.155684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:28.155684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:28.155684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:28.155684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:28.155684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:28.156612 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:05:28.156612 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:05:28.156612 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:28.156612 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:05:28.156612 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 626/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:28.162107 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a5bd2-9f16-45da-a5ef-b354c198f1d4 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:28.259341 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a5bd2-9f16-45da-a5ef-b354c198f1d4 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:28.292050 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828796a-6c93-4b25-8864-8614d1b123ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:28.292700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828796a-6c93-4b25-8864-8614d1b123ee None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:28.292981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828796a-6c93-4b25-8864-8614d1b123ee None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:28.299376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828796a-6c93-4b25-8864-8614d1b123ee None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:28.299376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828796a-6c93-4b25-8864-8614d1b123ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:28.299376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828796a-6c93-4b25-8864-8614d1b123ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:28.299376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828796a-6c93-4b25-8864-8614d1b123ee None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:28.307789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 626/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:28.313582 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a219a3d-4c0a-44d8-a68f-fb0ed7a3be17 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:28.408377 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a219a3d-4c0a-44d8-a68f-fb0ed7a3be17 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:28.440576 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252434b-80e9-413c-a283-c89cffd47e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:28.441372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252434b-80e9-413c-a283-c89cffd47e39 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:28.441660 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252434b-80e9-413c-a283-c89cffd47e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:28.441940 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252434b-80e9-413c-a283-c89cffd47e39 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:28.449011 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252434b-80e9-413c-a283-c89cffd47e39 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:28.450460 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252434b-80e9-413c-a283-c89cffd47e39 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:28.464557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-a252434b-80e9-413c-a283-c89cffd47e39 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 21:05:28.464557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:28.464557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:28.464557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:28.464557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:28.464557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:28.464557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:28.464557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:28.464557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:28.464557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:28.464557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:28.464557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:28.464557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:05:28.464557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:05:28.464557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:05:28.464557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:05:28.465687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:28.465687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:28.465687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:05:28.465687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:05:28.465687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:05:28.465687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:05:28.465687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:28.465687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:28.465687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:28.465687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:28.465687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:28.465687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:05:28.465687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:28.465687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:28.465687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:28.465687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:28.465687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:28.465687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:28.467034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:28.467034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:28.467034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:05:28.467034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:05:28.467034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:05:28.467034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:05:28.467034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:05:28.467034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:05:28.467034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 21:05:28.467034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:05:28.467034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 627/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:05:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:28.472059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828796a-6c93-4b25-8864-8614d1b123ee None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:28.568145 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828796a-6c93-4b25-8864-8614d1b123ee None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:28.601880 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749a61f-34c3-480f-aa62-9034fc22a559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:28.602572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749a61f-34c3-480f-aa62-9034fc22a559 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:28.602858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749a61f-34c3-480f-aa62-9034fc22a559 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:28.603126 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749a61f-34c3-480f-aa62-9034fc22a559 None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:28.603965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749a61f-34c3-480f-aa62-9034fc22a559 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:28.604275 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749a61f-34c3-480f-aa62-9034fc22a559 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:28.605697 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749a61f-34c3-480f-aa62-9034fc22a559 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:28.622229 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 627/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Tue May 10 21:05:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:28.628117 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252434b-80e9-413c-a283-c89cffd47e39 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:28.724959 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252434b-80e9-413c-a283-c89cffd47e39 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:28.756678 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d0a33-58ff-452e-89b7-5aa5197948a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:28.757380 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d0a33-58ff-452e-89b7-5aa5197948a9 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:28.757664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d0a33-58ff-452e-89b7-5aa5197948a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:28.757935 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d0a33-58ff-452e-89b7-5aa5197948a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:28.822972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d0a33-58ff-452e-89b7-5aa5197948a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:28.824422 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d0a33-58ff-452e-89b7-5aa5197948a9 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:28.919647 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 628/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:05:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 21:05:28.925665 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749a61f-34c3-480f-aa62-9034fc22a559 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:29.022333 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749a61f-34c3-480f-aa62-9034fc22a559 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:29.055192 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051aa229-3660-4704-a1c2-3b644dc23575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:29.055985 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051aa229-3660-4704-a1c2-3b644dc23575 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:29.056269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051aa229-3660-4704-a1c2-3b644dc23575 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:29.056610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051aa229-3660-4704-a1c2-3b644dc23575 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:29.067001 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051aa229-3660-4704-a1c2-3b644dc23575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:29.068429 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051aa229-3660-4704-a1c2-3b644dc23575 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:29.085970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-051aa229-3660-4704-a1c2-3b644dc23575 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:29.085970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:29.085970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:29.085970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:29.085970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:29.085970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:29.085970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:29.085970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:29.085970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:29.085970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:29.085970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:29.085970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:29.085970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:05:29.085970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:05:29.085970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:05:29.087134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:05:29.087134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:29.087134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:29.087134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:29.087134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:29.087134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:29.087134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:29.087134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:29.087134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:05:29.087134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:29.087134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:29.087134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:29.087134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:29.087134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:29.087134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:29.087134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:29.087134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:29.088101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:05:29.088101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:05:29.088101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:29.088101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:29.088101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 628/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:05:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:29.093096 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d0a33-58ff-452e-89b7-5aa5197948a9 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:29.188090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d0a33-58ff-452e-89b7-5aa5197948a9 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:29.220003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522be7f-df9f-4be5-b598-f0f74c630214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:29.220664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522be7f-df9f-4be5-b598-f0f74c630214 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:29.220950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522be7f-df9f-4be5-b598-f0f74c630214 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:29.221226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522be7f-df9f-4be5-b598-f0f74c630214 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:29.221936 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522be7f-df9f-4be5-b598-f0f74c630214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:29.222243 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522be7f-df9f-4be5-b598-f0f74c630214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:29.223636 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522be7f-df9f-4be5-b598-f0f74c630214 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:29.234313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 629/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:29.240005 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051aa229-3660-4704-a1c2-3b644dc23575 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:29.337987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051aa229-3660-4704-a1c2-3b644dc23575 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:29.371797 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5a761-ceed-43c5-801e-c5a0a76e1848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:29.372581 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5a761-ceed-43c5-801e-c5a0a76e1848 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:29.372864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5a761-ceed-43c5-801e-c5a0a76e1848 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:29.373137 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5a761-ceed-43c5-801e-c5a0a76e1848 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:29.380674 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5a761-ceed-43c5-801e-c5a0a76e1848 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:29.382109 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5a761-ceed-43c5-801e-c5a0a76e1848 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:29.395977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-2ce5a761-ceed-43c5-801e-c5a0a76e1848 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:05:29.395977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:29.395977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:29.395977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:29.395977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:29.395977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:29.395977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:29.395977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:29.395977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:29.395977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:29.395977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:29.395977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:29.395977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:05:29.395977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:05:29.395977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:05:29.397011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:05:29.397011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:29.397011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:29.397011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:29.397011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:29.397011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:29.397011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:29.397011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:29.397011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:05:29.397011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:29.397011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:29.397011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:29.397011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:29.397011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:29.397011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:29.397011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:29.397011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:29.398036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:05:29.398036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:05:29.398036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:05:29.398036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:05:29.398036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:05:29.398036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:05:29.398036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:05:29.398036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:29.398036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 629/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:05:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:29.403020 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522be7f-df9f-4be5-b598-f0f74c630214 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:29.496128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522be7f-df9f-4be5-b598-f0f74c630214 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:29.527636 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0a02e-fc87-45b8-b738-7531fbdb83e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:29.528279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0a02e-fc87-45b8-b738-7531fbdb83e4 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:29.528561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0a02e-fc87-45b8-b738-7531fbdb83e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:29.528835 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0a02e-fc87-45b8-b738-7531fbdb83e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:29.529606 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0a02e-fc87-45b8-b738-7531fbdb83e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:29.529947 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0a02e-fc87-45b8-b738-7531fbdb83e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:29.531553 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0a02e-fc87-45b8-b738-7531fbdb83e4 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:29.543131 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 630/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:05:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:29.549858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5a761-ceed-43c5-801e-c5a0a76e1848 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:29.646631 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5a761-ceed-43c5-801e-c5a0a76e1848 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:29.679683 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47398e9-b794-4ccb-9f5b-5bf7820872f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:29.680368 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47398e9-b794-4ccb-9f5b-5bf7820872f6 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:29.680654 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47398e9-b794-4ccb-9f5b-5bf7820872f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:29.680929 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47398e9-b794-4ccb-9f5b-5bf7820872f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:29.681757 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47398e9-b794-4ccb-9f5b-5bf7820872f6 None admin] RBAC: Adding query filter params (role.id=5cd001edc58744738aa57180c0be68a9, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=9a13ad1e10ff44c4b870b45b7416b70f) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:29.682069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47398e9-b794-4ccb-9f5b-5bf7820872f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:29.683516 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47398e9-b794-4ccb-9f5b-5bf7820872f6 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:29.689381 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 630/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:05:29 2022] GET /identity/v3/role_assignments?user.id=9a13ad1e10ff44c4b870b45b7416b70f&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=5cd001edc58744738aa57180c0be68a9 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:31.867884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482e0ae-0c30-4ee1-b2b3-78b3ec8626a4 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:31.868427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482e0ae-0c30-4ee1-b2b3-78b3ec8626a4 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:31.868427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482e0ae-0c30-4ee1-b2b3-78b3ec8626a4 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:31.869785 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 631/1261] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:05:31.876137 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02122289-038c-4d15-9bc7-78a6b696c89f None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:31.876559 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02122289-038c-4d15-9bc7-78a6b696c89f None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:31.876765 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02122289-038c-4d15-9bc7-78a6b696c89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:31.893179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-02122289-038c-4d15-9bc7-78a6b696c89f None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:05:31.894356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-02122289-038c-4d15-9bc7-78a6b696c89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:05:31.957598 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 631/1262] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:05:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:05:31.980583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482e0ae-0c30-4ee1-b2b3-78b3ec8626a4 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:32.077129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482e0ae-0c30-4ee1-b2b3-78b3ec8626a4 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:32.110077 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df44524-c256-497c-870c-dd246baff588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:32.110886 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df44524-c256-497c-870c-dd246baff588 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:32.111167 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df44524-c256-497c-870c-dd246baff588 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:32.111436 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df44524-c256-497c-870c-dd246baff588 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:32.121425 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df44524-c256-497c-870c-dd246baff588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:05:32.129176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-6df44524-c256-497c-870c-dd246baff588 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:05:32.129176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:32.129176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:32.129176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:32.129176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:32.129176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:32.129176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:32.129176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:32.129176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:32.129176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:32.129176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:32.129176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:32.129176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:05:32.129176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:05:32.129176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:05:32.129176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:05:32.130240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:05:32.130240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:05:32.130240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:05:32.130240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:05:32.130240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:32.130240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:32.130240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:32.130240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:32.130240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:32.130240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:32.130240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:32.130240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:05:32.130240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:32.130240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:32.130240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:32.130240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:32.131723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:32.131723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:32.131723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:32.131723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:32.131723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:05:32.131723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:05:32.131723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:05:32.131723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:05:32.131723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:05:32.131723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:05:32.131723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:05:32.131723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:05:32.131723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 632/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:05:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:32.136486 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02122289-038c-4d15-9bc7-78a6b696c89f None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:32.232652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02122289-038c-4d15-9bc7-78a6b696c89f None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:32.268230 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc65f76-914b-4086-b65a-3e3bae7a6ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:32.268892 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc65f76-914b-4086-b65a-3e3bae7a6ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:32.269177 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc65f76-914b-4086-b65a-3e3bae7a6ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:32.269452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc65f76-914b-4086-b65a-3e3bae7a6ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:32.270192 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc65f76-914b-4086-b65a-3e3bae7a6ae3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:32.270527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc65f76-914b-4086-b65a-3e3bae7a6ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:32.271882 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc65f76-914b-4086-b65a-3e3bae7a6ae3 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:32.280829 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 632/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:05:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:32.286891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df44524-c256-497c-870c-dd246baff588 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:32.382134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df44524-c256-497c-870c-dd246baff588 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:32.415243 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86dbe5-11ca-4517-b11d-f5b200a2c311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:32.416029 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86dbe5-11ca-4517-b11d-f5b200a2c311 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:32.416307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86dbe5-11ca-4517-b11d-f5b200a2c311 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:32.416577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86dbe5-11ca-4517-b11d-f5b200a2c311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:32.427003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86dbe5-11ca-4517-b11d-f5b200a2c311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:32.428428 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86dbe5-11ca-4517-b11d-f5b200a2c311 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:32.444824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-2e86dbe5-11ca-4517-b11d-f5b200a2c311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:32.444824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:32.444824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:32.444824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:32.444824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:32.444824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:32.444824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:32.444824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:32.444824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:32.444824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:32.444824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:32.444824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:32.444824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:05:32.444824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:05:32.444824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:05:32.445912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:05:32.445912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:32.445912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:32.445912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:32.445912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:32.445912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:32.445912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:32.445912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:32.445912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:05:32.445912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:32.445912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:32.445912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:32.445912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:32.445912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:32.445912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:32.445912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:32.445912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:32.447162 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:05:32.447162 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:05:32.447162 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:32.447162 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:05:32.447162 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 633/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:32.452480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc65f76-914b-4086-b65a-3e3bae7a6ae3 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:32.547425 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc65f76-914b-4086-b65a-3e3bae7a6ae3 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:32.580033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a4943-acb8-485f-bb94-e9016c00b1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:32.580752 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a4943-acb8-485f-bb94-e9016c00b1bb None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:32.581034 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a4943-acb8-485f-bb94-e9016c00b1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:32.581309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a4943-acb8-485f-bb94-e9016c00b1bb None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:32.582022 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a4943-acb8-485f-bb94-e9016c00b1bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:32.582325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a4943-acb8-485f-bb94-e9016c00b1bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:32.583737 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a4943-acb8-485f-bb94-e9016c00b1bb None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:32.595689 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 633/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:05:32.601282 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86dbe5-11ca-4517-b11d-f5b200a2c311 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:32.696803 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86dbe5-11ca-4517-b11d-f5b200a2c311 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:32.729123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842053b7-6f96-411f-96f0-e9923979bf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:32.733121 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842053b7-6f96-411f-96f0-e9923979bf9f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:32.733121 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842053b7-6f96-411f-96f0-e9923979bf9f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:32.733121 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842053b7-6f96-411f-96f0-e9923979bf9f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:32.737966 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842053b7-6f96-411f-96f0-e9923979bf9f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:32.739430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842053b7-6f96-411f-96f0-e9923979bf9f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:32.753911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-842053b7-6f96-411f-96f0-e9923979bf9f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 21:05:32.753911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:32.753911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:32.753911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:32.753911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:32.753911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:32.753911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:32.753911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:32.753911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:32.753911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:32.753911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:32.753911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:32.753911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:05:32.753911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:05:32.753911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:05:32.753911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:05:32.755052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:32.755052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:32.755052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:05:32.755052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:05:32.755052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:05:32.755052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:05:32.755052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:32.755052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:32.755052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:32.755052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:32.755052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:32.755052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:05:32.755052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:32.755052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:32.755052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:32.755052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:32.755052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:32.755052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:32.756078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:32.756078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:32.756078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:05:32.756078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:05:32.756078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:05:32.756078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:05:32.756078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:05:32.756078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:05:32.756078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 21:05:32.756078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:05:32.756078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 634/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:05:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:32.761156 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a4943-acb8-485f-bb94-e9016c00b1bb None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:32.859360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a4943-acb8-485f-bb94-e9016c00b1bb None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:32.893067 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6361fbc-9bae-42b0-896c-8e39714d2ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:32.893736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6361fbc-9bae-42b0-896c-8e39714d2ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:32.894020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6361fbc-9bae-42b0-896c-8e39714d2ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:32.894300 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6361fbc-9bae-42b0-896c-8e39714d2ff9 None admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:32.895174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6361fbc-9bae-42b0-896c-8e39714d2ff9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:32.895485 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6361fbc-9bae-42b0-896c-8e39714d2ff9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:32.896904 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6361fbc-9bae-42b0-896c-8e39714d2ff9 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:32.913449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 634/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Tue May 10 21:05:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:32.919162 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842053b7-6f96-411f-96f0-e9923979bf9f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:33.016126 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842053b7-6f96-411f-96f0-e9923979bf9f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:33.048125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48da99-40a8-4425-8db1-2131af68c58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:33.048911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48da99-40a8-4425-8db1-2131af68c58d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:33.049199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48da99-40a8-4425-8db1-2131af68c58d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:33.049478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48da99-40a8-4425-8db1-2131af68c58d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:33.059475 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48da99-40a8-4425-8db1-2131af68c58d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:33.060899 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48da99-40a8-4425-8db1-2131af68c58d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:33.078158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-9e48da99-40a8-4425-8db1-2131af68c58d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:33.078158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:33.078158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:33.078158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:33.078158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:33.078158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:33.078158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:33.078158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:33.078158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:33.078158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:33.078158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:33.078158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:33.078158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:05:33.078158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:05:33.078158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:05:33.079152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:05:33.079152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:33.079152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:33.079152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:33.079152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:33.079152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:33.079152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:33.079152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:33.079152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:05:33.079152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:33.079152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:33.079152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:33.079152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:33.079152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:33.079152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:33.079152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:33.079152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:33.080212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:05:33.080212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:05:33.080212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:33.080212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:05:33.080212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 635/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:33.085081 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6361fbc-9bae-42b0-896c-8e39714d2ff9 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:33.183163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6361fbc-9bae-42b0-896c-8e39714d2ff9 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:33.215407 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa541c-3870-4e88-9ad1-e5f9b25afdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:33.216060 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa541c-3870-4e88-9ad1-e5f9b25afdd3 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:33.216339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa541c-3870-4e88-9ad1-e5f9b25afdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:33.216609 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa541c-3870-4e88-9ad1-e5f9b25afdd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:33.217364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa541c-3870-4e88-9ad1-e5f9b25afdd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:33.217796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa541c-3870-4e88-9ad1-e5f9b25afdd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:33.219175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa541c-3870-4e88-9ad1-e5f9b25afdd3 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:33.230238 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 635/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:33.236366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48da99-40a8-4425-8db1-2131af68c58d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:33.333542 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48da99-40a8-4425-8db1-2131af68c58d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:33.366039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d495f-0559-4055-8efc-2b7fbd32666c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:33.366895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d495f-0559-4055-8efc-2b7fbd32666c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:33.367178 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d495f-0559-4055-8efc-2b7fbd32666c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:33.367453 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d495f-0559-4055-8efc-2b7fbd32666c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:33.373889 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d495f-0559-4055-8efc-2b7fbd32666c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:33.375380 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d495f-0559-4055-8efc-2b7fbd32666c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:33.390201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-5b8d495f-0559-4055-8efc-2b7fbd32666c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:05:33.390201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:33.390201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:33.390201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:33.390201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:33.390201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:33.390201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:33.390201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:33.390201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:33.390201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:33.390201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:33.390201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:33.390201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:05:33.390201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:05:33.390201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:05:33.391308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:05:33.391308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:33.391308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:33.391308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:33.391308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:33.391308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:33.391308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:33.391308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:33.391308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:05:33.391308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:33.391308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:33.391308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:33.391308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:33.391308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:33.391308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:33.391308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:33.391308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:33.392241 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:05:33.392241 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:05:33.392241 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:05:33.392241 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:05:33.392241 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:05:33.392241 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:05:33.392241 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:05:33.392241 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:05:33.392241 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 636/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:05:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:33.397241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa541c-3870-4e88-9ad1-e5f9b25afdd3 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:33.494820 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa541c-3870-4e88-9ad1-e5f9b25afdd3 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:33.527705 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcbb9b-d7e6-45f4-98fc-17806cc2df82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:33.528358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcbb9b-d7e6-45f4-98fc-17806cc2df82 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:33.528647 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcbb9b-d7e6-45f4-98fc-17806cc2df82 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:33.528924 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcbb9b-d7e6-45f4-98fc-17806cc2df82 None admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:33.529778 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcbb9b-d7e6-45f4-98fc-17806cc2df82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:33.530081 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcbb9b-d7e6-45f4-98fc-17806cc2df82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:33.531518 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcbb9b-d7e6-45f4-98fc-17806cc2df82 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:33.543349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 636/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:05:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:33.549713 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d495f-0559-4055-8efc-2b7fbd32666c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:33.645164 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d495f-0559-4055-8efc-2b7fbd32666c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:33.678263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ee027-f6ae-417b-9736-81d763b344ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:33.679185 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ee027-f6ae-417b-9736-81d763b344ed None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:33.679468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ee027-f6ae-417b-9736-81d763b344ed None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:33.679747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ee027-f6ae-417b-9736-81d763b344ed None admin] PATH_INFO: `/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/9a13ad1e10ff44c4b870b45b7416b70f/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:33.681707 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ee027-f6ae-417b-9736-81d763b344ed None admin] RBAC: Authorizing `identity:create_grant(project_id=385eeb55a9ae42eba674de1e83d96e0d, user_id=9a13ad1e10ff44c4b870b45b7416b70f, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:33.683149 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ee027-f6ae-417b-9736-81d763b344ed None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:33.756774 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 637/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 10 21:05:33 2022] PUT /identity/v3/projects/385eeb55a9ae42eba674de1e83d96e0d/users/9a13ad1e10ff44c4b870b45b7416b70f/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:05:35.972952 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d3c07-db0c-46db-98e7-5ae240b5ea74 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:35.973511 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d3c07-db0c-46db-98e7-5ae240b5ea74 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:35.973511 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d3c07-db0c-46db-98e7-5ae240b5ea74 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:35.974880 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 637/1274] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:05:35.980028 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423edd8-8ccc-49eb-84cf-be895b886d74 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:35.980445 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423edd8-8ccc-49eb-84cf-be895b886d74 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:35.980623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423edd8-8ccc-49eb-84cf-be895b886d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:35.996975 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a423edd8-8ccc-49eb-84cf-be895b886d74 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:05:35.998162 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a423edd8-8ccc-49eb-84cf-be895b886d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:05:36.063936 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 638/1275] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:05:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 21:05:36.087452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d3c07-db0c-46db-98e7-5ae240b5ea74 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:36.186494 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d3c07-db0c-46db-98e7-5ae240b5ea74 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:36.219613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60c7a0-a6b9-43b0-b860-076d6e30137c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:36.220439 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60c7a0-a6b9-43b0-b860-076d6e30137c None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:36.220727 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60c7a0-a6b9-43b0-b860-076d6e30137c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:36.221006 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60c7a0-a6b9-43b0-b860-076d6e30137c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:36.231488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60c7a0-a6b9-43b0-b860-076d6e30137c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 21:05:36.239448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-3e60c7a0-a6b9-43b0-b860-076d6e30137c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:05:36.239448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:36.239448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:36.239448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:36.239448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:36.239448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:36.239448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:36.239448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:36.239448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:36.239448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:36.239448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:36.239448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:36.239448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 21:05:36.239448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 21:05:36.239448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 21:05:36.239448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 21:05:36.240606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 21:05:36.240606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 21:05:36.240606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 21:05:36.240606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 21:05:36.240606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:36.240606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:36.240606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:36.240606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:36.240606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:36.240606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:36.240606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:36.240606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:05:36.240606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:36.240606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:36.240606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:36.240606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:36.241693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:36.241693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:36.241693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:36.241693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:36.241693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 21:05:36.241693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 21:05:36.241693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 21:05:36.241693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 21:05:36.241693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 21:05:36.241693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 21:05:36.241693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 21:05:36.241693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:36.241693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 638/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 10 21:05:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:36.246588 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423edd8-8ccc-49eb-84cf-be895b886d74 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:36.341664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423edd8-8ccc-49eb-84cf-be895b886d74 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:36.378303 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b5bbd-4fb2-4c12-bbaa-8af62187e3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:36.379054 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b5bbd-4fb2-4c12-bbaa-8af62187e3ac None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:36.379355 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b5bbd-4fb2-4c12-bbaa-8af62187e3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:36.379633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b5bbd-4fb2-4c12-bbaa-8af62187e3ac None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:36.380404 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b5bbd-4fb2-4c12-bbaa-8af62187e3ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:36.380728 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b5bbd-4fb2-4c12-bbaa-8af62187e3ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:36.382131 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b5bbd-4fb2-4c12-bbaa-8af62187e3ac None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:36.391867 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 639/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 10 21:05:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:36.397920 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60c7a0-a6b9-43b0-b860-076d6e30137c None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:36.504885 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60c7a0-a6b9-43b0-b860-076d6e30137c None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:36.539410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa8ae1-71f0-4cc7-8afb-d93eb58819df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:36.540213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa8ae1-71f0-4cc7-8afb-d93eb58819df None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:36.540493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa8ae1-71f0-4cc7-8afb-d93eb58819df None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:36.540766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa8ae1-71f0-4cc7-8afb-d93eb58819df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:36.554185 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa8ae1-71f0-4cc7-8afb-d93eb58819df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:36.555699 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa8ae1-71f0-4cc7-8afb-d93eb58819df None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:36.574402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-94fa8ae1-71f0-4cc7-8afb-d93eb58819df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:36.574402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:36.574402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:36.574402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:36.574402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:36.574402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:36.574402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:36.574402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:36.574402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:36.574402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:36.574402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:36.574402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:36.574402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:05:36.574402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:05:36.574402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:05:36.575610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:05:36.575610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:36.575610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:36.575610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:36.575610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:36.575610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:36.575610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:36.575610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:36.575610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:05:36.575610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:36.575610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:36.575610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:36.575610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:36.575610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:36.575610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:36.575610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:36.575610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:36.576770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:05:36.576770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:05:36.576770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:36.576770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:36.576770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 639/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:36.581941 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b5bbd-4fb2-4c12-bbaa-8af62187e3ac None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:36.684367 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b5bbd-4fb2-4c12-bbaa-8af62187e3ac None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:36.719388 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ed509-2846-4ff0-bfdd-e6af436266b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:36.720059 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ed509-2846-4ff0-bfdd-e6af436266b6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:36.720345 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ed509-2846-4ff0-bfdd-e6af436266b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:36.720622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ed509-2846-4ff0-bfdd-e6af436266b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:36.721350 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ed509-2846-4ff0-bfdd-e6af436266b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:36.721653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ed509-2846-4ff0-bfdd-e6af436266b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:36.723048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ed509-2846-4ff0-bfdd-e6af436266b6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:36.735433 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 640/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:36.741283 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa8ae1-71f0-4cc7-8afb-d93eb58819df None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:36.844044 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa8ae1-71f0-4cc7-8afb-d93eb58819df None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:36.877686 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46379e8a-d115-42d4-ab37-e9d6a7f6895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:36.878655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46379e8a-d115-42d4-ab37-e9d6a7f6895c None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:36.878950 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46379e8a-d115-42d4-ab37-e9d6a7f6895c None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:36.888838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46379e8a-d115-42d4-ab37-e9d6a7f6895c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:36.888838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46379e8a-d115-42d4-ab37-e9d6a7f6895c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:36.888838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46379e8a-d115-42d4-ab37-e9d6a7f6895c None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:36.902503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-46379e8a-d115-42d4-ab37-e9d6a7f6895c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 21:05:36.902503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:36.902503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:36.902503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:36.902503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:36.902503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:36.902503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:36.902503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:36.902503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:36.902503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:36.902503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:36.902503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:36.902503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 21:05:36.902503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 21:05:36.902503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 21:05:36.902503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 21:05:36.903495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:36.903495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:36.903495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 21:05:36.903495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:05:36.903495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 21:05:36.903495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 21:05:36.903495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:36.903495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:36.903495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:36.903495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:36.903495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:36.903495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:05:36.903495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:36.903495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:36.903495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:36.903495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:36.903495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:36.903495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:36.904480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:36.904480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:36.904480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 21:05:36.904480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 21:05:36.904480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 21:05:36.904480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 21:05:36.904480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 21:05:36.904480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 21:05:36.904480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 21:05:36.904480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:36.904480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 640/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:05:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:36.910528 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ed509-2846-4ff0-bfdd-e6af436266b6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:37.003890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ed509-2846-4ff0-bfdd-e6af436266b6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:37.036469 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5542d0-0038-4fe3-8324-fc68dc4d88cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:37.037156 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5542d0-0038-4fe3-8324-fc68dc4d88cc None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:37.037429 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5542d0-0038-4fe3-8324-fc68dc4d88cc None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:37.037707 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5542d0-0038-4fe3-8324-fc68dc4d88cc None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:37.038569 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5542d0-0038-4fe3-8324-fc68dc4d88cc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:37.038881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5542d0-0038-4fe3-8324-fc68dc4d88cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:37.040313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5542d0-0038-4fe3-8324-fc68dc4d88cc None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:37.057047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 641/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Tue May 10 21:05:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:37.062792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46379e8a-d115-42d4-ab37-e9d6a7f6895c None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:37.158138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46379e8a-d115-42d4-ab37-e9d6a7f6895c None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:37.190382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6ec87-ff14-48d4-bc00-050c055642f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:37.191109 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6ec87-ff14-48d4-bc00-050c055642f5 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:37.191388 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6ec87-ff14-48d4-bc00-050c055642f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:37.191661 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6ec87-ff14-48d4-bc00-050c055642f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:37.255289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6ec87-ff14-48d4-bc00-050c055642f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:37.256730 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6ec87-ff14-48d4-bc00-050c055642f5 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:37.357579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 641/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 10 21:05:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 21:05:37.363884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5542d0-0038-4fe3-8324-fc68dc4d88cc None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:37.459967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5542d0-0038-4fe3-8324-fc68dc4d88cc None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:37.492543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2039c-b345-44fa-97bb-f94b54baa2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:37.493315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2039c-b345-44fa-97bb-f94b54baa2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:37.493596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2039c-b345-44fa-97bb-f94b54baa2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:37.493865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2039c-b345-44fa-97bb-f94b54baa2e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:37.504171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2039c-b345-44fa-97bb-f94b54baa2e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:37.505719 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2039c-b345-44fa-97bb-f94b54baa2e3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:37.522695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-0cc2039c-b345-44fa-97bb-f94b54baa2e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:37.522695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:37.522695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:37.522695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:37.522695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:37.522695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:37.522695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:37.522695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:37.522695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:37.522695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:37.522695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:37.522695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:37.522695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 21:05:37.522695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 21:05:37.522695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 21:05:37.523787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 21:05:37.523787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:37.523787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:37.523787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:37.523787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:37.523787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:37.523787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:37.523787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:37.523787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:05:37.523787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:37.523787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:37.523787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:37.523787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:37.523787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:37.523787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:37.523787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:37.523787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:37.524918 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 21:05:37.524918 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 21:05:37.524918 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 21:05:37.524918 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:05:37.524918 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 642/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:37.529537 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6ec87-ff14-48d4-bc00-050c055642f5 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:37.625715 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6ec87-ff14-48d4-bc00-050c055642f5 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:37.658343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f310d54-e935-41a4-810c-7f71fbccb5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:37.659280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f310d54-e935-41a4-810c-7f71fbccb5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:37.659570 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f310d54-e935-41a4-810c-7f71fbccb5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:37.659851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f310d54-e935-41a4-810c-7f71fbccb5e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:37.660562 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f310d54-e935-41a4-810c-7f71fbccb5e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:37.660870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f310d54-e935-41a4-810c-7f71fbccb5e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:37.662225 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f310d54-e935-41a4-810c-7f71fbccb5e9 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:37.673865 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 642/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 10 21:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:37.679518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2039c-b345-44fa-97bb-f94b54baa2e3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:37.773405 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2039c-b345-44fa-97bb-f94b54baa2e3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:37.806352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0df4c-625d-4397-be47-0bf85639efc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:37.812259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0df4c-625d-4397-be47-0bf85639efc9 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:37.812259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0df4c-625d-4397-be47-0bf85639efc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:37.812259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0df4c-625d-4397-be47-0bf85639efc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:37.814170 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0df4c-625d-4397-be47-0bf85639efc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:37.815618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0df4c-625d-4397-be47-0bf85639efc9 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:37.829357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-c6f0df4c-625d-4397-be47-0bf85639efc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:05:37.829357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:37.829357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:37.829357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:37.829357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:37.829357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:37.829357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:37.829357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:37.829357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:37.829357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:37.829357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:37.829357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:37.829357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 21:05:37.829357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 21:05:37.829357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 21:05:37.830296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 21:05:37.830296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:37.830296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:37.830296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:37.830296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:37.830296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:37.830296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:37.830296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:37.830296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( May 10 21:05:37.830296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:37.830296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:37.830296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:37.830296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:37.830296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:37.830296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:37.830296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:37.830296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:37.831270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:05:37.831270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:05:37.831270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:05:37.831270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:05:37.831270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:05:37.831270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:05:37.831270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 21:05:37.831270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: ERROR keystone.server.flask.application May 10 21:05:37.831270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 643/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 10 21:05:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:37.836446 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f310d54-e935-41a4-810c-7f71fbccb5e9 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:37.932711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f310d54-e935-41a4-810c-7f71fbccb5e9 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:37.964875 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7a9e0-bd81-4ee0-a685-655b15a56b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:37.965526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7a9e0-bd81-4ee0-a685-655b15a56b77 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:37.965813 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7a9e0-bd81-4ee0-a685-655b15a56b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:37.966093 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7a9e0-bd81-4ee0-a685-655b15a56b77 None admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:37.966910 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7a9e0-bd81-4ee0-a685-655b15a56b77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:37.967224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7a9e0-bd81-4ee0-a685-655b15a56b77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:37.969359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7a9e0-bd81-4ee0-a685-655b15a56b77 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:37.980805 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 643/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 10 21:05:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:05:37.986927 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0df4c-625d-4397-be47-0bf85639efc9 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:38.083010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0df4c-625d-4397-be47-0bf85639efc9 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:38.114317 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b075d9-afc3-47a6-9973-ab2d5752ddb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:38.114980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b075d9-afc3-47a6-9973-ab2d5752ddb0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:38.115260 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b075d9-afc3-47a6-9973-ab2d5752ddb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:38.115535 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b075d9-afc3-47a6-9973-ab2d5752ddb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:38.116349 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b075d9-afc3-47a6-9973-ab2d5752ddb0 None admin] RBAC: Adding query filter params (role.id=5cd001edc58744738aa57180c0be68a9, scope.project.id=385eeb55a9ae42eba674de1e83d96e0d, user.id=9a13ad1e10ff44c4b870b45b7416b70f) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:38.116755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b075d9-afc3-47a6-9973-ab2d5752ddb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:38.118158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b075d9-afc3-47a6-9973-ab2d5752ddb0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:38.123679 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 644/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 10 21:05:37 2022] GET /identity/v3/role_assignments?user.id=9a13ad1e10ff44c4b870b45b7416b70f&scope.project.id=385eeb55a9ae42eba674de1e83d96e0d&role.id=5cd001edc58744738aa57180c0be68a9 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:40.471442 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5d972-8edb-4335-8885-c73296def289 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:40.498195 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5d972-8edb-4335-8885-c73296def289 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:40.498195 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5d972-8edb-4335-8885-c73296def289 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:40.498195 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 644/1288] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:05:40.498508 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa271adb-cfa9-4b86-bba7-1bcb1dc87fbe None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:40.498508 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa271adb-cfa9-4b86-bba7-1bcb1dc87fbe None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:40.498508 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa271adb-cfa9-4b86-bba7-1bcb1dc87fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:40.498508 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-aa271adb-cfa9-4b86-bba7-1bcb1dc87fbe None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:05:40.498508 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-aa271adb-cfa9-4b86-bba7-1bcb1dc87fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:05:40.559753 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 645/1289] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:05:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:05:40.582403 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5d972-8edb-4335-8885-c73296def289 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:40.678839 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5d972-8edb-4335-8885-c73296def289 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:40.712176 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a5a79-a2ca-4f86-bfc3-83d8596b31e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:40.712986 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a5a79-a2ca-4f86-bfc3-83d8596b31e1 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:40.713267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a5a79-a2ca-4f86-bfc3-83d8596b31e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:40.713539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a5a79-a2ca-4f86-bfc3-83d8596b31e1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:40.714179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a5a79-a2ca-4f86-bfc3-83d8596b31e1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:40.715566 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a5a79-a2ca-4f86-bfc3-83d8596b31e1 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:40.727354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-fb7a5a79-a2ca-4f86-bfc3-83d8596b31e1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 21:05:40.727354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:40.727354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:05:40.727354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:05:40.727354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:05:40.727354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:05:40.727354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:05:40.727354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:05:40.727354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 21:05:40.727354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:40.727354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:05:40.727354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:40.727354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:40.727354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:40.727354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:40.727354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:40.727354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:40.728720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:40.728720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:40.728720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:40.728720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:40.728720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:40.728720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:40.728720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:05:40.728720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:05:40.728720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:05:40.728720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:05:40.728720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:40.728720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:40.728720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:40.728720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:40.728720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:40.728720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:40.729949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:40.729949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:05:40.729949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:40.729949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:40.729949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:40.729949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:40.729949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:40.729949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:40.729949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:40.729949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:40.729949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:05:40.729949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:05:40.729949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 21:05:40.729949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:40.729949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 645/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Tue May 10 21:05:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:40.734602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa271adb-cfa9-4b86-bba7-1bcb1dc87fbe None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:40.829302 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa271adb-cfa9-4b86-bba7-1bcb1dc87fbe None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:40.862515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad2bd3-ae74-434d-9db3-25990e7af3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:40.863181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad2bd3-ae74-434d-9db3-25990e7af3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:40.863467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad2bd3-ae74-434d-9db3-25990e7af3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:40.863743 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad2bd3-ae74-434d-9db3-25990e7af3b5 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:40.864445 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad2bd3-ae74-434d-9db3-25990e7af3b5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:40.864753 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad2bd3-ae74-434d-9db3-25990e7af3b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:40.866099 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad2bd3-ae74-434d-9db3-25990e7af3b5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:40.870857 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 646/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Tue May 10 21:05:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:40.876643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a5a79-a2ca-4f86-bfc3-83d8596b31e1 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:40.974610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a5a79-a2ca-4f86-bfc3-83d8596b31e1 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:41.007356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ac5db-995d-46c4-894f-40ee060d20ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:41.007946 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ac5db-995d-46c4-894f-40ee060d20ab None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:41.008230 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ac5db-995d-46c4-894f-40ee060d20ab None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:41.008506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ac5db-995d-46c4-894f-40ee060d20ab None admin] PATH_INFO: `/v3/services` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:41.009207 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ac5db-995d-46c4-894f-40ee060d20ab None admin] RBAC: Adding query filter params (type=placement) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:41.009514 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ac5db-995d-46c4-894f-40ee060d20ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:41.010902 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ac5db-995d-46c4-894f-40ee060d20ab None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:41.016087 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 646/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Tue May 10 21:05:40 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:43.201106 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebb9bc-267d-4dd1-aa62-b2c175b3c5f2 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:43.201675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebb9bc-267d-4dd1-aa62-b2c175b3c5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:43.201675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebb9bc-267d-4dd1-aa62-b2c175b3c5f2 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:43.203603 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 647/1293] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:05:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:05:43.208722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3626b-fd0e-4b5f-83f6-9bc4d7f5c34b None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:43.209113 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3626b-fd0e-4b5f-83f6-9bc4d7f5c34b None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:43.209280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3626b-fd0e-4b5f-83f6-9bc4d7f5c34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:43.225667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-1ea3626b-fd0e-4b5f-83f6-9bc4d7f5c34b None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:05:43.226853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-1ea3626b-fd0e-4b5f-83f6-9bc4d7f5c34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:05:43.291717 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 647/1294] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:05:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:05:43.315952 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebb9bc-267d-4dd1-aa62-b2c175b3c5f2 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:43.412717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebb9bc-267d-4dd1-aa62-b2c175b3c5f2 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:43.449987 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46583b0c-b27c-4c90-98e9-7fe6baa17c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:43.451229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46583b0c-b27c-4c90-98e9-7fe6baa17c11 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:43.451703 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46583b0c-b27c-4c90-98e9-7fe6baa17c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:43.452251 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46583b0c-b27c-4c90-98e9-7fe6baa17c11 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:43.453679 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46583b0c-b27c-4c90-98e9-7fe6baa17c11 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:43.456251 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46583b0c-b27c-4c90-98e9-7fe6baa17c11 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:43.551152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 648/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 10 21:05:43 2022] POST /identity/v3/services => generated 246 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:05:45.814210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc4164-c523-49ea-baee-be81f5c8e2a3 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:45.814871 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc4164-c523-49ea-baee-be81f5c8e2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:45.814871 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc4164-c523-49ea-baee-be81f5c8e2a3 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:45.816364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 648/1296] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:05:45.821517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9344e-3ade-4d53-bbb6-13a3005bb659 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:45.821910 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9344e-3ade-4d53-bbb6-13a3005bb659 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:45.822075 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9344e-3ade-4d53-bbb6-13a3005bb659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:45.839475 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-c9c9344e-3ade-4d53-bbb6-13a3005bb659 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:05:45.840709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c9c9344e-3ade-4d53-bbb6-13a3005bb659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:05:45.915608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 649/1297] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:05:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:05:45.939290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc4164-c523-49ea-baee-be81f5c8e2a3 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:46.043760 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc4164-c523-49ea-baee-be81f5c8e2a3 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:46.076234 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7d2cf-5985-47e7-a9c9-82c1779a26d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:46.076961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7d2cf-5985-47e7-a9c9-82c1779a26d4 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:46.077783 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7d2cf-5985-47e7-a9c9-82c1779a26d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:46.078229 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7d2cf-5985-47e7-a9c9-82c1779a26d4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:46.078916 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f7d2cf-5985-47e7-a9c9-82c1779a26d4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:46.080258 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f7d2cf-5985-47e7-a9c9-82c1779a26d4 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:46.091695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-c1f7d2cf-5985-47e7-a9c9-82c1779a26d4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 21:05:46.091695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:46.091695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:05:46.091695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:05:46.091695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:05:46.091695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:05:46.091695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:05:46.091695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:05:46.091695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 21:05:46.091695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:46.091695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:05:46.091695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:46.091695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:46.091695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:46.091695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:46.091695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:46.091695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:46.093503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:46.093503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:46.093503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:46.093503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:46.093503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:46.093503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:46.093503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:05:46.093503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:05:46.093503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:05:46.093503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:05:46.093503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:46.093503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:46.093503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:46.093503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:46.093503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:46.093503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:46.094358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:46.094358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:05:46.094358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:46.094358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:46.094358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:46.094358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:46.094358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:46.094358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:46.094358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:46.094358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:46.094358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:05:46.094358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:05:46.094358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 21:05:46.094358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:46.094358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 649/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Tue May 10 21:05:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:46.099608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9344e-3ade-4d53-bbb6-13a3005bb659 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:46.192425 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9344e-3ade-4d53-bbb6-13a3005bb659 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:46.224919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f79f8-4af3-43b7-b966-97894ab85d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:46.225585 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f79f8-4af3-43b7-b966-97894ab85d00 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:46.225869 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f79f8-4af3-43b7-b966-97894ab85d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:46.226141 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f79f8-4af3-43b7-b966-97894ab85d00 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:46.226879 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f79f8-4af3-43b7-b966-97894ab85d00 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:46.227185 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f79f8-4af3-43b7-b966-97894ab85d00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:46.228543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f79f8-4af3-43b7-b966-97894ab85d00 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:46.233743 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 650/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Tue May 10 21:05:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:46.239815 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7d2cf-5985-47e7-a9c9-82c1779a26d4 None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:46.337713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7d2cf-5985-47e7-a9c9-82c1779a26d4 None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:46.370100 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76c382-d745-461d-b8b4-90075cbfb9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:46.370771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76c382-d745-461d-b8b4-90075cbfb9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:46.371053 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76c382-d745-461d-b8b4-90075cbfb9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:46.371326 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76c382-d745-461d-b8b4-90075cbfb9b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:46.372129 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76c382-d745-461d-b8b4-90075cbfb9b3 None admin] RBAC: Adding query filter params (interface=public, service_id=484b48f91ced4afd84f06c6bb68d3bbf, region_id=RegionOne) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:46.372448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76c382-d745-461d-b8b4-90075cbfb9b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:46.373790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76c382-d745-461d-b8b4-90075cbfb9b3 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:46.379377 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 650/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Tue May 10 21:05:46 2022] GET /identity/v3/endpoints?service_id=484b48f91ced4afd84f06c6bb68d3bbf&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:46.384925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f79f8-4af3-43b7-b966-97894ab85d00 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:46.480795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f79f8-4af3-43b7-b966-97894ab85d00 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:46.513190 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5625cf-d5ee-4675-b946-b6af8067011a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:46.513856 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5625cf-d5ee-4675-b946-b6af8067011a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:46.514127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5625cf-d5ee-4675-b946-b6af8067011a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:46.514405 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5625cf-d5ee-4675-b946-b6af8067011a None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:46.516117 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5625cf-d5ee-4675-b946-b6af8067011a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:46.517459 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5625cf-d5ee-4675-b946-b6af8067011a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:46.524010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 651/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Tue May 10 21:05:46 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:05:48.716540 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be043ec7-d6b2-4d12-80e9-10bbff0b37f1 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:48.717146 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be043ec7-d6b2-4d12-80e9-10bbff0b37f1 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:48.717146 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be043ec7-d6b2-4d12-80e9-10bbff0b37f1 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:48.718833 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 651/1302] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:05:48.724084 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2d623-77e1-4c06-b4ba-82f9bcd03601 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:48.724981 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2d623-77e1-4c06-b4ba-82f9bcd03601 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:48.724981 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2d623-77e1-4c06-b4ba-82f9bcd03601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:48.740764 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b6d2d623-77e1-4c06-b4ba-82f9bcd03601 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:05:48.741922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b6d2d623-77e1-4c06-b4ba-82f9bcd03601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:05:48.804996 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 652/1303] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:05:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 21:05:48.828485 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be043ec7-d6b2-4d12-80e9-10bbff0b37f1 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:48.927269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be043ec7-d6b2-4d12-80e9-10bbff0b37f1 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:48.961777 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790f85f-5c78-4e7a-b199-8a56349437cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:48.962595 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790f85f-5c78-4e7a-b199-8a56349437cb None admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:48.962877 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790f85f-5c78-4e7a-b199-8a56349437cb None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:48.963148 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790f85f-5c78-4e7a-b199-8a56349437cb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:48.963790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790f85f-5c78-4e7a-b199-8a56349437cb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:48.965133 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790f85f-5c78-4e7a-b199-8a56349437cb None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:48.976563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application [None req-6790f85f-5c78-4e7a-b199-8a56349437cb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 21:05:48.976563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:48.976563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 21:05:48.976563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 21:05:48.976563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 21:05:48.976563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 21:05:48.976563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 21:05:48.976563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:05:48.976563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 21:05:48.976563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:48.976563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 21:05:48.976563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:48.976563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:05:48.976563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:05:48.976563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:05:48.976563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:05:48.976563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:05:48.977850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:05:48.977850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:05:48.977850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:05:48.977850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:05:48.977850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:05:48.977850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:05:48.977850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 21:05:48.977850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 21:05:48.977850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 21:05:48.977850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 21:05:48.977850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:05:48.977850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:05:48.977850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:05:48.977850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:05:48.977850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:05:48.977850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:05:48.978821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:05:48.978821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application with Lock( May 10 21:05:48.978821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:05:48.978821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self._enter() May 10 21:05:48.978821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:05:48.978821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:05:48.978821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:05:48.978821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application return self.creator() May 10 21:05:48.978821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:05:48.978821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application created_value = creator( May 10 21:05:48.978821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 21:05:48.978821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 21:05:48.978821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 21:05:48.978821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: ERROR keystone.server.flask.application May 10 21:05:48.978821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 652/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Tue May 10 21:05:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 21:05:48.984320 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2d623-77e1-4c06-b4ba-82f9bcd03601 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:49.078303 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2d623-77e1-4c06-b4ba-82f9bcd03601 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:49.110803 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9e5bc-3d41-42f3-87ea-a382526eec54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:49.111457 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9e5bc-3d41-42f3-87ea-a382526eec54 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:49.111738 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9e5bc-3d41-42f3-87ea-a382526eec54 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:49.112015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9e5bc-3d41-42f3-87ea-a382526eec54 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:49.112707 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9e5bc-3d41-42f3-87ea-a382526eec54 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:49.113008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9e5bc-3d41-42f3-87ea-a382526eec54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:49.114382 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9e5bc-3d41-42f3-87ea-a382526eec54 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:49.119334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 653/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Tue May 10 21:05:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:05:49.125904 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790f85f-5c78-4e7a-b199-8a56349437cb None admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:49.221436 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790f85f-5c78-4e7a-b199-8a56349437cb None admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:49.253802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f96c7-829f-4873-a76f-d261c8cecb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:49.254379 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f96c7-829f-4873-a76f-d261c8cecb42 None admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:49.254687 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f96c7-829f-4873-a76f-d261c8cecb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:49.254960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f96c7-829f-4873-a76f-d261c8cecb42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:49.255697 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f96c7-829f-4873-a76f-d261c8cecb42 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:49.257036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f96c7-829f-4873-a76f-d261c8cecb42 None admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:49.391789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 653/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Tue May 10 21:05:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:11:19.392172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee22411-c4a3-45fa-bfbc-2b4b0c221e67 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:19.393071 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee22411-c4a3-45fa-bfbc-2b4b0c221e67 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:19.393506 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee22411-c4a3-45fa-bfbc-2b4b0c221e67 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:19.395069 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 654/1307] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:11:19.400459 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4c759-aa0b-48ca-8d07-3f9645206a15 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:19.401235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4c759-aa0b-48ca-8d07-3f9645206a15 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:19.401686 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4c759-aa0b-48ca-8d07-3f9645206a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:19.474111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-7dc4c759-aa0b-48ca-8d07-3f9645206a15 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:19.477863 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-7dc4c759-aa0b-48ca-8d07-3f9645206a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:19.662571 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 654/1308] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:19.694478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53019055-2737-4a63-b0e6-6d1f7d0b78bd None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:19.694781 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53019055-2737-4a63-b0e6-6d1f7d0b78bd None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:19.695151 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53019055-2737-4a63-b0e6-6d1f7d0b78bd None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:19.697323 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 655/1309] 10.222.0.25 () {54 vars in 964 bytes} [Tue May 10 21:11:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:11:19.703459 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe152775-2e13-414f-8a37-0aba7df596ad None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:19.703747 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe152775-2e13-414f-8a37-0aba7df596ad None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:19.704455 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe152775-2e13-414f-8a37-0aba7df596ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:19.797460 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-fe152775-2e13-414f-8a37-0aba7df596ad None None] MFA Rules not processed for user `2fa7da0ccf954be1a582411cdc617b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:19.798802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-fe152775-2e13-414f-8a37-0aba7df596ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:19.882234 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 655/1310] 10.222.0.25 () {58 vars in 1061 bytes} [Tue May 10 21:11:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:19.891653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53019055-2737-4a63-b0e6-6d1f7d0b78bd None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:19.893444 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-53019055-2737-4a63-b0e6-6d1f7d0b78bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:20.008941 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53019055-2737-4a63-b0e6-6d1f7d0b78bd None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:20.083379 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae59a6-4c62-473b-a8b0-d50c6e99e6aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:20.083947 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae59a6-4c62-473b-a8b0-d50c6e99e6aa service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:20.084234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae59a6-4c62-473b-a8b0-d50c6e99e6aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:20.084699 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae59a6-4c62-473b-a8b0-d50c6e99e6aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:20.086328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9dae59a6-4c62-473b-a8b0-d50c6e99e6aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:20.193648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae59a6-4c62-473b-a8b0-d50c6e99e6aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:20.195725 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae59a6-4c62-473b-a8b0-d50c6e99e6aa service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:20.215046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 656/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:11:22.734211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad2651-ca1a-4362-99df-2687c3152748 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:22.734765 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad2651-ca1a-4362-99df-2687c3152748 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:22.734874 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad2651-ca1a-4362-99df-2687c3152748 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:22.736393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 656/1312] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:11:22.742760 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549d978-0962-474f-ba33-59261aa5ca45 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:22.743216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549d978-0962-474f-ba33-59261aa5ca45 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:22.743321 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549d978-0962-474f-ba33-59261aa5ca45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:22.848768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6549d978-0962-474f-ba33-59261aa5ca45 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:22.850410 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6549d978-0962-474f-ba33-59261aa5ca45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:22.948383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 657/1313] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:22.986566 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad2651-ca1a-4362-99df-2687c3152748 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:22.988175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-67ad2651-ca1a-4362-99df-2687c3152748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:23.095485 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad2651-ca1a-4362-99df-2687c3152748 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:23.169356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5e6fa-1c55-4697-b9f1-bf1b5a5e2329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:23.170017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5e6fa-1c55-4697-b9f1-bf1b5a5e2329 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:23.170302 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5e6fa-1c55-4697-b9f1-bf1b5a5e2329 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:23.170616 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5e6fa-1c55-4697-b9f1-bf1b5a5e2329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:23.172290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a6b5e6fa-1c55-4697-b9f1-bf1b5a5e2329 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:23.281351 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5e6fa-1c55-4697-b9f1-bf1b5a5e2329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:23.282833 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5e6fa-1c55-4697-b9f1-bf1b5a5e2329 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:23.305755 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 657/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:11:26.037009 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29174051-3767-4c11-aae2-49039921632a None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:26.038239 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29174051-3767-4c11-aae2-49039921632a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:26.038239 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29174051-3767-4c11-aae2-49039921632a None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:26.039578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 658/1315] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:11:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:11:26.044841 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6be9d-ffa6-4b9c-99a5-b2b8e3399258 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:26.045245 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6be9d-ffa6-4b9c-99a5-b2b8e3399258 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:26.045398 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6be9d-ffa6-4b9c-99a5-b2b8e3399258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:26.107530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-a4c6be9d-ffa6-4b9c-99a5-b2b8e3399258 None None] MFA Rules not processed for user `33781cd02a6e417a9a09ee0ca6390d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:26.108719 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a4c6be9d-ffa6-4b9c-99a5-b2b8e3399258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:26.199313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 658/1316] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:11:26 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:26.239228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29174051-3767-4c11-aae2-49039921632a None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:26.240783 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-29174051-3767-4c11-aae2-49039921632a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:26.339961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29174051-3767-4c11-aae2-49039921632a None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:26.413753 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f1d2f-c222-47cc-a2ea-009dd2c9cbd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:26.414405 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f1d2f-c222-47cc-a2ea-009dd2c9cbd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:26.414726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f1d2f-c222-47cc-a2ea-009dd2c9cbd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:26.415002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f1d2f-c222-47cc-a2ea-009dd2c9cbd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:26.416639 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c53f1d2f-c222-47cc-a2ea-009dd2c9cbd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:26.518728 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f1d2f-c222-47cc-a2ea-009dd2c9cbd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:26.520152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f1d2f-c222-47cc-a2ea-009dd2c9cbd3 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:26.538815 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 659/1317] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:11:26 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:11:29.526093 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d99b34-d628-46ab-b015-fce366d4e934 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:29.526716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d99b34-d628-46ab-b015-fce366d4e934 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:29.526716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d99b34-d628-46ab-b015-fce366d4e934 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:29.528090 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 659/1318] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:11:29.533303 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b965e3-68d8-4395-ac56-c676aa33fab2 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:29.533712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b965e3-68d8-4395-ac56-c676aa33fab2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:29.533863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b965e3-68d8-4395-ac56-c676aa33fab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:29.597127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-34b965e3-68d8-4395-ac56-c676aa33fab2 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:29.598316 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-34b965e3-68d8-4395-ac56-c676aa33fab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:29.688768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 660/1319] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:11:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:29.744211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fb047-f12a-48ff-9044-4dcec43f8680 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:29.744503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fb047-f12a-48ff-9044-4dcec43f8680 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:29.744786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fb047-f12a-48ff-9044-4dcec43f8680 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:29.746142 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 660/1320] 10.222.0.25 () {54 vars in 964 bytes} [Tue May 10 21:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:11:29.752627 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c989a5-cff2-43ca-946e-5dc9fe3f09c7 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:29.752922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c989a5-cff2-43ca-946e-5dc9fe3f09c7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:29.753203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c989a5-cff2-43ca-946e-5dc9fe3f09c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:29.824247 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-01c989a5-cff2-43ca-946e-5dc9fe3f09c7 None None] MFA Rules not processed for user `2fa7da0ccf954be1a582411cdc617b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:29.825479 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-01c989a5-cff2-43ca-946e-5dc9fe3f09c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:29.897556 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 661/1321] 10.222.0.25 () {58 vars in 1061 bytes} [Tue May 10 21:11:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:29.906418 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fb047-f12a-48ff-9044-4dcec43f8680 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:29.907991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-026fb047-f12a-48ff-9044-4dcec43f8680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:30.008899 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fb047-f12a-48ff-9044-4dcec43f8680 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:30.079958 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577ff3e-07ea-45fb-96f7-8cad784ea2e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:30.080605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577ff3e-07ea-45fb-96f7-8cad784ea2e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:30.080886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577ff3e-07ea-45fb-96f7-8cad784ea2e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:30.081165 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577ff3e-07ea-45fb-96f7-8cad784ea2e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:30.082843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e577ff3e-07ea-45fb-96f7-8cad784ea2e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:30.189868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577ff3e-07ea-45fb-96f7-8cad784ea2e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:30.191336 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577ff3e-07ea-45fb-96f7-8cad784ea2e2 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:30.211200 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 661/1322] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:11:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:11:33.788225 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a82144-2421-4257-bc1b-79806998c9fd None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:33.788736 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a82144-2421-4257-bc1b-79806998c9fd None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:33.788736 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a82144-2421-4257-bc1b-79806998c9fd None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:33.790074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 662/1323] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:11:33.795325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0953f-5cc8-483e-8ef4-0d6f0aa69961 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:33.795742 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0953f-5cc8-483e-8ef4-0d6f0aa69961 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:33.795885 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0953f-5cc8-483e-8ef4-0d6f0aa69961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:33.861967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-77b0953f-5cc8-483e-8ef4-0d6f0aa69961 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:33.863204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-77b0953f-5cc8-483e-8ef4-0d6f0aa69961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:33.960641 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 662/1324] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:33.996404 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a82144-2421-4257-bc1b-79806998c9fd None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:33.997930 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a1a82144-2421-4257-bc1b-79806998c9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:34.100363 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a82144-2421-4257-bc1b-79806998c9fd None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:34.172504 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86f3f4-2683-433a-8b73-580878d20972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:34.173151 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86f3f4-2683-433a-8b73-580878d20972 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:34.173438 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86f3f4-2683-433a-8b73-580878d20972 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:34.173713 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86f3f4-2683-433a-8b73-580878d20972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:34.175366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9d86f3f4-2683-433a-8b73-580878d20972 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:34.281613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86f3f4-2683-433a-8b73-580878d20972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:34.283077 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86f3f4-2683-433a-8b73-580878d20972 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:34.302079 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 663/1325] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:11:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:11:36.603800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d80a7-26b6-45a1-8105-9843fff60064 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:36.604407 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d80a7-26b6-45a1-8105-9843fff60064 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:36.604407 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d80a7-26b6-45a1-8105-9843fff60064 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:36.605692 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 663/1326] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:11:36.610935 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa98d1-596c-4f75-b38a-de72c976e1b8 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:36.611357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa98d1-596c-4f75-b38a-de72c976e1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:36.611506 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa98d1-596c-4f75-b38a-de72c976e1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:36.674808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-eaaa98d1-596c-4f75-b38a-de72c976e1b8 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:36.676022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-eaaa98d1-596c-4f75-b38a-de72c976e1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:36.772391 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 664/1327] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:36.808176 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d80a7-26b6-45a1-8105-9843fff60064 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:36.809687 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a39d80a7-26b6-45a1-8105-9843fff60064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:36.914004 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d80a7-26b6-45a1-8105-9843fff60064 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:36.984674 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0a6f1-3ac9-4cb3-81fa-78799ec923f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:36.985328 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0a6f1-3ac9-4cb3-81fa-78799ec923f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:36.985613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0a6f1-3ac9-4cb3-81fa-78799ec923f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:36.985889 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0a6f1-3ac9-4cb3-81fa-78799ec923f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:36.987560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-94b0a6f1-3ac9-4cb3-81fa-78799ec923f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:37.093376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0a6f1-3ac9-4cb3-81fa-78799ec923f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:37.094839 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0a6f1-3ac9-4cb3-81fa-78799ec923f5 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:37.112712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 664/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:11:39.404229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d8c6d-d174-4ad9-8955-83d3a8d53b1d None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:39.404656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d8c6d-d174-4ad9-8955-83d3a8d53b1d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:39.404772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d8c6d-d174-4ad9-8955-83d3a8d53b1d None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:39.406166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 665/1329] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:11:39.411648 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c41d3-59fe-4d1a-bdb3-14a884dd5970 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:39.412604 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c41d3-59fe-4d1a-bdb3-14a884dd5970 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:39.412854 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c41d3-59fe-4d1a-bdb3-14a884dd5970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:39.473791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-0f0c41d3-59fe-4d1a-bdb3-14a884dd5970 None None] MFA Rules not processed for user `33781cd02a6e417a9a09ee0ca6390d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:39.475528 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-0f0c41d3-59fe-4d1a-bdb3-14a884dd5970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:39.566831 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 665/1330] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:11:39 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:39.604241 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d8c6d-d174-4ad9-8955-83d3a8d53b1d None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:39.605791 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-687d8c6d-d174-4ad9-8955-83d3a8d53b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:39.707359 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d8c6d-d174-4ad9-8955-83d3a8d53b1d None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:39.777424 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1537fe1-73dc-483d-8499-f0ffae3017e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:39.778073 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1537fe1-73dc-483d-8499-f0ffae3017e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:39.778354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1537fe1-73dc-483d-8499-f0ffae3017e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:39.778663 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1537fe1-73dc-483d-8499-f0ffae3017e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:39.780297 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d1537fe1-73dc-483d-8499-f0ffae3017e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:39.889897 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1537fe1-73dc-483d-8499-f0ffae3017e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:39.891356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1537fe1-73dc-483d-8499-f0ffae3017e8 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:39.909120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 666/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:11:39 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:11:42.558122 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831416a-461a-4252-a243-f540cab04886 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:42.558712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831416a-461a-4252-a243-f540cab04886 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:42.558869 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831416a-461a-4252-a243-f540cab04886 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:42.560408 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 666/1332] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:11:42.565868 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaa892-1d5b-415c-825b-d92c70c9e78d None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:42.566365 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaa892-1d5b-415c-825b-d92c70c9e78d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:42.566627 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaa892-1d5b-415c-825b-d92c70c9e78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:42.633425 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-9eaaa892-1d5b-415c-825b-d92c70c9e78d None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:42.634654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9eaaa892-1d5b-415c-825b-d92c70c9e78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:42.727756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 667/1333] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:42.764385 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831416a-461a-4252-a243-f540cab04886 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:42.765909 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-f831416a-461a-4252-a243-f540cab04886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:42.869850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831416a-461a-4252-a243-f540cab04886 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:42.943846 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97ad2b-8fed-48ed-99d1-8f3ceb5f4529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:42.944532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97ad2b-8fed-48ed-99d1-8f3ceb5f4529 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:42.944836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97ad2b-8fed-48ed-99d1-8f3ceb5f4529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:42.945112 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97ad2b-8fed-48ed-99d1-8f3ceb5f4529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:42.946777 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-bb97ad2b-8fed-48ed-99d1-8f3ceb5f4529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:43.053618 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97ad2b-8fed-48ed-99d1-8f3ceb5f4529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:43.055026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97ad2b-8fed-48ed-99d1-8f3ceb5f4529 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:43.074459 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 667/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:11:45.362296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384921d-7d97-4ac2-b70e-8ac998eed599 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:45.362894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384921d-7d97-4ac2-b70e-8ac998eed599 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:45.362894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384921d-7d97-4ac2-b70e-8ac998eed599 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:45.364252 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 668/1335] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:11:45.370417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596a1bd-623b-414e-8c16-8de97e78ebdf None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:45.370822 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596a1bd-623b-414e-8c16-8de97e78ebdf None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:45.371020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596a1bd-623b-414e-8c16-8de97e78ebdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:45.435424 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-d596a1bd-623b-414e-8c16-8de97e78ebdf None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:45.436627 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-d596a1bd-623b-414e-8c16-8de97e78ebdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:45.532570 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 668/1336] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:45.573544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384921d-7d97-4ac2-b70e-8ac998eed599 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:45.575143 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f384921d-7d97-4ac2-b70e-8ac998eed599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:45.678508 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384921d-7d97-4ac2-b70e-8ac998eed599 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:45.748630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18409b-7a27-418f-bb1d-86de59debbac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:45.749280 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18409b-7a27-418f-bb1d-86de59debbac service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:45.749567 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18409b-7a27-418f-bb1d-86de59debbac service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:45.749847 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18409b-7a27-418f-bb1d-86de59debbac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:45.751521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2a18409b-7a27-418f-bb1d-86de59debbac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:45.853715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18409b-7a27-418f-bb1d-86de59debbac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:45.855172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18409b-7a27-418f-bb1d-86de59debbac service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:45.873494 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 669/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:11:48.765214 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93e0ac-3274-44ac-8407-c5d4880cc13e None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:48.765782 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93e0ac-3274-44ac-8407-c5d4880cc13e None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:48.766145 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93e0ac-3274-44ac-8407-c5d4880cc13e None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:48.767550 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 669/1338] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:11:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:11:48.773648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5db783-892f-45e8-a8a8-1192529a6fa2 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:48.774075 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5db783-892f-45e8-a8a8-1192529a6fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:48.774232 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5db783-892f-45e8-a8a8-1192529a6fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:48.836296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2b5db783-892f-45e8-a8a8-1192529a6fa2 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:48.837495 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2b5db783-892f-45e8-a8a8-1192529a6fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:48.930116 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 670/1339] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:11:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:48.965879 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93e0ac-3274-44ac-8407-c5d4880cc13e None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:48.967437 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-0c93e0ac-3274-44ac-8407-c5d4880cc13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:49.069626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93e0ac-3274-44ac-8407-c5d4880cc13e None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:49.140766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb897d-2eb2-414b-900d-4adb47f84f6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:49.141411 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb897d-2eb2-414b-900d-4adb47f84f6e service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:49.141690 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb897d-2eb2-414b-900d-4adb47f84f6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:49.142032 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb897d-2eb2-414b-900d-4adb47f84f6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:49.143682 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e2cb897d-2eb2-414b-900d-4adb47f84f6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:49.249772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb897d-2eb2-414b-900d-4adb47f84f6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:49.251170 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb897d-2eb2-414b-900d-4adb47f84f6e service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:49.268440 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 670/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:11:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:11:53.669121 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2bdfb-36dd-4a66-bdf5-207c32a0307b None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:53.669635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2bdfb-36dd-4a66-bdf5-207c32a0307b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:53.669729 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2bdfb-36dd-4a66-bdf5-207c32a0307b None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:53.671076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 671/1341] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:11:53.676355 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfb429-e91d-47ca-b2f2-3b93172c9ba1 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:53.676793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfb429-e91d-47ca-b2f2-3b93172c9ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:53.677086 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfb429-e91d-47ca-b2f2-3b93172c9ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:53.746778 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-15cfb429-e91d-47ca-b2f2-3b93172c9ba1 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:53.747969 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-15cfb429-e91d-47ca-b2f2-3b93172c9ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:53.858535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 671/1342] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:53.893787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2bdfb-36dd-4a66-bdf5-207c32a0307b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:53.896196 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-dba2bdfb-36dd-4a66-bdf5-207c32a0307b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:53.988122 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2bdfb-36dd-4a66-bdf5-207c32a0307b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:53.991735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d064973-5747-4bf2-a188-7c03791defaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:53.992371 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d064973-5747-4bf2-a188-7c03791defaf service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:53.994773 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d064973-5747-4bf2-a188-7c03791defaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:53.994773 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d064973-5747-4bf2-a188-7c03791defaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:54.001963 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d064973-5747-4bf2-a188-7c03791defaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:54.003425 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d064973-5747-4bf2-a188-7c03791defaf service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:54.012848 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 672/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:11:57.135262 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a369d-b6c4-4382-9e0e-2a5342c6cdcf None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:57.135807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a369d-b6c4-4382-9e0e-2a5342c6cdcf None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:57.135807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a369d-b6c4-4382-9e0e-2a5342c6cdcf None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:57.137177 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 672/1344] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:11:57.142314 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a30410-b529-4615-9c12-3d586b448f28 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:57.142751 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a30410-b529-4615-9c12-3d586b448f28 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:57.142947 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a30410-b529-4615-9c12-3d586b448f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:57.171710 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-24a30410-b529-4615-9c12-3d586b448f28 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:57.172912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-24a30410-b529-4615-9c12-3d586b448f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:57.248456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 673/1345] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:11:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:57.286154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a369d-b6c4-4382-9e0e-2a5342c6cdcf None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:57.297320 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a369d-b6c4-4382-9e0e-2a5342c6cdcf None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:57.300824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b859a77-ecff-4f5a-980b-fb948ae7b27b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:57.301468 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b859a77-ecff-4f5a-980b-fb948ae7b27b service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:57.302294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b859a77-ecff-4f5a-980b-fb948ae7b27b service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:57.302965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b859a77-ecff-4f5a-980b-fb948ae7b27b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:57.311930 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b859a77-ecff-4f5a-980b-fb948ae7b27b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:57.313430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b859a77-ecff-4f5a-980b-fb948ae7b27b service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:57.323462 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 673/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:11:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:12:01.906550 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcb22d-06cf-45c4-86ad-0ba201cad554 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:01.907104 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcb22d-06cf-45c4-86ad-0ba201cad554 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:01.907261 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcb22d-06cf-45c4-86ad-0ba201cad554 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:01.908723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 674/1347] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:12:01.914567 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0809f9-fcec-407c-b309-a6ce792d7152 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:01.914993 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0809f9-fcec-407c-b309-a6ce792d7152 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:01.915109 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0809f9-fcec-407c-b309-a6ce792d7152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:01.932594 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-2c0809f9-fcec-407c-b309-a6ce792d7152 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:01.933786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-2c0809f9-fcec-407c-b309-a6ce792d7152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:01.941650 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 674/1348] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:01.979699 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcb22d-06cf-45c4-86ad-0ba201cad554 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:01.990416 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcb22d-06cf-45c4-86ad-0ba201cad554 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:01.993898 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ac224-13c0-454d-ae5a-315478dc2dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:01.994557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ac224-13c0-454d-ae5a-315478dc2dec service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:01.994842 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ac224-13c0-454d-ae5a-315478dc2dec service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:01.995117 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ac224-13c0-454d-ae5a-315478dc2dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:02.004048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ac224-13c0-454d-ae5a-315478dc2dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:02.006167 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ac224-13c0-454d-ae5a-315478dc2dec service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:02.015488 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 675/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:12:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:12:07.364846 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98644e01-c01d-4b60-8545-4ec361a78c89 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:07.365699 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98644e01-c01d-4b60-8545-4ec361a78c89 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:07.366144 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98644e01-c01d-4b60-8545-4ec361a78c89 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:07.367961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 675/1350] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 10 21:12:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:12:07.380796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38829b2-8c20-4418-abae-b2c1b6cc3dca None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:07.381251 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38829b2-8c20-4418-abae-b2c1b6cc3dca None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:07.381356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38829b2-8c20-4418-abae-b2c1b6cc3dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:07.467556 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b38829b2-8c20-4418-abae-b2c1b6cc3dca None None] MFA Rules not processed for user `9a13ad1e10ff44c4b870b45b7416b70f`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:07.474627 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b38829b2-8c20-4418-abae-b2c1b6cc3dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:07.584381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 676/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 10 21:12:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:11.905353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cddf3-f5ae-4c1d-b6cb-dc0cd60c1620 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:11.905907 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cddf3-f5ae-4c1d-b6cb-dc0cd60c1620 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:11.905907 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cddf3-f5ae-4c1d-b6cb-dc0cd60c1620 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:11.907285 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 676/1352] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 10 21:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:12:11.913575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ade0e-87b4-4d88-a428-10dcc3d5cb08 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:11.914500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ade0e-87b4-4d88-a428-10dcc3d5cb08 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:11.915067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ade0e-87b4-4d88-a428-10dcc3d5cb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:11.937200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-909ade0e-87b4-4d88-a428-10dcc3d5cb08 None None] MFA Rules not processed for user `9a13ad1e10ff44c4b870b45b7416b70f`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:11.938900 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-909ade0e-87b4-4d88-a428-10dcc3d5cb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:11.949032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 677/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 10 21:12:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:13.510741 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f001ffa-c321-4845-bbe7-22a4393c33bb None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:13.511280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f001ffa-c321-4845-bbe7-22a4393c33bb None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:13.511387 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f001ffa-c321-4845-bbe7-22a4393c33bb None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:13.512650 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 677/1354] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 10 21:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:12:13.517457 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98ba89-2645-4044-88b8-1a45fa393d2f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:13.517879 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98ba89-2645-4044-88b8-1a45fa393d2f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:13.518023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98ba89-2645-4044-88b8-1a45fa393d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:13.537234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-0b98ba89-2645-4044-88b8-1a45fa393d2f None None] MFA Rules not processed for user `9a13ad1e10ff44c4b870b45b7416b70f`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:13.538409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0b98ba89-2645-4044-88b8-1a45fa393d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:13.546878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 678/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 10 21:12:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:17.409897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fb2d2-c55d-4ce0-8329-df189fd825aa None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:17.410864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fb2d2-c55d-4ce0-8329-df189fd825aa None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:17.411428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fb2d2-c55d-4ce0-8329-df189fd825aa None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:17.413347 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 678/1356] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:12:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:12:17.418300 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32ec6b-012f-4ba5-b71d-631ee7b22e04 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:17.419054 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32ec6b-012f-4ba5-b71d-631ee7b22e04 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:17.419498 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32ec6b-012f-4ba5-b71d-631ee7b22e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:17.440991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-fa32ec6b-012f-4ba5-b71d-631ee7b22e04 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:17.443191 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fa32ec6b-012f-4ba5-b71d-631ee7b22e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:17.451817 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 679/1357] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:17.499060 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61dff57-c68f-4ce2-b0cd-4824f06a8c5c None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:17.499347 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61dff57-c68f-4ce2-b0cd-4824f06a8c5c None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:17.499793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61dff57-c68f-4ce2-b0cd-4824f06a8c5c None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:17.501260 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 679/1358] 10.222.0.25 () {54 vars in 961 bytes} [Tue May 10 21:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:12:17.507599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b456fb-18dc-4c9e-b5c9-4bca6e2ef655 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:17.508068 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b456fb-18dc-4c9e-b5c9-4bca6e2ef655 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:17.508524 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b456fb-18dc-4c9e-b5c9-4bca6e2ef655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:17.556875 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-e8b456fb-18dc-4c9e-b5c9-4bca6e2ef655 None None] MFA Rules not processed for user `c4c16a3b07c64a22bfc3df2a5a90c3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:17.558413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e8b456fb-18dc-4c9e-b5c9-4bca6e2ef655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:17.648462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 680/1359] 10.222.0.25 () {58 vars in 1058 bytes} [Tue May 10 21:12:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:17.656592 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61dff57-c68f-4ce2-b0cd-4824f06a8c5c None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:17.672082 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61dff57-c68f-4ce2-b0cd-4824f06a8c5c None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:17.678509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1cd62b-de1e-46ba-8d13-47aff86eb076 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:17.679321 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cd62b-de1e-46ba-8d13-47aff86eb076 service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:17.679751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cd62b-de1e-46ba-8d13-47aff86eb076 service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:17.680171 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cd62b-de1e-46ba-8d13-47aff86eb076 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:17.689319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1cd62b-de1e-46ba-8d13-47aff86eb076 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:17.691214 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1cd62b-de1e-46ba-8d13-47aff86eb076 service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:17.703044 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 680/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:12:20.183166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838708e-2621-4f01-b11b-26f07d53134b None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:20.183721 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838708e-2621-4f01-b11b-26f07d53134b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:20.183721 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838708e-2621-4f01-b11b-26f07d53134b None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:20.185070 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 681/1361] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:12:20.192404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53461d-fa42-4fca-9fd7-8bf036eade81 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:20.192840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53461d-fa42-4fca-9fd7-8bf036eade81 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:20.193286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53461d-fa42-4fca-9fd7-8bf036eade81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:20.212033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-8c53461d-fa42-4fca-9fd7-8bf036eade81 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:20.213370 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-8c53461d-fa42-4fca-9fd7-8bf036eade81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:20.221328 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 681/1362] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:20.266496 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838708e-2621-4f01-b11b-26f07d53134b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:20.281405 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838708e-2621-4f01-b11b-26f07d53134b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:20.287940 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9ec04-ea88-4a33-8929-9c5811826319 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:20.288587 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9ec04-ea88-4a33-8929-9c5811826319 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:20.288871 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9ec04-ea88-4a33-8929-9c5811826319 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:20.289148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9ec04-ea88-4a33-8929-9c5811826319 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:20.297699 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9ec04-ea88-4a33-8929-9c5811826319 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:20.299321 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9ec04-ea88-4a33-8929-9c5811826319 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:20.309886 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 682/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:12:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:12:22.995309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b24db0-a15e-484f-a18c-fc5c24b41ebf None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:22.995812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b24db0-a15e-484f-a18c-fc5c24b41ebf None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:22.995812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b24db0-a15e-484f-a18c-fc5c24b41ebf None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:22.997157 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 682/1364] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:12:23.002543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0738a-7626-4502-9ead-43778290caf5 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:23.003334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0738a-7626-4502-9ead-43778290caf5 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:23.008808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0738a-7626-4502-9ead-43778290caf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:23.021572 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8ed0738a-7626-4502-9ead-43778290caf5 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:23.022871 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8ed0738a-7626-4502-9ead-43778290caf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:23.030831 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 683/1365] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:23.076199 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfce4c2-43ae-47c7-92e0-80c17b5e529d None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:23.076486 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfce4c2-43ae-47c7-92e0-80c17b5e529d None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:23.076761 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfce4c2-43ae-47c7-92e0-80c17b5e529d None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:23.078188 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 683/1366] 10.222.0.25 () {54 vars in 961 bytes} [Tue May 10 21:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:12:23.083617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe9945-daca-46fb-88aa-45f73c180607 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:23.083909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe9945-daca-46fb-88aa-45f73c180607 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:23.084213 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe9945-daca-46fb-88aa-45f73c180607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:23.103285 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-bbfe9945-daca-46fb-88aa-45f73c180607 None None] MFA Rules not processed for user `c4c16a3b07c64a22bfc3df2a5a90c3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:23.104462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-bbfe9945-daca-46fb-88aa-45f73c180607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:23.114230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 684/1367] 10.222.0.25 () {58 vars in 1058 bytes} [Tue May 10 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:23.121873 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfce4c2-43ae-47c7-92e0-80c17b5e529d None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:23.135956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfce4c2-43ae-47c7-92e0-80c17b5e529d None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:23.141379 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290771b-b35c-4ac3-9e58-8894b1f0a04f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:23.142089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290771b-b35c-4ac3-9e58-8894b1f0a04f service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:23.142457 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290771b-b35c-4ac3-9e58-8894b1f0a04f service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:23.142741 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290771b-b35c-4ac3-9e58-8894b1f0a04f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:23.151004 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290771b-b35c-4ac3-9e58-8894b1f0a04f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:23.152573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290771b-b35c-4ac3-9e58-8894b1f0a04f service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:23.162684 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 684/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:12:25.651940 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77c78d-bf02-441f-b1d9-8315ec6b3319 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:25.652500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77c78d-bf02-441f-b1d9-8315ec6b3319 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:25.652500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77c78d-bf02-441f-b1d9-8315ec6b3319 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:25.653864 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 685/1369] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:12:25.659519 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce9d95-91b4-41ae-a163-6647e89ae35e None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:25.660024 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce9d95-91b4-41ae-a163-6647e89ae35e None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:25.660188 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce9d95-91b4-41ae-a163-6647e89ae35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:25.679265 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-ebce9d95-91b4-41ae-a163-6647e89ae35e None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:25.680404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-ebce9d95-91b4-41ae-a163-6647e89ae35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:25.688677 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 685/1370] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:25.732202 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8ff03-2267-4947-895c-af0951bad7c5 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:25.732755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8ff03-2267-4947-895c-af0951bad7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:25.733036 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8ff03-2267-4947-895c-af0951bad7c5 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:25.733698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce9d95-91b4-41ae-a163-6647e89ae35e None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:25.734415 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 686/1371] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:12:25.740692 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdb539-d3ff-47dd-9abd-5705c2112f63 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:25.740981 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdb539-d3ff-47dd-9abd-5705c2112f63 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:25.741261 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdb539-d3ff-47dd-9abd-5705c2112f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:25.747156 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce9d95-91b4-41ae-a163-6647e89ae35e None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:25.752733 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e07f0-ff93-4b06-b3cf-1241bdb2c323 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:25.753393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e07f0-ff93-4b06-b3cf-1241bdb2c323 service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:25.753682 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e07f0-ff93-4b06-b3cf-1241bdb2c323 service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:25.755006 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e07f0-ff93-4b06-b3cf-1241bdb2c323 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:25.760355 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-87cdb539-d3ff-47dd-9abd-5705c2112f63 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:25.761549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-87cdb539-d3ff-47dd-9abd-5705c2112f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:25.763309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e07f0-ff93-4b06-b3cf-1241bdb2c323 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:25.764881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e07f0-ff93-4b06-b3cf-1241bdb2c323 service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:25.769743 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 687/1372] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:12:25.775439 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 686/1373] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:12:26.091155 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29877dc1-a89f-4808-8fbf-93940ece8eca None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:26.091155 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29877dc1-a89f-4808-8fbf-93940ece8eca None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:26.091155 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29877dc1-a89f-4808-8fbf-93940ece8eca None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:26.092892 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 688/1374] 10.222.0.25 () {54 vars in 963 bytes} [Tue May 10 21:12:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:12:26.099021 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea3bc4-bff5-4826-a166-48f9ae328059 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:26.099021 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea3bc4-bff5-4826-a166-48f9ae328059 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:26.100364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea3bc4-bff5-4826-a166-48f9ae328059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:26.151396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-42ea3bc4-bff5-4826-a166-48f9ae328059 None None] MFA Rules not processed for user `c4dfa98f420c4c4c845262a78ae75ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:26.152977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-42ea3bc4-bff5-4826-a166-48f9ae328059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:26.214383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 687/1375] 10.222.0.25 () {58 vars in 1060 bytes} [Tue May 10 21:12:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:26.221960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29877dc1-a89f-4808-8fbf-93940ece8eca None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:26.233623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29877dc1-a89f-4808-8fbf-93940ece8eca None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:26.237232 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a44f8-0797-4bfa-8be3-0eb0a67bf10f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:26.239117 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a44f8-0797-4bfa-8be3-0eb0a67bf10f service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:26.239117 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a44f8-0797-4bfa-8be3-0eb0a67bf10f service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:26.239117 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a44f8-0797-4bfa-8be3-0eb0a67bf10f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:26.248354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a44f8-0797-4bfa-8be3-0eb0a67bf10f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:26.249840 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a44f8-0797-4bfa-8be3-0eb0a67bf10f service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:26.261318 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 689/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:12:28.171959 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012009d-a402-4fa9-81f6-f8f4e08c8f49 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:28.172547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012009d-a402-4fa9-81f6-f8f4e08c8f49 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:28.172547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012009d-a402-4fa9-81f6-f8f4e08c8f49 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:28.173864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 688/1377] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:12:28.179695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39249dd7-6c9e-4de0-a183-5abacfbf083c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:28.180257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39249dd7-6c9e-4de0-a183-5abacfbf083c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:28.180352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39249dd7-6c9e-4de0-a183-5abacfbf083c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:28.198207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-39249dd7-6c9e-4de0-a183-5abacfbf083c None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:28.199420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-39249dd7-6c9e-4de0-a183-5abacfbf083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:28.208277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 690/1378] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:28.252968 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012009d-a402-4fa9-81f6-f8f4e08c8f49 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:28.267738 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012009d-a402-4fa9-81f6-f8f4e08c8f49 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:28.273843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae84971-534a-45bf-bbea-6ce1870f1c10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:28.274546 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae84971-534a-45bf-bbea-6ce1870f1c10 service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:28.274833 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae84971-534a-45bf-bbea-6ce1870f1c10 service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:28.275105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae84971-534a-45bf-bbea-6ce1870f1c10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:28.283386 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae84971-534a-45bf-bbea-6ce1870f1c10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:28.285807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae84971-534a-45bf-bbea-6ce1870f1c10 service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:28.295158 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 689/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:12:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:12:30.699676 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d1cf6-cd45-4f77-82c0-72fa4957f1f4 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:30.700258 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d1cf6-cd45-4f77-82c0-72fa4957f1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:30.700258 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d1cf6-cd45-4f77-82c0-72fa4957f1f4 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:30.701574 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 691/1380] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:12:30.707434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e61701-bef7-49ad-b725-cca6a8a3814d None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:30.708491 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e61701-bef7-49ad-b725-cca6a8a3814d None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:30.708877 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e61701-bef7-49ad-b725-cca6a8a3814d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:30.728042 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-56e61701-bef7-49ad-b725-cca6a8a3814d None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:30.729213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-56e61701-bef7-49ad-b725-cca6a8a3814d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:30.736911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 690/1381] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:30.781214 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d1cf6-cd45-4f77-82c0-72fa4957f1f4 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:30.796824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d1cf6-cd45-4f77-82c0-72fa4957f1f4 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:30.804439 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533a33e-d571-49dc-97d7-00057db9546d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:30.805166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533a33e-d571-49dc-97d7-00057db9546d service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:30.805523 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533a33e-d571-49dc-97d7-00057db9546d service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:30.805874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533a33e-d571-49dc-97d7-00057db9546d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:30.814764 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533a33e-d571-49dc-97d7-00057db9546d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:30.818718 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533a33e-d571-49dc-97d7-00057db9546d service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:30.829420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 692/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:12:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:12:33.249278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816be97c-d721-4e79-9d98-58abe0c859bc None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:33.249815 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816be97c-d721-4e79-9d98-58abe0c859bc None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:33.249815 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816be97c-d721-4e79-9d98-58abe0c859bc None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:33.254406 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 691/1383] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:12:33.257653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a82e1-ed88-409c-b3a5-56285bc8f853 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:33.258071 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a82e1-ed88-409c-b3a5-56285bc8f853 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:33.258216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a82e1-ed88-409c-b3a5-56285bc8f853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:33.276457 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f05a82e1-ed88-409c-b3a5-56285bc8f853 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:33.277896 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f05a82e1-ed88-409c-b3a5-56285bc8f853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:33.287064 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 693/1384] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:33.331113 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816be97c-d721-4e79-9d98-58abe0c859bc None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:33.348474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816be97c-d721-4e79-9d98-58abe0c859bc None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:33.354570 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0ce55-dba2-4eb7-ab5f-6766b715b142 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:33.355310 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0ce55-dba2-4eb7-ab5f-6766b715b142 service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:33.355597 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0ce55-dba2-4eb7-ab5f-6766b715b142 service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:33.355884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0ce55-dba2-4eb7-ab5f-6766b715b142 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:33.365730 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0ce55-dba2-4eb7-ab5f-6766b715b142 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:33.367355 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0ce55-dba2-4eb7-ab5f-6766b715b142 service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:33.377718 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 692/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:12:35.735633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e61b7-e2cd-4904-a77a-72206c9c1755 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:35.736169 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e61b7-e2cd-4904-a77a-72206c9c1755 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:35.736169 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e61b7-e2cd-4904-a77a-72206c9c1755 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:35.737528 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 694/1386] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:12:35.746514 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ae4f6-32ad-4642-a24b-dd26a128df86 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:35.746991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ae4f6-32ad-4642-a24b-dd26a128df86 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:35.747075 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ae4f6-32ad-4642-a24b-dd26a128df86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:35.765230 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-0b5ae4f6-32ad-4642-a24b-dd26a128df86 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:35.766417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-0b5ae4f6-32ad-4642-a24b-dd26a128df86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:35.775067 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 693/1387] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:35.819461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e61b7-e2cd-4904-a77a-72206c9c1755 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:35.834736 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e61b7-e2cd-4904-a77a-72206c9c1755 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:35.841874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e383932-cc1d-477e-9764-abf263cfe39b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:35.842702 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e383932-cc1d-477e-9764-abf263cfe39b service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:35.844005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e383932-cc1d-477e-9764-abf263cfe39b service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:35.844005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e383932-cc1d-477e-9764-abf263cfe39b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:35.856198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e383932-cc1d-477e-9764-abf263cfe39b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:35.858281 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e383932-cc1d-477e-9764-abf263cfe39b service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:35.871692 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 695/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:12:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:12:38.361861 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4681a-07d7-4623-aae4-2169c6e96e72 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:38.362490 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4681a-07d7-4623-aae4-2169c6e96e72 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:38.362490 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4681a-07d7-4623-aae4-2169c6e96e72 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:38.364705 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 694/1389] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:12:38.370569 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ae160-e024-4e78-aaf6-1173c2b6810d None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:38.371081 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ae160-e024-4e78-aaf6-1173c2b6810d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:38.371324 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ae160-e024-4e78-aaf6-1173c2b6810d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:38.393708 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2a1ae160-e024-4e78-aaf6-1173c2b6810d None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:38.395704 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2a1ae160-e024-4e78-aaf6-1173c2b6810d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:38.405792 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 696/1390] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:38.453336 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4681a-07d7-4623-aae4-2169c6e96e72 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:38.467896 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4681a-07d7-4623-aae4-2169c6e96e72 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:38.473714 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ade052-6abf-414c-80ce-8fb84909730e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:38.474389 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ade052-6abf-414c-80ce-8fb84909730e service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:38.474665 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ade052-6abf-414c-80ce-8fb84909730e service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:38.474932 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ade052-6abf-414c-80ce-8fb84909730e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:38.483506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ade052-6abf-414c-80ce-8fb84909730e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:38.485083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ade052-6abf-414c-80ce-8fb84909730e service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:38.495241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 695/1391] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:12:40.893121 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7804f9-251c-461e-8ccd-460da51ce890 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:40.893711 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7804f9-251c-461e-8ccd-460da51ce890 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:40.893711 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7804f9-251c-461e-8ccd-460da51ce890 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:40.896006 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 697/1392] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:12:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:12:40.901451 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60053185-d1ff-4658-b14b-c0dc9444ede8 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:40.901878 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60053185-d1ff-4658-b14b-c0dc9444ede8 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:40.902021 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60053185-d1ff-4658-b14b-c0dc9444ede8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:40.919492 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-60053185-d1ff-4658-b14b-c0dc9444ede8 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:40.920678 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-60053185-d1ff-4658-b14b-c0dc9444ede8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:40.928507 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 696/1393] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:40.972065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7804f9-251c-461e-8ccd-460da51ce890 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:40.986644 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7804f9-251c-461e-8ccd-460da51ce890 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:40.992077 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f532a3-21da-4a96-a0ad-f3b8b24dfd17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:40.992759 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f532a3-21da-4a96-a0ad-f3b8b24dfd17 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:40.993044 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f532a3-21da-4a96-a0ad-f3b8b24dfd17 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:40.993352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f532a3-21da-4a96-a0ad-f3b8b24dfd17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:41.001240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f532a3-21da-4a96-a0ad-f3b8b24dfd17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:41.002871 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f532a3-21da-4a96-a0ad-f3b8b24dfd17 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:41.012861 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 698/1394] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:12:42.277465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5b0f9-6c24-47c7-8fa3-b2383d421b9c None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:42.278023 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5b0f9-6c24-47c7-8fa3-b2383d421b9c None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:42.278023 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5b0f9-6c24-47c7-8fa3-b2383d421b9c None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:42.279466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 697/1395] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:12:42.288318 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5feab-0b17-489b-8fdc-2215e1e2d64e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:42.288794 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5feab-0b17-489b-8fdc-2215e1e2d64e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:42.288891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5feab-0b17-489b-8fdc-2215e1e2d64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:42.306803 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-16f5feab-0b17-489b-8fdc-2215e1e2d64e None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:42.307995 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-16f5feab-0b17-489b-8fdc-2215e1e2d64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:42.316796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 699/1396] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:42.373273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9fbac-378b-4db7-8e9e-0321e9b110a2 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:42.373954 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9fbac-378b-4db7-8e9e-0321e9b110a2 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:42.374455 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9fbac-378b-4db7-8e9e-0321e9b110a2 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:42.376278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 698/1397] 10.222.0.25 () {54 vars in 962 bytes} [Tue May 10 21:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:12:42.381581 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16478c82-d846-4034-ad1b-e9ace7affc70 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:42.382104 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16478c82-d846-4034-ad1b-e9ace7affc70 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:42.382397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16478c82-d846-4034-ad1b-e9ace7affc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:42.431278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-16478c82-d846-4034-ad1b-e9ace7affc70 None None] MFA Rules not processed for user `aa2b6514779d42fa81d34351607dea27`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:42.432453 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-16478c82-d846-4034-ad1b-e9ace7affc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:42.490261 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 700/1398] 10.222.0.25 () {58 vars in 1059 bytes} [Tue May 10 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:42.497644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9fbac-378b-4db7-8e9e-0321e9b110a2 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:42.508844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9fbac-378b-4db7-8e9e-0321e9b110a2 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:42.512512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a72f5-f632-4217-a3fb-403675084c3c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2b6514779d42fa81d34351607dea27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:42.513215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a72f5-f632-4217-a3fb-403675084c3c service glance] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:42.513566 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a72f5-f632-4217-a3fb-403675084c3c service glance] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:42.514033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a72f5-f632-4217-a3fb-403675084c3c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:42.523570 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a72f5-f632-4217-a3fb-403675084c3c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:42.525084 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a72f5-f632-4217-a3fb-403675084c3c service glance] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:42.535135 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 699/1399] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:12:43.076101 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd9b1a-6582-446f-bf77-79eecdcb74b2 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:43.076419 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd9b1a-6582-446f-bf77-79eecdcb74b2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:43.076722 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd9b1a-6582-446f-bf77-79eecdcb74b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:43.122341 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-86bd9b1a-6582-446f-bf77-79eecdcb74b2 None None] MFA Rules not processed for user `c0fc3052af194b48b7ce036ff605ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:43.123554 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-86bd9b1a-6582-446f-bf77-79eecdcb74b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:43.188991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 701/1400] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 10 21:12:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:43.234475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f663965-c015-4306-a1dc-bec8c5cc1900 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:43.234835 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f663965-c015-4306-a1dc-bec8c5cc1900 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:43.235178 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f663965-c015-4306-a1dc-bec8c5cc1900 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:43.236803 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 700/1401] 10.222.0.25 () {54 vars in 942 bytes} [Tue May 10 21:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:12:43.243611 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070cc9e-bddf-4794-8090-beb2027af04e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:43.243935 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070cc9e-bddf-4794-8090-beb2027af04e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:43.244217 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070cc9e-bddf-4794-8090-beb2027af04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:43.294399 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-5070cc9e-bddf-4794-8090-beb2027af04e None None] MFA Rules not processed for user `76040882d4374087bb7458fd8b5c1d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:43.295632 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5070cc9e-bddf-4794-8090-beb2027af04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:43.359364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d3300-10a7-4160-89fb-12e43861d7d1 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:43.359924 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d3300-10a7-4160-89fb-12e43861d7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:43.359924 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d3300-10a7-4160-89fb-12e43861d7d1 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:43.361298 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 701/1402] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:12:43.366359 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 702/1403] 10.222.0.25 () {58 vars in 1039 bytes} [Tue May 10 21:12:43 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:43.366557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2f0f2-d326-4ac7-82bc-4cca61e0590a None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:43.366790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2f0f2-d326-4ac7-82bc-4cca61e0590a None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:43.367070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2f0f2-d326-4ac7-82bc-4cca61e0590a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:43.375729 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070cc9e-bddf-4794-8090-beb2027af04e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:43.385579 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070cc9e-bddf-4794-8090-beb2027af04e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:43.385728 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-01f2f0f2-d326-4ac7-82bc-4cca61e0590a None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:43.386970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-01f2f0f2-d326-4ac7-82bc-4cca61e0590a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:43.390622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7e73e-962f-4e36-a9ea-5334df79217a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76040882d4374087bb7458fd8b5c1d8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:43.391268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7e73e-962f-4e36-a9ea-5334df79217a service swift] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:43.391552 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7e73e-962f-4e36-a9ea-5334df79217a service swift] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:43.391830 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7e73e-962f-4e36-a9ea-5334df79217a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:43.395273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 702/1404] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:12:43.400122 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7e73e-962f-4e36-a9ea-5334df79217a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:43.401680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7e73e-962f-4e36-a9ea-5334df79217a service swift] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:43.410115 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 703/1405] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 10 21:12:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 21:12:43.439933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2f0f2-d326-4ac7-82bc-4cca61e0590a None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:43.452032 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2f0f2-d326-4ac7-82bc-4cca61e0590a None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:43.458798 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0aba4f-d1ff-45d5-88fb-72b7a557a78c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:43.459430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aba4f-d1ff-45d5-88fb-72b7a557a78c service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:43.459710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aba4f-d1ff-45d5-88fb-72b7a557a78c service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:43.459982 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aba4f-d1ff-45d5-88fb-72b7a557a78c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:43.467858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0aba4f-d1ff-45d5-88fb-72b7a557a78c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:43.472487 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0aba4f-d1ff-45d5-88fb-72b7a557a78c service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:43.479245 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 703/1406] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:12:45.848353 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d81577-5735-4c4a-9a8e-5ecff6523c1b None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:45.848765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d81577-5735-4c4a-9a8e-5ecff6523c1b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:45.848765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d81577-5735-4c4a-9a8e-5ecff6523c1b None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:45.856389 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 704/1407] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:12:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:12:45.856591 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961e5be-afe1-4cb5-85fe-2b852645534d None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:45.856591 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961e5be-afe1-4cb5-85fe-2b852645534d None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:45.857100 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961e5be-afe1-4cb5-85fe-2b852645534d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:45.885238 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-3961e5be-afe1-4cb5-85fe-2b852645534d None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:45.885238 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-3961e5be-afe1-4cb5-85fe-2b852645534d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:45.898671 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 704/1408] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:45.944433 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d81577-5735-4c4a-9a8e-5ecff6523c1b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:45.959726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d81577-5735-4c4a-9a8e-5ecff6523c1b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:45.965527 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fec512-9d00-44ac-8d62-939471b2c385 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:45.992428 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fec512-9d00-44ac-8d62-939471b2c385 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:45.992428 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fec512-9d00-44ac-8d62-939471b2c385 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:45.992428 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fec512-9d00-44ac-8d62-939471b2c385 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:45.992428 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fec512-9d00-44ac-8d62-939471b2c385 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:45.992428 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fec512-9d00-44ac-8d62-939471b2c385 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:45.992428 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 705/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:12:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:13:08.030783 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6de694-f981-4e8d-8245-9fc151abc2d3 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:08.031418 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6de694-f981-4e8d-8245-9fc151abc2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:08.031418 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6de694-f981-4e8d-8245-9fc151abc2d3 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:08.032970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 705/1410] 10.222.0.25 () {54 vars in 918 bytes} [Tue May 10 21:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:13:08.038926 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94e4d2-6dec-4a9e-a39d-033d1f432752 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:08.039414 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94e4d2-6dec-4a9e-a39d-033d1f432752 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:08.039523 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94e4d2-6dec-4a9e-a39d-033d1f432752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:08.057879 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-bb94e4d2-6dec-4a9e-a39d-033d1f432752 None None] MFA Rules not processed for user `9a13ad1e10ff44c4b870b45b7416b70f`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:08.059135 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-bb94e4d2-6dec-4a9e-a39d-033d1f432752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:08.067863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 706/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Tue May 10 21:13:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:13:08.081901 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50264eff-3141-4b31-b7b5-5109466c3efe None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:08.082182 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50264eff-3141-4b31-b7b5-5109466c3efe None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:08.082496 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50264eff-3141-4b31-b7b5-5109466c3efe None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:08.083841 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 706/1412] 10.222.0.25 () {54 vars in 918 bytes} [Tue May 10 21:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:13:08.088268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6b1ed-c655-4990-b74e-20675a8807fd None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:08.088588 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6b1ed-c655-4990-b74e-20675a8807fd None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:08.088865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6b1ed-c655-4990-b74e-20675a8807fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:08.106582 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-53d6b1ed-c655-4990-b74e-20675a8807fd None None] MFA Rules not processed for user `c4c16a3b07c64a22bfc3df2a5a90c3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:08.107745 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-53d6b1ed-c655-4990-b74e-20675a8807fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:08.117429 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 707/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Tue May 10 21:13:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:13:10.839593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce069387-b5c6-489c-a85c-144b183c75c0 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:10.840135 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce069387-b5c6-489c-a85c-144b183c75c0 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:10.840135 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce069387-b5c6-489c-a85c-144b183c75c0 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:10.841541 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:13:10.847122 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06229248-664a-478c-8868-d39fe873895b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:10.847798 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06229248-664a-478c-8868-d39fe873895b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:10.847798 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06229248-664a-478c-8868-d39fe873895b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:10.864912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-06229248-664a-478c-8868-d39fe873895b None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:10.866096 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-06229248-664a-478c-8868-d39fe873895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:10.873717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:13:10.915506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce069387-b5c6-489c-a85c-144b183c75c0 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:10.929691 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce069387-b5c6-489c-a85c-144b183c75c0 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:10.935154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c064a79-ae0e-4e61-9a0c-fc267d8a1a3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:10.935787 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c064a79-ae0e-4e61-9a0c-fc267d8a1a3c service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:10.936076 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c064a79-ae0e-4e61-9a0c-fc267d8a1a3c service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:10.936355 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c064a79-ae0e-4e61-9a0c-fc267d8a1a3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:10.944895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c064a79-ae0e-4e61-9a0c-fc267d8a1a3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:10.946510 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c064a79-ae0e-4e61-9a0c-fc267d8a1a3c service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:10.955670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 708/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:13:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:13:11.937143 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb21d1b-7cc4-4509-94fe-de6e00083a16 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:11.937691 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb21d1b-7cc4-4509-94fe-de6e00083a16 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:11.937691 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb21d1b-7cc4-4509-94fe-de6e00083a16 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:11.939094 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:13:11.944620 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33167fb-4658-4c5c-a288-94dae947081e None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:11.945016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33167fb-4658-4c5c-a288-94dae947081e None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:11.945185 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33167fb-4658-4c5c-a288-94dae947081e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:11.962819 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-f33167fb-4658-4c5c-a288-94dae947081e None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:11.964000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-f33167fb-4658-4c5c-a288-94dae947081e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:11.971622 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:13:12.143223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb21d1b-7cc4-4509-94fe-de6e00083a16 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:12.157443 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb21d1b-7cc4-4509-94fe-de6e00083a16 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:12.163124 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a70759-5c50-4b73-bb37-6c5fffd41042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:12.163754 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a70759-5c50-4b73-bb37-6c5fffd41042 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:12.164035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a70759-5c50-4b73-bb37-6c5fffd41042 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:12.164307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a70759-5c50-4b73-bb37-6c5fffd41042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:12.172249 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a70759-5c50-4b73-bb37-6c5fffd41042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:12.173828 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a70759-5c50-4b73-bb37-6c5fffd41042 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:12.183563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 710/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:13:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:13:13.140051 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb518a-9ec1-4092-9e48-f332fbf63163 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:13.140587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb518a-9ec1-4092-9e48-f332fbf63163 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:13.140587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb518a-9ec1-4092-9e48-f332fbf63163 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:13.141967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:13:13.147153 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e186e-40bd-4608-b605-3e9247e6415e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:13.147561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e186e-40bd-4608-b605-3e9247e6415e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:13.147715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e186e-40bd-4608-b605-3e9247e6415e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:13.165835 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-ed6e186e-40bd-4608-b605-3e9247e6415e None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:13.167061 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ed6e186e-40bd-4608-b605-3e9247e6415e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:13.175445 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:13:13.324698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb518a-9ec1-4092-9e48-f332fbf63163 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:13.339155 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb518a-9ec1-4092-9e48-f332fbf63163 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:13.344543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f789355-c4b9-4c16-92af-8b9d51ad30fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:13.345174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f789355-c4b9-4c16-92af-8b9d51ad30fa service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:13.345458 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f789355-c4b9-4c16-92af-8b9d51ad30fa service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:13.345735 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f789355-c4b9-4c16-92af-8b9d51ad30fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:13.354183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f789355-c4b9-4c16-92af-8b9d51ad30fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:13.355797 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f789355-c4b9-4c16-92af-8b9d51ad30fa service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:13.365677 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 711/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:13:14.303790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f004a-d3b1-4d92-ada0-51facc2e1c08 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:14.304372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f004a-d3b1-4d92-ada0-51facc2e1c08 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:14.304372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f004a-d3b1-4d92-ada0-51facc2e1c08 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:14.305779 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:13:14.310891 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606fa94-e8aa-462b-8a36-5145253256a2 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:14.311321 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606fa94-e8aa-462b-8a36-5145253256a2 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:14.311462 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606fa94-e8aa-462b-8a36-5145253256a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:14.328873 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-c606fa94-e8aa-462b-8a36-5145253256a2 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:14.330136 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-c606fa94-e8aa-462b-8a36-5145253256a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:14.338750 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:13:14.488682 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f004a-d3b1-4d92-ada0-51facc2e1c08 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:14.502428 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f004a-d3b1-4d92-ada0-51facc2e1c08 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:14.507752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea579612-7541-4499-bc9f-ce2616dd7bec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:14.508374 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea579612-7541-4499-bc9f-ce2616dd7bec service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:14.508656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea579612-7541-4499-bc9f-ce2616dd7bec service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:14.508931 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea579612-7541-4499-bc9f-ce2616dd7bec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:14.516613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea579612-7541-4499-bc9f-ce2616dd7bec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:14.518160 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea579612-7541-4499-bc9f-ce2616dd7bec service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:14.527780 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 713/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:13:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:13:15.451806 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cf548-9100-45f6-8d0c-19ae8ae2ee2e None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:15.452230 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cf548-9100-45f6-8d0c-19ae8ae2ee2e None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:15.452369 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cf548-9100-45f6-8d0c-19ae8ae2ee2e None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:15.453734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:13:15.458738 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee2bb3-dcac-4dcf-9b8c-ed5b47bc8d94 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:15.459169 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee2bb3-dcac-4dcf-9b8c-ed5b47bc8d94 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:15.459307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee2bb3-dcac-4dcf-9b8c-ed5b47bc8d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:15.477021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-43ee2bb3-dcac-4dcf-9b8c-ed5b47bc8d94 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:15.478201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-43ee2bb3-dcac-4dcf-9b8c-ed5b47bc8d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:15.485935 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:13:15.636121 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cf548-9100-45f6-8d0c-19ae8ae2ee2e None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:15.651214 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cf548-9100-45f6-8d0c-19ae8ae2ee2e None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:15.656575 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c204be-3295-49cc-9bed-dea1a171a2da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:15.657466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c204be-3295-49cc-9bed-dea1a171a2da service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:15.657750 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c204be-3295-49cc-9bed-dea1a171a2da service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:15.658028 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c204be-3295-49cc-9bed-dea1a171a2da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:15.666666 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c204be-3295-49cc-9bed-dea1a171a2da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:15.668239 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c204be-3295-49cc-9bed-dea1a171a2da service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:15.677424 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 714/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:13:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:13:16.618740 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701043ec-a4cc-4939-b371-3a2fad90507c None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:16.619306 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701043ec-a4cc-4939-b371-3a2fad90507c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:16.619306 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701043ec-a4cc-4939-b371-3a2fad90507c None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:16.620672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:13:16.625525 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104982d-b90f-440b-bcf4-5b575c50d947 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:16.625975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104982d-b90f-440b-bcf4-5b575c50d947 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:16.626077 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104982d-b90f-440b-bcf4-5b575c50d947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:16.644016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-5104982d-b90f-440b-bcf4-5b575c50d947 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:16.645197 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-5104982d-b90f-440b-bcf4-5b575c50d947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:16.652802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:13:16.802551 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701043ec-a4cc-4939-b371-3a2fad90507c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:16.816980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701043ec-a4cc-4939-b371-3a2fad90507c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:16.822259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209c489-af71-4cf9-b16a-b126e8a62ca5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:16.822921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209c489-af71-4cf9-b16a-b126e8a62ca5 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:16.823207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209c489-af71-4cf9-b16a-b126e8a62ca5 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:16.823482 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209c489-af71-4cf9-b16a-b126e8a62ca5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:16.832146 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209c489-af71-4cf9-b16a-b126e8a62ca5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:16.833729 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209c489-af71-4cf9-b16a-b126e8a62ca5 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:16.843025 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 716/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:13:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:13:17.778781 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469e07d-c934-4dcc-a354-70cec6647c5d None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:17.779312 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469e07d-c934-4dcc-a354-70cec6647c5d None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:17.779312 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469e07d-c934-4dcc-a354-70cec6647c5d None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:17.780596 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:13:17.786327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f50972-8efc-4776-8051-93596de706f2 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:17.786782 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f50972-8efc-4776-8051-93596de706f2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:17.786926 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f50972-8efc-4776-8051-93596de706f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:17.804835 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-47f50972-8efc-4776-8051-93596de706f2 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:17.806013 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-47f50972-8efc-4776-8051-93596de706f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:17.813548 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:13:17.964594 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469e07d-c934-4dcc-a354-70cec6647c5d None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:17.979277 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469e07d-c934-4dcc-a354-70cec6647c5d None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:17.984519 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339d8f5-9930-4864-b3fa-b6969ae6e1dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:17.985144 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339d8f5-9930-4864-b3fa-b6969ae6e1dc service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:17.985425 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339d8f5-9930-4864-b3fa-b6969ae6e1dc service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:17.985699 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339d8f5-9930-4864-b3fa-b6969ae6e1dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:17.993645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339d8f5-9930-4864-b3fa-b6969ae6e1dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:17.995253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339d8f5-9930-4864-b3fa-b6969ae6e1dc service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:18.004290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 717/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:13:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:13:18.930618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add314ac-58e5-4adf-8cdd-dd893c807836 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:18.931155 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add314ac-58e5-4adf-8cdd-dd893c807836 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:18.931155 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add314ac-58e5-4adf-8cdd-dd893c807836 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:18.932485 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:13:18.937662 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90e676-5700-4982-adef-4fb95bd1683e None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:18.938096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90e676-5700-4982-adef-4fb95bd1683e None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:18.938228 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90e676-5700-4982-adef-4fb95bd1683e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:18.956217 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-5b90e676-5700-4982-adef-4fb95bd1683e None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:18.957393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-5b90e676-5700-4982-adef-4fb95bd1683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:18.965005 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:13:19.118182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add314ac-58e5-4adf-8cdd-dd893c807836 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:19.132086 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add314ac-58e5-4adf-8cdd-dd893c807836 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:19.137353 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd04552-fd56-4a16-95f9-f7d55b0f0268 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:19.137978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd04552-fd56-4a16-95f9-f7d55b0f0268 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:19.138263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd04552-fd56-4a16-95f9-f7d55b0f0268 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:19.138571 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd04552-fd56-4a16-95f9-f7d55b0f0268 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:19.146546 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd04552-fd56-4a16-95f9-f7d55b0f0268 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:19.148097 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd04552-fd56-4a16-95f9-f7d55b0f0268 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:19.157374 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 719/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:13:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:13:20.100667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e07bf0-257e-4e8e-8845-3bc3bb741b45 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:20.101195 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e07bf0-257e-4e8e-8845-3bc3bb741b45 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:20.101311 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e07bf0-257e-4e8e-8845-3bc3bb741b45 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:20.102604 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:13:20.107607 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107638a5-a068-4dcd-8588-68a4cfbeb252 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:20.107989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107638a5-a068-4dcd-8588-68a4cfbeb252 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:20.108183 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107638a5-a068-4dcd-8588-68a4cfbeb252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:20.125677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-107638a5-a068-4dcd-8588-68a4cfbeb252 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:20.126895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-107638a5-a068-4dcd-8588-68a4cfbeb252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:20.135353 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:13:20.286593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e07bf0-257e-4e8e-8845-3bc3bb741b45 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:20.300797 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e07bf0-257e-4e8e-8845-3bc3bb741b45 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:20.306012 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3a3da-6117-4aa5-8710-15fd977dc952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:20.306669 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3a3da-6117-4aa5-8710-15fd977dc952 service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:20.306952 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3a3da-6117-4aa5-8710-15fd977dc952 service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:20.307222 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3a3da-6117-4aa5-8710-15fd977dc952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:20.315118 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3a3da-6117-4aa5-8710-15fd977dc952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:20.316694 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3a3da-6117-4aa5-8710-15fd977dc952 service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:20.325948 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 720/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:13:22.432175 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6c394-9865-4e09-9a1a-7dc595739d5f None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:22.432724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6c394-9865-4e09-9a1a-7dc595739d5f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:22.432846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6c394-9865-4e09-9a1a-7dc595739d5f None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:22.434200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:13:22.439607 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc80a5-40f8-486c-9969-b7d033172e56 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:22.440072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc80a5-40f8-486c-9969-b7d033172e56 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:22.440434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc80a5-40f8-486c-9969-b7d033172e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:22.458575 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-41dc80a5-40f8-486c-9969-b7d033172e56 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:22.459771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-41dc80a5-40f8-486c-9969-b7d033172e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:22.468038 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:13:22.506934 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6c394-9865-4e09-9a1a-7dc595739d5f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:22.517413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6c394-9865-4e09-9a1a-7dc595739d5f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:22.521102 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b888b5-f428-48e8-bbad-6b26ab576d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:22.521737 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b888b5-f428-48e8-bbad-6b26ab576d1b service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:22.522026 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b888b5-f428-48e8-bbad-6b26ab576d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:22.522312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b888b5-f428-48e8-bbad-6b26ab576d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:22.531097 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b888b5-f428-48e8-bbad-6b26ab576d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:22.532785 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b888b5-f428-48e8-bbad-6b26ab576d1b service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:22.542117 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 722/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:13:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:13:24.924197 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6d508-4af7-4cbd-9b7d-8d6fdae03872 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:24.925490 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6d508-4af7-4cbd-9b7d-8d6fdae03872 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:24.925780 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6d508-4af7-4cbd-9b7d-8d6fdae03872 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:24.927190 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:13:24.932507 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad9625-e84f-433b-b778-3117eda6804b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:24.932944 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad9625-e84f-433b-b778-3117eda6804b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:24.933045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad9625-e84f-433b-b778-3117eda6804b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:24.950946 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-76ad9625-e84f-433b-b778-3117eda6804b None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:24.952124 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-76ad9625-e84f-433b-b778-3117eda6804b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:24.959896 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:13:24.998003 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6d508-4af7-4cbd-9b7d-8d6fdae03872 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:25.009454 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6d508-4af7-4cbd-9b7d-8d6fdae03872 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:25.012923 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b0b4a-455f-41bf-97b3-f71f4a3faaea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:25.016036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b0b4a-455f-41bf-97b3-f71f4a3faaea service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:25.016036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b0b4a-455f-41bf-97b3-f71f4a3faaea service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:25.016036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b0b4a-455f-41bf-97b3-f71f4a3faaea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:25.023337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b0b4a-455f-41bf-97b3-f71f4a3faaea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:25.024748 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b0b4a-455f-41bf-97b3-f71f4a3faaea service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:25.035192 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 723/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:13:27.612457 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b66f4a-67ed-4396-abd4-de855c122678 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:27.613076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b66f4a-67ed-4396-abd4-de855c122678 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:27.613076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b66f4a-67ed-4396-abd4-de855c122678 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:27.614505 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:13:27.619758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31166d9d-4d89-4f18-9c6d-0c52d200dac3 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:27.620211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31166d9d-4d89-4f18-9c6d-0c52d200dac3 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:27.620329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31166d9d-4d89-4f18-9c6d-0c52d200dac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:27.638559 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-31166d9d-4d89-4f18-9c6d-0c52d200dac3 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:27.640496 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-31166d9d-4d89-4f18-9c6d-0c52d200dac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:27.648427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:13:27.686573 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b66f4a-67ed-4396-abd4-de855c122678 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:27.698017 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b66f4a-67ed-4396-abd4-de855c122678 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:27.701476 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504c6e5-5e4e-4875-88c2-48ce0b9a0ffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:27.702103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504c6e5-5e4e-4875-88c2-48ce0b9a0ffe service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:27.702445 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504c6e5-5e4e-4875-88c2-48ce0b9a0ffe service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:27.702687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504c6e5-5e4e-4875-88c2-48ce0b9a0ffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:27.711259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504c6e5-5e4e-4875-88c2-48ce0b9a0ffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:27.712655 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504c6e5-5e4e-4875-88c2-48ce0b9a0ffe service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:27.721721 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 725/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:13:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:13:30.071834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cb181-48ac-4d94-90db-5a994b8c59a4 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:30.072411 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cb181-48ac-4d94-90db-5a994b8c59a4 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:30.072411 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cb181-48ac-4d94-90db-5a994b8c59a4 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:30.073739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:13:30.079113 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2e5f7-20e5-43ac-a10c-b430c3d5fecb None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:30.079562 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2e5f7-20e5-43ac-a10c-b430c3d5fecb None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:30.079693 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2e5f7-20e5-43ac-a10c-b430c3d5fecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:30.097975 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-4ba2e5f7-20e5-43ac-a10c-b430c3d5fecb None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:30.099192 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4ba2e5f7-20e5-43ac-a10c-b430c3d5fecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:30.106921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:13:30.144513 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cb181-48ac-4d94-90db-5a994b8c59a4 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:30.154903 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cb181-48ac-4d94-90db-5a994b8c59a4 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:30.159574 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d189c9c-6bb0-4467-aea5-d96d79c5daa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:30.160206 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d189c9c-6bb0-4467-aea5-d96d79c5daa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:30.160491 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d189c9c-6bb0-4467-aea5-d96d79c5daa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:30.160768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d189c9c-6bb0-4467-aea5-d96d79c5daa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:30.169507 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d189c9c-6bb0-4467-aea5-d96d79c5daa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:30.170955 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d189c9c-6bb0-4467-aea5-d96d79c5daa7 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:30.180336 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 726/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:13:32.439283 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55958d6a-e13c-4c04-a794-4fd32a04626c None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:32.440118 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55958d6a-e13c-4c04-a794-4fd32a04626c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:32.440118 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55958d6a-e13c-4c04-a794-4fd32a04626c None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:32.441203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:13:32.446630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a660b02-c448-4635-8add-cbd43033dded None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:32.447057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a660b02-c448-4635-8add-cbd43033dded None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:32.447175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a660b02-c448-4635-8add-cbd43033dded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:32.464801 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-4a660b02-c448-4635-8add-cbd43033dded None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:32.465990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4a660b02-c448-4635-8add-cbd43033dded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:32.474792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:13:32.511082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55958d6a-e13c-4c04-a794-4fd32a04626c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:32.521765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55958d6a-e13c-4c04-a794-4fd32a04626c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:32.525165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84068cad-bdce-414d-bf75-2f2a2e208056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:32.525789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84068cad-bdce-414d-bf75-2f2a2e208056 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:32.526070 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84068cad-bdce-414d-bf75-2f2a2e208056 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:32.526345 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84068cad-bdce-414d-bf75-2f2a2e208056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:32.535735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84068cad-bdce-414d-bf75-2f2a2e208056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:32.537143 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84068cad-bdce-414d-bf75-2f2a2e208056 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:32.546164 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 728/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:13:34.801439 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1016a1-0777-4d2c-8131-7d7be20b99fa None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:34.801983 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1016a1-0777-4d2c-8131-7d7be20b99fa None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:34.802109 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1016a1-0777-4d2c-8131-7d7be20b99fa None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:34.803414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:13:34.808850 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26640da-ee3e-452b-9ffc-08e0a85780fa None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:34.809245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26640da-ee3e-452b-9ffc-08e0a85780fa None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:34.809448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26640da-ee3e-452b-9ffc-08e0a85780fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:34.827888 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-e26640da-ee3e-452b-9ffc-08e0a85780fa None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:34.829077 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e26640da-ee3e-452b-9ffc-08e0a85780fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:34.837620 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:13:34.874786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1016a1-0777-4d2c-8131-7d7be20b99fa None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:34.885644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1016a1-0777-4d2c-8131-7d7be20b99fa None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:34.889096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07cb74-f276-4c5c-9432-f97c79bb1e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:34.889721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07cb74-f276-4c5c-9432-f97c79bb1e81 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:34.890002 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07cb74-f276-4c5c-9432-f97c79bb1e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:34.890275 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07cb74-f276-4c5c-9432-f97c79bb1e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:34.907699 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07cb74-f276-4c5c-9432-f97c79bb1e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:34.909143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07cb74-f276-4c5c-9432-f97c79bb1e81 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:34.918426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 729/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:13:37.278271 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c35b4f-d9c8-4e36-b0e8-2f2f0e8e7aa1 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:37.278882 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c35b4f-d9c8-4e36-b0e8-2f2f0e8e7aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:37.278882 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c35b4f-d9c8-4e36-b0e8-2f2f0e8e7aa1 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:37.280218 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:13:37.286689 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42566a74-572e-4666-979f-903019972535 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:37.287124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42566a74-572e-4666-979f-903019972535 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:37.287251 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42566a74-572e-4666-979f-903019972535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:37.305762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-42566a74-572e-4666-979f-903019972535 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:37.306987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-42566a74-572e-4666-979f-903019972535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:37.314794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:13:37.351246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c35b4f-d9c8-4e36-b0e8-2f2f0e8e7aa1 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:37.362132 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c35b4f-d9c8-4e36-b0e8-2f2f0e8e7aa1 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:37.365569 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e4b3b-7fae-410f-83d6-48eda7902ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:37.366192 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e4b3b-7fae-410f-83d6-48eda7902ecb service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:37.366497 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e4b3b-7fae-410f-83d6-48eda7902ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:37.366778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e4b3b-7fae-410f-83d6-48eda7902ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:37.375294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e4b3b-7fae-410f-83d6-48eda7902ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:37.376729 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e4b3b-7fae-410f-83d6-48eda7902ecb service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:37.385633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 731/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:13:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:13:39.639360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc697a5-b59f-4b9d-8313-9b7149a4d354 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:39.639895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc697a5-b59f-4b9d-8313-9b7149a4d354 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:39.639895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc697a5-b59f-4b9d-8313-9b7149a4d354 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:39.641268 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:13:39.647163 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cc55e-b4bd-483c-9747-383817203399 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:39.647609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cc55e-b4bd-483c-9747-383817203399 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:39.647752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cc55e-b4bd-483c-9747-383817203399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:39.665597 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-c90cc55e-b4bd-483c-9747-383817203399 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:39.666807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c90cc55e-b4bd-483c-9747-383817203399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:39.674587 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:13:39.710915 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc697a5-b59f-4b9d-8313-9b7149a4d354 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:39.722012 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc697a5-b59f-4b9d-8313-9b7149a4d354 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:39.725476 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cf896-f518-4c69-9b2d-c96e68c34ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:39.726102 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cf896-f518-4c69-9b2d-c96e68c34ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:39.726380 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cf896-f518-4c69-9b2d-c96e68c34ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:39.726684 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cf896-f518-4c69-9b2d-c96e68c34ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:39.735334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cf896-f518-4c69-9b2d-c96e68c34ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:39.736771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cf896-f518-4c69-9b2d-c96e68c34ae3 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:39.745726 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 732/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:13:41.960629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48a8e6-aaa5-49a5-a9ad-e931e82ea3bd None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:41.961178 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48a8e6-aaa5-49a5-a9ad-e931e82ea3bd None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:41.961178 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48a8e6-aaa5-49a5-a9ad-e931e82ea3bd None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:41.962566 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:13:41.967714 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd18240-8253-41e8-82da-489e2b602bc1 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:41.968125 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd18240-8253-41e8-82da-489e2b602bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:41.968273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd18240-8253-41e8-82da-489e2b602bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:41.985273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-3fd18240-8253-41e8-82da-489e2b602bc1 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:41.987001 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-3fd18240-8253-41e8-82da-489e2b602bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:41.994556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:13:42.030626 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48a8e6-aaa5-49a5-a9ad-e931e82ea3bd None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:42.032523 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6d48a8e6-aaa5-49a5-a9ad-e931e82ea3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:42.044939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48a8e6-aaa5-49a5-a9ad-e931e82ea3bd None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:42.048339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f88990-b6f4-421b-86f3-9af2d1bcff03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:42.049808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f88990-b6f4-421b-86f3-9af2d1bcff03 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:42.050092 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f88990-b6f4-421b-86f3-9af2d1bcff03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:42.050363 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f88990-b6f4-421b-86f3-9af2d1bcff03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:42.058962 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f88990-b6f4-421b-86f3-9af2d1bcff03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:42.060375 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f88990-b6f4-421b-86f3-9af2d1bcff03 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:42.070253 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 734/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:13:44.341725 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557aa9c-f4e5-4f72-809e-dfd6051a387a None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:44.342269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557aa9c-f4e5-4f72-809e-dfd6051a387a None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:44.342269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557aa9c-f4e5-4f72-809e-dfd6051a387a None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:44.343661 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:13:44.349147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f775c-b14f-48e4-a687-ea80f1b46485 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:44.349598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f775c-b14f-48e4-a687-ea80f1b46485 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:44.349734 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f775c-b14f-48e4-a687-ea80f1b46485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:44.367412 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-893f775c-b14f-48e4-a687-ea80f1b46485 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:13:44.368583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-893f775c-b14f-48e4-a687-ea80f1b46485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:44.376154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:13:44.412400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557aa9c-f4e5-4f72-809e-dfd6051a387a None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:44.422694 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557aa9c-f4e5-4f72-809e-dfd6051a387a None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:44.426729 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e1de6-b345-4cc9-ad23-b82c257c97e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:44.427357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e1de6-b345-4cc9-ad23-b82c257c97e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:44.427639 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e1de6-b345-4cc9-ad23-b82c257c97e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:44.427912 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e1de6-b345-4cc9-ad23-b82c257c97e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:44.436557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e1de6-b345-4cc9-ad23-b82c257c97e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:44.437954 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e1de6-b345-4cc9-ad23-b82c257c97e4 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:44.447706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 735/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:13:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:14:18.101410 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738b3e8-5d65-4fa2-a989-a37b8c777a6c None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:18.101996 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738b3e8-5d65-4fa2-a989-a37b8c777a6c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:18.101996 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738b3e8-5d65-4fa2-a989-a37b8c777a6c None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:18.103369 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 736/1471] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:14:18.108391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120a724-1be5-44fa-b1d5-51959e009a1f None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:18.108843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120a724-1be5-44fa-b1d5-51959e009a1f None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:18.108965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120a724-1be5-44fa-b1d5-51959e009a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:18.126396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-a120a724-1be5-44fa-b1d5-51959e009a1f None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:14:18.127626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a120a724-1be5-44fa-b1d5-51959e009a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:18.135486 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 736/1472] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:14:18.182621 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cfa7e-ef93-4137-be5d-cff344f128f1 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:18.182919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cfa7e-ef93-4137-be5d-cff344f128f1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:18.183205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cfa7e-ef93-4137-be5d-cff344f128f1 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:18.184563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 737/1473] 10.222.0.25 () {54 vars in 962 bytes} [Tue May 10 21:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:14:18.189364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e5835-7f15-4971-b1a3-7cb9170e28ee None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:18.189658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e5835-7f15-4971-b1a3-7cb9170e28ee None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:18.189941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e5835-7f15-4971-b1a3-7cb9170e28ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:18.207965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-8c9e5835-7f15-4971-b1a3-7cb9170e28ee None None] MFA Rules not processed for user `aa2b6514779d42fa81d34351607dea27`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:14:18.209187 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-8c9e5835-7f15-4971-b1a3-7cb9170e28ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:18.215640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 737/1474] 10.222.0.25 () {58 vars in 1059 bytes} [Tue May 10 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:14:18.223605 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cfa7e-ef93-4137-be5d-cff344f128f1 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:14:18.233950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cfa7e-ef93-4137-be5d-cff344f128f1 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:14:18.237744 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9805b-4bf0-4d02-b20e-abae65414b94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2b6514779d42fa81d34351607dea27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:14:18.238375 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9805b-4bf0-4d02-b20e-abae65414b94 service glance] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:18.238689 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9805b-4bf0-4d02-b20e-abae65414b94 service glance] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:18.238967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9805b-4bf0-4d02-b20e-abae65414b94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:18.247649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9805b-4bf0-4d02-b20e-abae65414b94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:14:18.249068 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9805b-4bf0-4d02-b20e-abae65414b94 service glance] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:14:18.258173 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 738/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:14:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:14:20.567302 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0c5d6-7c30-49a7-a76a-be9b35c2d292 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:20.567916 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0c5d6-7c30-49a7-a76a-be9b35c2d292 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:20.567916 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0c5d6-7c30-49a7-a76a-be9b35c2d292 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:20.569286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 738/1476] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:14:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:14:20.574427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce397-3ea4-4cac-8f11-5a1b1e212a94 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:20.574845 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce397-3ea4-4cac-8f11-5a1b1e212a94 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:20.575013 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce397-3ea4-4cac-8f11-5a1b1e212a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:20.591875 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d8cce397-3ea4-4cac-8f11-5a1b1e212a94 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:14:20.593048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d8cce397-3ea4-4cac-8f11-5a1b1e212a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:20.601062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 739/1477] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:14:20.624252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0c5d6-7c30-49a7-a76a-be9b35c2d292 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:14:20.636545 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0c5d6-7c30-49a7-a76a-be9b35c2d292 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:14:20.640997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef36279-478c-467d-9d5d-3b02212e520b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:14:20.641630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef36279-478c-467d-9d5d-3b02212e520b admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:20.641913 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef36279-478c-467d-9d5d-3b02212e520b admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:20.642188 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef36279-478c-467d-9d5d-3b02212e520b admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:20.642964 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef36279-478c-467d-9d5d-3b02212e520b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:14:20.644709 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: WARNING py.warnings [None req-7ef36279-478c-467d-9d5d-3b02212e520b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:14:20.644709 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: warnings.warn(msg) May 10 21:14:20.644709 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: May 10 21:14:20.645846 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef36279-478c-467d-9d5d-3b02212e520b admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:14:20.665173 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 739/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 10 21:14:20 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:14:22.908186 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c4dd3-3d0c-4c05-a523-12ccd9379abc None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:22.908734 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c4dd3-3d0c-4c05-a523-12ccd9379abc None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:22.908734 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c4dd3-3d0c-4c05-a523-12ccd9379abc None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:22.910105 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 740/1479] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:14:22.915243 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905765e-1db7-401f-9e3f-91fd458d63f4 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:22.915654 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905765e-1db7-401f-9e3f-91fd458d63f4 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:22.915871 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905765e-1db7-401f-9e3f-91fd458d63f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:22.934133 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-9905765e-1db7-401f-9e3f-91fd458d63f4 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:14:22.935363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-9905765e-1db7-401f-9e3f-91fd458d63f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:22.943430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 740/1480] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:14:22.986064 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c4dd3-3d0c-4c05-a523-12ccd9379abc None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:14:23.000349 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c4dd3-3d0c-4c05-a523-12ccd9379abc None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:14:23.005861 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b34dc-c1e5-4b09-9809-2ece0175a9c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:14:23.006548 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b34dc-c1e5-4b09-9809-2ece0175a9c5 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:23.006839 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b34dc-c1e5-4b09-9809-2ece0175a9c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:23.007121 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b34dc-c1e5-4b09-9809-2ece0175a9c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:23.015308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b34dc-c1e5-4b09-9809-2ece0175a9c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:14:23.017325 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b34dc-c1e5-4b09-9809-2ece0175a9c5 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:14:23.026620 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 741/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:14:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:14:25.450008 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a4324-c8a4-4db0-a967-790e40209974 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:25.450625 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a4324-c8a4-4db0-a967-790e40209974 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:25.450625 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a4324-c8a4-4db0-a967-790e40209974 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:25.451950 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 741/1482] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:14:25.457778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe91aa-d471-4852-9708-bc33932e9daa None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:25.458189 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe91aa-d471-4852-9708-bc33932e9daa None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:25.458335 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe91aa-d471-4852-9708-bc33932e9daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:25.475872 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6cfe91aa-d471-4852-9708-bc33932e9daa None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:14:25.477050 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6cfe91aa-d471-4852-9708-bc33932e9daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:25.484734 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 742/1483] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:14:25.520495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a4324-c8a4-4db0-a967-790e40209974 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:14:25.531993 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a4324-c8a4-4db0-a967-790e40209974 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:14:25.535513 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8368340-5ace-41ce-b9eb-632f64e48471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:14:25.536141 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8368340-5ace-41ce-b9eb-632f64e48471 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:25.536423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8368340-5ace-41ce-b9eb-632f64e48471 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:25.536694 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8368340-5ace-41ce-b9eb-632f64e48471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:25.545359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8368340-5ace-41ce-b9eb-632f64e48471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:14:25.546831 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8368340-5ace-41ce-b9eb-632f64e48471 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:14:25.555841 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 742/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:14:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:14:27.818674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3f598-81b0-462a-9015-6f8c82394c49 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:27.819216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3f598-81b0-462a-9015-6f8c82394c49 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:27.819216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3f598-81b0-462a-9015-6f8c82394c49 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:27.820503 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 743/1485] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:14:27.826019 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffba52-2e47-44b1-91b8-0b0ec10b3d59 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:27.826415 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffba52-2e47-44b1-91b8-0b0ec10b3d59 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:27.826621 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffba52-2e47-44b1-91b8-0b0ec10b3d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:27.845216 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-4dffba52-2e47-44b1-91b8-0b0ec10b3d59 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:14:27.846452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4dffba52-2e47-44b1-91b8-0b0ec10b3d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:27.854090 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 743/1486] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:14:27.891328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3f598-81b0-462a-9015-6f8c82394c49 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:14:27.901670 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3f598-81b0-462a-9015-6f8c82394c49 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:14:27.905366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f258cf3-b7ec-43af-b913-31fa32393da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:14:27.906602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f258cf3-b7ec-43af-b913-31fa32393da3 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:27.906887 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f258cf3-b7ec-43af-b913-31fa32393da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:27.907159 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f258cf3-b7ec-43af-b913-31fa32393da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:27.915566 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f258cf3-b7ec-43af-b913-31fa32393da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:14:27.916973 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f258cf3-b7ec-43af-b913-31fa32393da3 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:14:27.926209 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 744/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:14:30.248909 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337eb19-2fed-41ba-88f9-0133b5255b85 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:30.249736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337eb19-2fed-41ba-88f9-0133b5255b85 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:30.249736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337eb19-2fed-41ba-88f9-0133b5255b85 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:30.251013 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 744/1488] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:14:30.256175 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeaf55-6be3-44ed-a227-9fc4230a4535 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:30.256583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeaf55-6be3-44ed-a227-9fc4230a4535 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:30.256741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeaf55-6be3-44ed-a227-9fc4230a4535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:30.274655 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-29aeaf55-6be3-44ed-a227-9fc4230a4535 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:14:30.275890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-29aeaf55-6be3-44ed-a227-9fc4230a4535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:30.284453 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 745/1489] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:14:30.323615 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337eb19-2fed-41ba-88f9-0133b5255b85 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:14:30.334821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337eb19-2fed-41ba-88f9-0133b5255b85 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:14:30.338340 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe4709-c1b9-4e7e-9a74-b0671b40bd97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:14:30.339000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe4709-c1b9-4e7e-9a74-b0671b40bd97 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:30.339287 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe4709-c1b9-4e7e-9a74-b0671b40bd97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:30.339566 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe4709-c1b9-4e7e-9a74-b0671b40bd97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:30.348423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe4709-c1b9-4e7e-9a74-b0671b40bd97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:14:30.349841 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe4709-c1b9-4e7e-9a74-b0671b40bd97 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:14:30.359254 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 745/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:14:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:14:32.962786 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65830f41-2d72-4614-9479-d5cb1bf93f73 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:32.963346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65830f41-2d72-4614-9479-d5cb1bf93f73 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:32.963346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65830f41-2d72-4614-9479-d5cb1bf93f73 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:32.964699 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 746/1491] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 10 21:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:14:32.970845 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3800610-81ba-455c-b7b8-871db585bd1b None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:32.978698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3800610-81ba-455c-b7b8-871db585bd1b None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:32.978698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3800610-81ba-455c-b7b8-871db585bd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:32.988616 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-f3800610-81ba-455c-b7b8-871db585bd1b None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:14:32.989916 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-f3800610-81ba-455c-b7b8-871db585bd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:32.997716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 746/1492] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 10 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:14:33.036407 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65830f41-2d72-4614-9479-d5cb1bf93f73 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:14:33.047183 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65830f41-2d72-4614-9479-d5cb1bf93f73 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:14:33.052081 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afbec9-5966-498f-a83a-d0217cedcd08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:14:33.052423 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afbec9-5966-498f-a83a-d0217cedcd08 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:33.052712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afbec9-5966-498f-a83a-d0217cedcd08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:33.052993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afbec9-5966-498f-a83a-d0217cedcd08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:33.061746 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afbec9-5966-498f-a83a-d0217cedcd08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:14:33.063201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afbec9-5966-498f-a83a-d0217cedcd08 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:14:33.072525 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 747/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:16:28.507215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03cbf5-c9d2-4763-8406-6ed3e467e41b None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:16:28.507827 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03cbf5-c9d2-4763-8406-6ed3e467e41b None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:16:28.507827 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03cbf5-c9d2-4763-8406-6ed3e467e41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:16:28.526581 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-0c03cbf5-c9d2-4763-8406-6ed3e467e41b None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:16:28.527757 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-0c03cbf5-c9d2-4763-8406-6ed3e467e41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:16:28.535406 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 747/1494] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:16:28.544789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543976e-dc02-4423-8ce2-9e276376b79a None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:16:28.545280 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543976e-dc02-4423-8ce2-9e276376b79a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:16:28.545379 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543976e-dc02-4423-8ce2-9e276376b79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:16:28.562586 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f543976e-dc02-4423-8ce2-9e276376b79a None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:16:28.563767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f543976e-dc02-4423-8ce2-9e276376b79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:16:28.571419 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 748/1495] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:16:28.576571 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03cbf5-c9d2-4763-8406-6ed3e467e41b None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:16:28.586098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03cbf5-c9d2-4763-8406-6ed3e467e41b None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:16:28.591430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9e709-c1c1-4854-a47a-e5f6f9a014a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:16:28.592078 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9e709-c1c1-4854-a47a-e5f6f9a014a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:16:28.592364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9e709-c1c1-4854-a47a-e5f6f9a014a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:16:28.592661 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9e709-c1c1-4854-a47a-e5f6f9a014a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:16:28.593385 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9e709-c1c1-4854-a47a-e5f6f9a014a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:16:28.593697 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9e709-c1c1-4854-a47a-e5f6f9a014a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:16:28.594741 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: WARNING py.warnings [None req-02c9e709-c1c1-4854-a47a-e5f6f9a014a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:16:28.594741 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: warnings.warn(msg) May 10 21:16:28.594741 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: May 10 21:16:28.595653 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9e709-c1c1-4854-a47a-e5f6f9a014a6 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:16:28.607444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 748/1496] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:16:28.615330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543976e-dc02-4423-8ce2-9e276376b79a None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:16:28.624147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543976e-dc02-4423-8ce2-9e276376b79a None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:16:28.628548 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fc027-ef0b-40af-878b-bcd5dbb9e845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:16:28.629188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fc027-ef0b-40af-878b-bcd5dbb9e845 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:16:28.629465 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fc027-ef0b-40af-878b-bcd5dbb9e845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:16:28.629765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fc027-ef0b-40af-878b-bcd5dbb9e845 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:16:28.630459 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387fc027-ef0b-40af-878b-bcd5dbb9e845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:16:28.632199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: WARNING py.warnings [None req-387fc027-ef0b-40af-878b-bcd5dbb9e845 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:16:28.632199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: warnings.warn(msg) May 10 21:16:28.632199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: May 10 21:16:28.633373 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387fc027-ef0b-40af-878b-bcd5dbb9e845 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:16:28.761279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 749/1497] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:16:28 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:16:28.768682 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9e709-c1c1-4854-a47a-e5f6f9a014a6 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:16:28.779268 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9e709-c1c1-4854-a47a-e5f6f9a014a6 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:16:28.833154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fd55a-5c18-490d-973d-a50ac7c80c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:16:28.833811 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fd55a-5c18-490d-973d-a50ac7c80c84 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:16:28.834094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fd55a-5c18-490d-973d-a50ac7c80c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:16:28.834367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fd55a-5c18-490d-973d-a50ac7c80c84 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:16:28.835080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fd55a-5c18-490d-973d-a50ac7c80c84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:16:28.836083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: WARNING py.warnings [None req-722fd55a-5c18-490d-973d-a50ac7c80c84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:16:28.836083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: warnings.warn(msg) May 10 21:16:28.836083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: May 10 21:16:28.837282 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fd55a-5c18-490d-973d-a50ac7c80c84 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:16:28.941870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 749/1498] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:16:28 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:16:28.945995 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fc027-ef0b-40af-878b-bcd5dbb9e845 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:16:28.956782 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fc027-ef0b-40af-878b-bcd5dbb9e845 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:16:28.961331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2dc21-62b2-449f-a9a1-c6019d9ceae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:16:28.961992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2dc21-62b2-449f-a9a1-c6019d9ceae5 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:16:28.962279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2dc21-62b2-449f-a9a1-c6019d9ceae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:16:28.962720 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2dc21-62b2-449f-a9a1-c6019d9ceae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:16:28.963491 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2dc21-62b2-449f-a9a1-c6019d9ceae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:16:28.964493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: WARNING py.warnings [None req-44c2dc21-62b2-449f-a9a1-c6019d9ceae5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:16:28.964493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: warnings.warn(msg) May 10 21:16:28.964493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: May 10 21:16:28.965369 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2dc21-62b2-449f-a9a1-c6019d9ceae5 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:16:28.977714 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 750/1499] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:16:28.981673 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fd55a-5c18-490d-973d-a50ac7c80c84 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:16:28.991387 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fd55a-5c18-490d-973d-a50ac7c80c84 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:16:28.996568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4f6b9-1e61-4ed7-b948-0eba0533b62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:16:28.997211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4f6b9-1e61-4ed7-b948-0eba0533b62d admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:16:28.997491 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4f6b9-1e61-4ed7-b948-0eba0533b62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:16:28.997761 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4f6b9-1e61-4ed7-b948-0eba0533b62d admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:16:28.998581 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4f6b9-1e61-4ed7-b948-0eba0533b62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:16:28.999597 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: WARNING py.warnings [None req-90c4f6b9-1e61-4ed7-b948-0eba0533b62d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:16:28.999597 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: warnings.warn(msg) May 10 21:16:28.999597 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: May 10 21:16:29.000474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4f6b9-1e61-4ed7-b948-0eba0533b62d admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:16:29.014053 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 750/1500] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:16:29.018180 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2dc21-62b2-449f-a9a1-c6019d9ceae5 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:16:29.028254 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2dc21-62b2-449f-a9a1-c6019d9ceae5 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:16:29.032807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e88f50-6ced-4812-907e-f8a5a740eeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:16:29.033683 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e88f50-6ced-4812-907e-f8a5a740eeb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:16:29.033964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e88f50-6ced-4812-907e-f8a5a740eeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:16:29.034239 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e88f50-6ced-4812-907e-f8a5a740eeb2 admin admin] PATH_INFO: `/v3/projects/c31e81e00ea24cbfa64f9e30f5e176f3/users/41244e5dbceb48adb5d3de7a3d01bfae/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:16:29.048801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e88f50-6ced-4812-907e-f8a5a740eeb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31e81e00ea24cbfa64f9e30f5e176f3, user_id=41244e5dbceb48adb5d3de7a3d01bfae, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:16:29.055411 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: WARNING py.warnings [None req-e9e88f50-6ced-4812-907e-f8a5a740eeb2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:16:29.055411 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: warnings.warn(msg) May 10 21:16:29.055411 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: May 10 21:16:29.055411 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e88f50-6ced-4812-907e-f8a5a740eeb2 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:16:29.127223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 751/1501] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:16:29 2022] PUT /identity/v3/projects/c31e81e00ea24cbfa64f9e30f5e176f3/users/41244e5dbceb48adb5d3de7a3d01bfae/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:16:29.139183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b5561-069b-4dad-9afe-f524b0ad2b49 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:16:29.139475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b5561-069b-4dad-9afe-f524b0ad2b49 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:16:29.139755 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b5561-069b-4dad-9afe-f524b0ad2b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:16:29.167254 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-655b5561-069b-4dad-9afe-f524b0ad2b49 None None] MFA Rules not processed for user `41244e5dbceb48adb5d3de7a3d01bfae`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:16:29.168507 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-655b5561-069b-4dad-9afe-f524b0ad2b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:16:29.229634 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 751/1502] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:16:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:16:29.242924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d7b63-5154-4198-9022-31e5f04bb8a4 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:16:29.243219 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d7b63-5154-4198-9022-31e5f04bb8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:16:29.243500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d7b63-5154-4198-9022-31e5f04bb8a4 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:16:29.245670 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 752/1503] 10.222.0.25 () {54 vars in 963 bytes} [Tue May 10 21:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:16:29.250348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87d3f6-d1c5-4f5e-8d82-4bce69ae24ff None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:16:29.250667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87d3f6-d1c5-4f5e-8d82-4bce69ae24ff None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:16:29.250946 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87d3f6-d1c5-4f5e-8d82-4bce69ae24ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:16:29.268465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-bf87d3f6-d1c5-4f5e-8d82-4bce69ae24ff None None] MFA Rules not processed for user `c4dfa98f420c4c4c845262a78ae75ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:16:29.269588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-bf87d3f6-d1c5-4f5e-8d82-4bce69ae24ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:16:29.318448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 752/1504] 10.222.0.25 () {58 vars in 1060 bytes} [Tue May 10 21:16:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:16:29.325960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d7b63-5154-4198-9022-31e5f04bb8a4 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:16:29.336175 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d7b63-5154-4198-9022-31e5f04bb8a4 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:16:29.339796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f85013-9833-404e-b5d3-92a508bea237 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:16:29.340419 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f85013-9833-404e-b5d3-92a508bea237 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:16:29.340703 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f85013-9833-404e-b5d3-92a508bea237 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:16:29.340983 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f85013-9833-404e-b5d3-92a508bea237 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:16:29.348922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f85013-9833-404e-b5d3-92a508bea237 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:16:29.350319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f85013-9833-404e-b5d3-92a508bea237 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:16:29.359372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 753/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:16:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:16:29.401306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634403c-05bd-469c-9146-ac46191a4272 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:16:29.401623 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634403c-05bd-469c-9146-ac46191a4272 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:16:29.401898 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634403c-05bd-469c-9146-ac46191a4272 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:16:29.403228 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 753/1506] 10.222.0.25 () {52 vars in 829 bytes} [Tue May 10 21:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:16:29.406748 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f85013-9833-404e-b5d3-92a508bea237 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:16:29.465340 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f85013-9833-404e-b5d3-92a508bea237 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:16:29.469787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d00fa1-23e7-4efd-91ce-ac425097bf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:16:29.470671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d00fa1-23e7-4efd-91ce-ac425097bf46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:16:29.470957 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d00fa1-23e7-4efd-91ce-ac425097bf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:16:29.471232 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d00fa1-23e7-4efd-91ce-ac425097bf46 admin admin] PATH_INFO: `/v3/users/41244e5dbceb48adb5d3de7a3d01bfae` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:16:29.472407 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d00fa1-23e7-4efd-91ce-ac425097bf46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41244e5dbceb48adb5d3de7a3d01bfae)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:16:29.473410 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: WARNING py.warnings [None req-94d00fa1-23e7-4efd-91ce-ac425097bf46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:16:29.473410 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: warnings.warn(msg) May 10 21:16:29.473410 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: May 10 21:16:29.474640 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d00fa1-23e7-4efd-91ce-ac425097bf46 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:16:29.680298 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-94d00fa1-23e7-4efd-91ce-ac425097bf46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41244e5dbceb48adb5d3de7a3d01bfae'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:16:29.680970 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-94d00fa1-23e7-4efd-91ce-ac425097bf46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41244e5dbceb48adb5d3de7a3d01bfae'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:16:29.681613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-94d00fa1-23e7-4efd-91ce-ac425097bf46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41244e5dbceb48adb5d3de7a3d01bfae'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:16:29.701177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-94d00fa1-23e7-4efd-91ce-ac425097bf46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41244e5dbceb48adb5d3de7a3d01bfae'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:16:29.841496 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-94d00fa1-23e7-4efd-91ce-ac425097bf46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41244e5dbceb48adb5d3de7a3d01bfae'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:16:29.902709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 754/1507] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:16:29 2022] DELETE /identity/v3/users/41244e5dbceb48adb5d3de7a3d01bfae => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:16:29.907143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428cff-271e-42a7-aa11-c51b9ced3b5a None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:16:29.907613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428cff-271e-42a7-aa11-c51b9ced3b5a None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:16:29.907736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428cff-271e-42a7-aa11-c51b9ced3b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:16:29.925266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-9c428cff-271e-42a7-aa11-c51b9ced3b5a None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:16:29.926489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-9c428cff-271e-42a7-aa11-c51b9ced3b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:16:29.983235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 754/1508] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:16:29.992613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d00fa1-23e7-4efd-91ce-ac425097bf46 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:16:29.994039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-94d00fa1-23e7-4efd-91ce-ac425097bf46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:16:30.049812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d00fa1-23e7-4efd-91ce-ac425097bf46 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:16:30.053303 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17484036-74c7-4c76-beee-86d64e54fd17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:16:30.053951 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17484036-74c7-4c76-beee-86d64e54fd17 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:16:30.054234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17484036-74c7-4c76-beee-86d64e54fd17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:16:30.054552 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17484036-74c7-4c76-beee-86d64e54fd17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:16:30.063610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17484036-74c7-4c76-beee-86d64e54fd17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:16:30.065020 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17484036-74c7-4c76-beee-86d64e54fd17 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:16:30.074966 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 755/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:16:30.492494 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c428cff-271e-42a7-aa11-c51b9ced3b5a None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:16:30.494181 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-9c428cff-271e-42a7-aa11-c51b9ced3b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:16:30.506186 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c428cff-271e-42a7-aa11-c51b9ced3b5a None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:16:30.511885 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48eb6b5-4066-4b73-953b-b4605b527618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:16:30.512768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eb6b5-4066-4b73-953b-b4605b527618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:16:30.513035 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eb6b5-4066-4b73-953b-b4605b527618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:16:30.513384 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eb6b5-4066-4b73-953b-b4605b527618 admin admin] PATH_INFO: `/v3/projects/c31e81e00ea24cbfa64f9e30f5e176f3` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:16:30.514533 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48eb6b5-4066-4b73-953b-b4605b527618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c31e81e00ea24cbfa64f9e30f5e176f3)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:16:30.515571 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: WARNING py.warnings [None req-d48eb6b5-4066-4b73-953b-b4605b527618 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:16:30.515571 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: warnings.warn(msg) May 10 21:16:30.515571 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: May 10 21:16:30.517761 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48eb6b5-4066-4b73-953b-b4605b527618 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:16:30.615124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d48eb6b5-4066-4b73-953b-b4605b527618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31e81e00ea24cbfa64f9e30f5e176f3', 'request_id': 'req-d48eb6b5-4066-4b73-953b-b4605b527618'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:16:30.679013 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d48eb6b5-4066-4b73-953b-b4605b527618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31e81e00ea24cbfa64f9e30f5e176f3', 'request_id': 'req-d48eb6b5-4066-4b73-953b-b4605b527618'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:16:30.685434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d48eb6b5-4066-4b73-953b-b4605b527618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31e81e00ea24cbfa64f9e30f5e176f3', 'request_id': 'req-d48eb6b5-4066-4b73-953b-b4605b527618'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:16:30.704131 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d48eb6b5-4066-4b73-953b-b4605b527618 admin admin] The token cache is being invalidate because project c31e81e00ea24cbfa64f9e30f5e176f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:16:30.704423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d48eb6b5-4066-4b73-953b-b4605b527618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:16:30.705082 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d48eb6b5-4066-4b73-953b-b4605b527618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:16:30.706786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 755/1510] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:16:30 2022] DELETE /identity/v3/projects/c31e81e00ea24cbfa64f9e30f5e176f3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:18:08.436510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64dd24-2b77-492c-a5bc-2cecf27f1489 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:08.437114 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64dd24-2b77-492c-a5bc-2cecf27f1489 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:08.437114 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64dd24-2b77-492c-a5bc-2cecf27f1489 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:08.438509 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:18:08.443291 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63793a0b-4c4d-4b09-997c-c0f067d2c49c None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:08.443749 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63793a0b-4c4d-4b09-997c-c0f067d2c49c None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:08.443888 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63793a0b-4c4d-4b09-997c-c0f067d2c49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:08.462383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-63793a0b-4c4d-4b09-997c-c0f067d2c49c None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:18:08.463614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-63793a0b-4c4d-4b09-997c-c0f067d2c49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:18:08.521502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:18:08.691885 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64dd24-2b77-492c-a5bc-2cecf27f1489 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:18:08.693487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1b64dd24-2b77-492c-a5bc-2cecf27f1489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:18:08.765855 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64dd24-2b77-492c-a5bc-2cecf27f1489 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:18:08.771509 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde36cc1-739f-426a-b732-85f27c62f253 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:18:08.772152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde36cc1-739f-426a-b732-85f27c62f253 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:08.772440 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde36cc1-739f-426a-b732-85f27c62f253 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:08.772725 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde36cc1-739f-426a-b732-85f27c62f253 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:08.780695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde36cc1-739f-426a-b732-85f27c62f253 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:18:08.782273 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde36cc1-739f-426a-b732-85f27c62f253 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:18:08.792353 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 757/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:18:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:18:09.552199 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c4c2e-d491-4d87-914b-31f06ecbb793 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:09.552771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c4c2e-d491-4d87-914b-31f06ecbb793 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:09.552891 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c4c2e-d491-4d87-914b-31f06ecbb793 None None] PATH_INFO: `/v3` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:09.554329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 757/1514] 10.222.0.23 () {54 vars in 925 bytes} [Tue May 10 21:18:09 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:18:09.561382 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d97bb-6961-4708-a04e-1a228e871536 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:09.561872 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d97bb-6961-4708-a04e-1a228e871536 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:09.561976 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d97bb-6961-4708-a04e-1a228e871536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:09.581190 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7d8d97bb-6961-4708-a04e-1a228e871536 None None] MFA Rules not processed for user `9a13ad1e10ff44c4b870b45b7416b70f`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:18:09.582375 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7d8d97bb-6961-4708-a04e-1a228e871536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:18:09.645562 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 758/1515] 10.222.0.23 () {58 vars in 1015 bytes} [Tue May 10 21:18:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:18:09.697301 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81774c5c-f377-4cd2-8299-76eeff9635fd None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:09.697518 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81774c5c-f377-4cd2-8299-76eeff9635fd None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:09.697803 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81774c5c-f377-4cd2-8299-76eeff9635fd None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:09.699260 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 758/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:18:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:18:09.704002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f39c1-90d8-4759-a3dd-5559d8aae6ec None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:09.704294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f39c1-90d8-4759-a3dd-5559d8aae6ec None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:09.704572 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f39c1-90d8-4759-a3dd-5559d8aae6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:09.722988 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a28f39c1-90d8-4759-a3dd-5559d8aae6ec None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:18:09.724185 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a28f39c1-90d8-4759-a3dd-5559d8aae6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:18:09.733058 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 759/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:18:09.885787 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81774c5c-f377-4cd2-8299-76eeff9635fd None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:18:09.901023 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81774c5c-f377-4cd2-8299-76eeff9635fd None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:18:09.906346 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b0f27-20dd-4eb8-9034-0e2fbe9d6f84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:18:09.907003 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b0f27-20dd-4eb8-9034-0e2fbe9d6f84 service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:09.907287 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b0f27-20dd-4eb8-9034-0e2fbe9d6f84 service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:09.907559 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b0f27-20dd-4eb8-9034-0e2fbe9d6f84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:09.915638 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b0f27-20dd-4eb8-9034-0e2fbe9d6f84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:18:09.917219 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b0f27-20dd-4eb8-9034-0e2fbe9d6f84 service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:18:09.926189 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 759/1518] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:18:13.665408 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b438e83-1da1-4833-a2ee-f274a99bb40f None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:13.665922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b438e83-1da1-4833-a2ee-f274a99bb40f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:13.666020 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b438e83-1da1-4833-a2ee-f274a99bb40f None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:13.667359 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 760/1519] 10.222.0.25 () {54 vars in 960 bytes} [Tue May 10 21:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:18:13.672337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9ab9d-96d1-43da-91bb-108ad2235e21 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:13.672766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9ab9d-96d1-43da-91bb-108ad2235e21 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:13.673041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9ab9d-96d1-43da-91bb-108ad2235e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:13.692161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-4fa9ab9d-96d1-43da-91bb-108ad2235e21 None None] MFA Rules not processed for user `9a13ad1e10ff44c4b870b45b7416b70f`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:18:13.693458 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4fa9ab9d-96d1-43da-91bb-108ad2235e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:18:13.702850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 760/1520] 10.222.0.25 () {58 vars in 1057 bytes} [Tue May 10 21:18:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:18:13.710826 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b438e83-1da1-4833-a2ee-f274a99bb40f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:18:13.723936 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b438e83-1da1-4833-a2ee-f274a99bb40f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:18:13.729160 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fa21a-48be-411f-addf-e4307248d4b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a13ad1e10ff44c4b870b45b7416b70f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:18:13.729796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fa21a-48be-411f-addf-e4307248d4b2 service placement] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:13.730085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fa21a-48be-411f-addf-e4307248d4b2 service placement] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:13.730359 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fa21a-48be-411f-addf-e4307248d4b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:13.738566 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7fa21a-48be-411f-addf-e4307248d4b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:18:13.740131 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7fa21a-48be-411f-addf-e4307248d4b2 service placement] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:18:13.750407 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 761/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:18:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:18:21.214797 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70905941-655a-4aa3-a835-ad70eb71be3a None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:21.215277 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70905941-655a-4aa3-a835-ad70eb71be3a None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:21.215385 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70905941-655a-4aa3-a835-ad70eb71be3a None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:21.216696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:18:21.221713 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17581f54-15ff-47ad-8d08-084f856a0576 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:21.225263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17581f54-15ff-47ad-8d08-084f856a0576 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:21.225263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17581f54-15ff-47ad-8d08-084f856a0576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:21.240701 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-17581f54-15ff-47ad-8d08-084f856a0576 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:18:21.241885 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-17581f54-15ff-47ad-8d08-084f856a0576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:18:21.249750 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:18:21.398860 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70905941-655a-4aa3-a835-ad70eb71be3a None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:18:21.413131 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70905941-655a-4aa3-a835-ad70eb71be3a None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:18:21.419032 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125b708-af09-4832-ada5-1a1731963119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:18:21.419669 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125b708-af09-4832-ada5-1a1731963119 service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:21.419953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125b708-af09-4832-ada5-1a1731963119 service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:21.420230 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125b708-af09-4832-ada5-1a1731963119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:21.428131 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125b708-af09-4832-ada5-1a1731963119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:18:21.430225 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125b708-af09-4832-ada5-1a1731963119 service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:18:21.439447 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 762/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:18:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:18:22.322284 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f1afa-6dcb-451b-9c75-485338ef5c1a None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:22.322914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f1afa-6dcb-451b-9c75-485338ef5c1a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:22.322914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f1afa-6dcb-451b-9c75-485338ef5c1a None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:22.324234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:18:22.329149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf8ee7-d802-4305-acaf-c229f46554d8 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:22.329580 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf8ee7-d802-4305-acaf-c229f46554d8 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:22.329731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf8ee7-d802-4305-acaf-c229f46554d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:22.350503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-3adf8ee7-d802-4305-acaf-c229f46554d8 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:18:22.351745 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-3adf8ee7-d802-4305-acaf-c229f46554d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:18:22.359444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:18:22.511231 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f1afa-6dcb-451b-9c75-485338ef5c1a None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:18:22.526135 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f1afa-6dcb-451b-9c75-485338ef5c1a None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:18:22.531480 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebc876-be95-4fc2-b3d5-dbc51e678a97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:18:22.532112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebc876-be95-4fc2-b3d5-dbc51e678a97 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:22.532399 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebc876-be95-4fc2-b3d5-dbc51e678a97 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:22.532675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebc876-be95-4fc2-b3d5-dbc51e678a97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:22.540741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebc876-be95-4fc2-b3d5-dbc51e678a97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:18:22.542288 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebc876-be95-4fc2-b3d5-dbc51e678a97 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:18:22.551407 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 764/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:18:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:18:26.574941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7957a5a-0f22-4c81-8918-e9b6e602281c None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:26.575521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7957a5a-0f22-4c81-8918-e9b6e602281c None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:26.575521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7957a5a-0f22-4c81-8918-e9b6e602281c None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:26.576876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:18:26.581949 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a0713-4216-45ca-9333-f8f761b15d34 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:26.582392 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a0713-4216-45ca-9333-f8f761b15d34 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:26.582531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a0713-4216-45ca-9333-f8f761b15d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:26.600229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-173a0713-4216-45ca-9333-f8f761b15d34 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:18:26.602000 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-173a0713-4216-45ca-9333-f8f761b15d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:18:26.609672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:18:26.645260 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7957a5a-0f22-4c81-8918-e9b6e602281c None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:18:26.646935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-f7957a5a-0f22-4c81-8918-e9b6e602281c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:18:26.701630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7957a5a-0f22-4c81-8918-e9b6e602281c None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:18:26.705104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fefd74-635f-4721-9cb0-4b283c5545eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:18:26.705736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fefd74-635f-4721-9cb0-4b283c5545eb service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:26.706020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fefd74-635f-4721-9cb0-4b283c5545eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:26.706300 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fefd74-635f-4721-9cb0-4b283c5545eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:26.715720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fefd74-635f-4721-9cb0-4b283c5545eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:18:26.717139 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fefd74-635f-4721-9cb0-4b283c5545eb service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:18:26.726768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 765/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:18:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:18:28.968730 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9ea0e-5b56-4a5a-b1c0-129b3b2e95b0 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:28.969314 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9ea0e-5b56-4a5a-b1c0-129b3b2e95b0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:28.969314 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9ea0e-5b56-4a5a-b1c0-129b3b2e95b0 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:28.970733 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:18:28.975899 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71170d10-dc57-4486-b416-f79d8cc863d1 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:28.976562 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71170d10-dc57-4486-b416-f79d8cc863d1 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:28.976562 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71170d10-dc57-4486-b416-f79d8cc863d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:28.995061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-71170d10-dc57-4486-b416-f79d8cc863d1 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:18:28.996292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-71170d10-dc57-4486-b416-f79d8cc863d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:18:29.004112 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:18:29.040389 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9ea0e-5b56-4a5a-b1c0-129b3b2e95b0 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:18:29.051228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9ea0e-5b56-4a5a-b1c0-129b3b2e95b0 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:18:29.054861 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02b2fe-668a-4462-8405-23902ed463fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:18:29.055521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02b2fe-668a-4462-8405-23902ed463fb service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:29.055803 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02b2fe-668a-4462-8405-23902ed463fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:29.056076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02b2fe-668a-4462-8405-23902ed463fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:29.065172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02b2fe-668a-4462-8405-23902ed463fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:18:29.066603 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02b2fe-668a-4462-8405-23902ed463fb service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:18:29.076329 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 767/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:18:32.868795 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74630d9f-68a2-4e85-9b43-07f7fe229cf4 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:32.869274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74630d9f-68a2-4e85-9b43-07f7fe229cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:32.869394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74630d9f-68a2-4e85-9b43-07f7fe229cf4 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:32.870751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:18:32.876045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4bed6-54cc-470f-b667-e067bababd0e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:32.876493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4bed6-54cc-470f-b667-e067bababd0e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:32.876614 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4bed6-54cc-470f-b667-e067bababd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:32.894041 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-e0a4bed6-54cc-470f-b667-e067bababd0e None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:18:32.895235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e0a4bed6-54cc-470f-b667-e067bababd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:18:32.903008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:18:33.171988 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74630d9f-68a2-4e85-9b43-07f7fe229cf4 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:18:33.173706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-74630d9f-68a2-4e85-9b43-07f7fe229cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:18:33.230756 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74630d9f-68a2-4e85-9b43-07f7fe229cf4 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:18:33.234204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015dedc2-01c1-45e7-a72a-51fa023eb383 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:18:33.234875 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015dedc2-01c1-45e7-a72a-51fa023eb383 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:33.235159 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015dedc2-01c1-45e7-a72a-51fa023eb383 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:33.235433 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015dedc2-01c1-45e7-a72a-51fa023eb383 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:33.244668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015dedc2-01c1-45e7-a72a-51fa023eb383 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:18:33.246089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015dedc2-01c1-45e7-a72a-51fa023eb383 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:18:33.255256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 768/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:18:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:18:35.507826 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2fca4-469b-40e8-ac5f-72f4357f066e None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:35.508366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2fca4-469b-40e8-ac5f-72f4357f066e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:35.508366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2fca4-469b-40e8-ac5f-72f4357f066e None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:35.509783 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:18:35.515147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ae213-5f40-41c4-905e-1d448902cc5c None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:35.515530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ae213-5f40-41c4-905e-1d448902cc5c None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:35.515706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ae213-5f40-41c4-905e-1d448902cc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:35.534201 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-011ae213-5f40-41c4-905e-1d448902cc5c None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:18:35.535439 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-011ae213-5f40-41c4-905e-1d448902cc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:18:35.544295 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:18:35.813561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2fca4-469b-40e8-ac5f-72f4357f066e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:18:35.815228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5fe2fca4-469b-40e8-ac5f-72f4357f066e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:18:35.828258 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2fca4-469b-40e8-ac5f-72f4357f066e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:18:35.831843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40269731-9d30-48f7-85d8-9d368038d8ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:18:35.832479 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40269731-9d30-48f7-85d8-9d368038d8ca service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:35.832762 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40269731-9d30-48f7-85d8-9d368038d8ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:35.833036 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40269731-9d30-48f7-85d8-9d368038d8ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:35.841888 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40269731-9d30-48f7-85d8-9d368038d8ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:18:35.843797 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40269731-9d30-48f7-85d8-9d368038d8ca service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:18:35.853216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 770/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:06.165902 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a29772-4601-4601-87d4-457ada8fcf82 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.167088 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a29772-4601-4601-87d4-457ada8fcf82 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.167550 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a29772-4601-4601-87d4-457ada8fcf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.198291 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-e3a29772-4601-4601-87d4-457ada8fcf82 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:06.199914 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e3a29772-4601-4601-87d4-457ada8fcf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:06.213678 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 770/1540] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:06.224042 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b3bc2-831a-4275-abf1-b4e9eb3558c8 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.224662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b3bc2-831a-4275-abf1-b4e9eb3558c8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.224662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b3bc2-831a-4275-abf1-b4e9eb3558c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.252814 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-ae5b3bc2-831a-4275-abf1-b4e9eb3558c8 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:06.254099 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ae5b3bc2-831a-4275-abf1-b4e9eb3558c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:06.267566 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 771/1541] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:20:06.272432 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a29772-4601-4601-87d4-457ada8fcf82 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:06.283538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a29772-4601-4601-87d4-457ada8fcf82 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:06.294468 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf135b4-da90-43e7-b778-4416daadb11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:06.295495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf135b4-da90-43e7-b778-4416daadb11c admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.295948 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf135b4-da90-43e7-b778-4416daadb11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.296392 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf135b4-da90-43e7-b778-4416daadb11c admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.297314 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf135b4-da90-43e7-b778-4416daadb11c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:20:06.297801 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf135b4-da90-43e7-b778-4416daadb11c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:06.307337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf135b4-da90-43e7-b778-4416daadb11c admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:06.321237 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 771/1542] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:20:06.329684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b3bc2-831a-4275-abf1-b4e9eb3558c8 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:06.347493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b3bc2-831a-4275-abf1-b4e9eb3558c8 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:06.353186 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc551cb-3562-4f1a-ab1a-2c44c789659f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:06.353942 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc551cb-3562-4f1a-ab1a-2c44c789659f admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.354231 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc551cb-3562-4f1a-ab1a-2c44c789659f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.354529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc551cb-3562-4f1a-ab1a-2c44c789659f admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.355861 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc551cb-3562-4f1a-ab1a-2c44c789659f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:06.357939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc551cb-3562-4f1a-ab1a-2c44c789659f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:06.371248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b0616-0d05-424d-8459-580e794ec2f9 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.371788 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b0616-0d05-424d-8459-580e794ec2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.372246 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b0616-0d05-424d-8459-580e794ec2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.392924 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-f79b0616-0d05-424d-8459-580e794ec2f9 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:06.397608 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-f79b0616-0d05-424d-8459-580e794ec2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:06.410765 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 772/1543] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:20:06.424492 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d3e25-ece3-4d08-84fd-3d9ec3138281 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.425129 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d3e25-ece3-4d08-84fd-3d9ec3138281 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.425634 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d3e25-ece3-4d08-84fd-3d9ec3138281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.449508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-8e2d3e25-ece3-4d08-84fd-3d9ec3138281 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:06.451796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-8e2d3e25-ece3-4d08-84fd-3d9ec3138281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:06.462883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 773/1544] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:06.468521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99983ee0-1555-4295-93a7-5fe2557652a7 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.469081 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99983ee0-1555-4295-93a7-5fe2557652a7 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.469581 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99983ee0-1555-4295-93a7-5fe2557652a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.485378 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 772/1545] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:06 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:06.489696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-99983ee0-1555-4295-93a7-5fe2557652a7 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:06.491222 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-99983ee0-1555-4295-93a7-5fe2557652a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:06.494987 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7ac3e-f6c7-414b-8282-56f4a6c68e3b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.495318 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7ac3e-f6c7-414b-8282-56f4a6c68e3b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.495597 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7ac3e-f6c7-414b-8282-56f4a6c68e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.524944 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-ece7ac3e-f6c7-414b-8282-56f4a6c68e3b None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:06.526251 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ece7ac3e-f6c7-414b-8282-56f4a6c68e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:06.557397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 774/1546] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:06.558375 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99983ee0-1555-4295-93a7-5fe2557652a7 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:06.567671 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99983ee0-1555-4295-93a7-5fe2557652a7 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:06.572933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559444b-4032-41cb-b9d3-94e094df5f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:06.573616 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559444b-4032-41cb-b9d3-94e094df5f2b admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.573901 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559444b-4032-41cb-b9d3-94e094df5f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.574178 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559444b-4032-41cb-b9d3-94e094df5f2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.574965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559444b-4032-41cb-b9d3-94e094df5f2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:20:06.575270 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559444b-4032-41cb-b9d3-94e094df5f2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:06.577010 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559444b-4032-41cb-b9d3-94e094df5f2b admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:06.589867 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 775/1547] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:20:06.591141 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3aeae-267f-4b3c-adfd-d2c479412b92 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.591428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3aeae-267f-4b3c-adfd-d2c479412b92 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.591705 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3aeae-267f-4b3c-adfd-d2c479412b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.598465 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 773/1548] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:06.599276 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7ac3e-f6c7-414b-8282-56f4a6c68e3b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:06.608827 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7ac3e-f6c7-414b-8282-56f4a6c68e3b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:06.613256 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e1bbb-6581-4fdd-9d5c-df9854910c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:06.613913 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e1bbb-6581-4fdd-9d5c-df9854910c33 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.614041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-6de3aeae-267f-4b3c-adfd-d2c479412b92 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:06.614192 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e1bbb-6581-4fdd-9d5c-df9854910c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.614491 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e1bbb-6581-4fdd-9d5c-df9854910c33 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.615209 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e1bbb-6581-4fdd-9d5c-df9854910c33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:06.615363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-6de3aeae-267f-4b3c-adfd-d2c479412b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:06.616204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: WARNING py.warnings [None req-179e1bbb-6581-4fdd-9d5c-df9854910c33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:20:06.616204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: warnings.warn(msg) May 10 21:20:06.616204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: May 10 21:20:06.617681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e1bbb-6581-4fdd-9d5c-df9854910c33 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:06.624011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 776/1549] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:06.625538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836af97-fc42-44ae-9d99-d2e0dd19b174 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.625833 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836af97-fc42-44ae-9d99-d2e0dd19b174 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.626113 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836af97-fc42-44ae-9d99-d2e0dd19b174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.645223 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-b836af97-fc42-44ae-9d99-d2e0dd19b174 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:06.646469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-b836af97-fc42-44ae-9d99-d2e0dd19b174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:06.655511 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 777/1550] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:06.656843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78e507-8ef8-41d5-b270-7d0445e21ce8 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.657141 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78e507-8ef8-41d5-b270-7d0445e21ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.657421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78e507-8ef8-41d5-b270-7d0445e21ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.676233 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-cd78e507-8ef8-41d5-b270-7d0445e21ce8 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:06.677482 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-cd78e507-8ef8-41d5-b270-7d0445e21ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:06.685321 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 774/1551] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:06 2022] POST /identity/v3/users => generated 288 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:06.694378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 778/1552] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:06.694582 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63976a1f-d116-4fcf-a96e-cdc6210e3397 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.695230 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae8ef7-cc6d-4580-9a4c-f9885718c5d8 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.695334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63976a1f-d116-4fcf-a96e-cdc6210e3397 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.695424 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae8ef7-cc6d-4580-9a4c-f9885718c5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.695511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63976a1f-d116-4fcf-a96e-cdc6210e3397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.695609 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae8ef7-cc6d-4580-9a4c-f9885718c5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.712605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-35ae8ef7-cc6d-4580-9a4c-f9885718c5d8 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:06.712871 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-63976a1f-d116-4fcf-a96e-cdc6210e3397 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:06.713804 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-35ae8ef7-cc6d-4580-9a4c-f9885718c5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:06.714046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-63976a1f-d116-4fcf-a96e-cdc6210e3397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:06.721947 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 775/1553] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:06.722529 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63976a1f-d116-4fcf-a96e-cdc6210e3397 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:06.726556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 779/1554] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:06.728308 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ce9e0-b58c-4cfe-b34c-e638b1091b25 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.728601 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ce9e0-b58c-4cfe-b34c-e638b1091b25 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.728879 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ce9e0-b58c-4cfe-b34c-e638b1091b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.735042 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63976a1f-d116-4fcf-a96e-cdc6210e3397 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:06.739523 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656434a6-77e5-40b0-9c7c-3ecacaf2b2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:06.740219 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656434a6-77e5-40b0-9c7c-3ecacaf2b2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.740503 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656434a6-77e5-40b0-9c7c-3ecacaf2b2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.740776 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656434a6-77e5-40b0-9c7c-3ecacaf2b2f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.742264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656434a6-77e5-40b0-9c7c-3ecacaf2b2f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:06.744252 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656434a6-77e5-40b0-9c7c-3ecacaf2b2f0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:06.747602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-bf4ce9e0-b58c-4cfe-b34c-e638b1091b25 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:06.748799 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-bf4ce9e0-b58c-4cfe-b34c-e638b1091b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:06.756542 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 780/1555] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:06.758361 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534943ea-d6f1-410c-b795-a89ffbc3fa4f None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.758681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534943ea-d6f1-410c-b795-a89ffbc3fa4f None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.758961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534943ea-d6f1-410c-b795-a89ffbc3fa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.776489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-534943ea-d6f1-410c-b795-a89ffbc3fa4f None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:06.777667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-534943ea-d6f1-410c-b795-a89ffbc3fa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:06.785382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 781/1556] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:06.786598 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98457674-3986-43f3-9eca-87a15a44eed9 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.786889 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98457674-3986-43f3-9eca-87a15a44eed9 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.787166 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98457674-3986-43f3-9eca-87a15a44eed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.804947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-98457674-3986-43f3-9eca-87a15a44eed9 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:06.806095 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-98457674-3986-43f3-9eca-87a15a44eed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:06.813732 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 782/1557] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:06.814492 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98457674-3986-43f3-9eca-87a15a44eed9 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:06.824353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98457674-3986-43f3-9eca-87a15a44eed9 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:06.831926 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 776/1558] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:06 2022] POST /identity/v3/projects => generated 391 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:06.832107 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab7613-099a-4f4a-acd2-a52511b26198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:06.832107 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab7613-099a-4f4a-acd2-a52511b26198 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.832346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d0e9b-488b-4902-8c9c-336818f5b3fa None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.832449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab7613-099a-4f4a-acd2-a52511b26198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.832549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d0e9b-488b-4902-8c9c-336818f5b3fa None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.832660 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab7613-099a-4f4a-acd2-a52511b26198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.832758 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d0e9b-488b-4902-8c9c-336818f5b3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.832858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab7613-099a-4f4a-acd2-a52511b26198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:06.832858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab7613-099a-4f4a-acd2-a52511b26198 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:06.843573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 783/1559] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:06.844249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab7613-099a-4f4a-acd2-a52511b26198 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:06.853081 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7b1d0e9b-488b-4902-8c9c-336818f5b3fa None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:06.854269 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7b1d0e9b-488b-4902-8c9c-336818f5b3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:06.857310 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab7613-099a-4f4a-acd2-a52511b26198 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:06.912376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 777/1560] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:06.912605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312ca2b-5a04-4fc9-a4d6-af4bc08503a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:06.913264 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312ca2b-5a04-4fc9-a4d6-af4bc08503a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.913587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312ca2b-5a04-4fc9-a4d6-af4bc08503a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.913711 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a13a1-5604-425b-a617-54e324f782c3 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.914007 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a13a1-5604-425b-a617-54e324f782c3 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.914120 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312ca2b-5a04-4fc9-a4d6-af4bc08503a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.914286 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a13a1-5604-425b-a617-54e324f782c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.914769 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312ca2b-5a04-4fc9-a4d6-af4bc08503a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:20:06.915077 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312ca2b-5a04-4fc9-a4d6-af4bc08503a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:06.916926 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312ca2b-5a04-4fc9-a4d6-af4bc08503a9 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:06.928440 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 784/1561] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:20:06.929828 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312ca2b-5a04-4fc9-a4d6-af4bc08503a9 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:06.934607 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a23a13a1-5604-425b-a617-54e324f782c3 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:06.935885 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a23a13a1-5604-425b-a617-54e324f782c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:06.939824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312ca2b-5a04-4fc9-a4d6-af4bc08503a9 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:06.945589 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 778/1562] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:06.945698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3b0ed-f1cb-48b3-b451-027ab20e32f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:06.945825 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a13a1-5604-425b-a617-54e324f782c3 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:06.946047 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3b0ed-f1cb-48b3-b451-027ab20e32f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.946311 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3b0ed-f1cb-48b3-b451-027ab20e32f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.946622 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3b0ed-f1cb-48b3-b451-027ab20e32f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.947356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3b0ed-f1cb-48b3-b451-027ab20e32f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:20:06.947666 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3b0ed-f1cb-48b3-b451-027ab20e32f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:06.949252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3b0ed-f1cb-48b3-b451-027ab20e32f9 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:06.956926 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a13a1-5604-425b-a617-54e324f782c3 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:06.961501 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 785/1563] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:20:06.961625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e694716-d5b7-4bcf-8e65-31b74ae4a1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:06.962283 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e694716-d5b7-4bcf-8e65-31b74ae4a1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.962478 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3b0ed-f1cb-48b3-b451-027ab20e32f9 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:06.962595 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e694716-d5b7-4bcf-8e65-31b74ae4a1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.962980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e694716-d5b7-4bcf-8e65-31b74ae4a1d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.963712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e694716-d5b7-4bcf-8e65-31b74ae4a1d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:20:06.964019 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e694716-d5b7-4bcf-8e65-31b74ae4a1d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:06.965020 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: WARNING py.warnings [None req-9e694716-d5b7-4bcf-8e65-31b74ae4a1d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:20:06.965020 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: warnings.warn(msg) May 10 21:20:06.965020 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: May 10 21:20:06.965885 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e694716-d5b7-4bcf-8e65-31b74ae4a1d7 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:06.972706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3b0ed-f1cb-48b3-b451-027ab20e32f9 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:06.977521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 779/1564] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:20:06.977756 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73738e4-62a9-4971-bbe9-3ebd7c5c14df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:06.978449 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e694716-d5b7-4bcf-8e65-31b74ae4a1d7 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:06.978566 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73738e4-62a9-4971-bbe9-3ebd7c5c14df admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.978816 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73738e4-62a9-4971-bbe9-3ebd7c5c14df admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.979056 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73738e4-62a9-4971-bbe9-3ebd7c5c14df admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.979834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73738e4-62a9-4971-bbe9-3ebd7c5c14df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:20:06.980145 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73738e4-62a9-4971-bbe9-3ebd7c5c14df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:06.981728 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73738e4-62a9-4971-bbe9-3ebd7c5c14df admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:06.987993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e694716-d5b7-4bcf-8e65-31b74ae4a1d7 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:06.993064 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a8e01-5cc6-48e3-9da0-12671a4b8798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:06.993703 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a8e01-5cc6-48e3-9da0-12671a4b8798 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:06.993986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a8e01-5cc6-48e3-9da0-12671a4b8798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:06.994134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 786/1565] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:20:06.994257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a8e01-5cc6-48e3-9da0-12671a4b8798 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:06.994998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73738e4-62a9-4971-bbe9-3ebd7c5c14df admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:06.995113 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a8e01-5cc6-48e3-9da0-12671a4b8798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:06.996904 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a8e01-5cc6-48e3-9da0-12671a4b8798 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:07.004893 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73738e4-62a9-4971-bbe9-3ebd7c5c14df admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:07.010425 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229eb9b-a894-4d46-972b-5089f04c46eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:07.010823 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229eb9b-a894-4d46-972b-5089f04c46eb admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:07.011110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229eb9b-a894-4d46-972b-5089f04c46eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:07.011391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229eb9b-a894-4d46-972b-5089f04c46eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:07.012165 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229eb9b-a894-4d46-972b-5089f04c46eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:07.013995 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229eb9b-a894-4d46-972b-5089f04c46eb admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:07.024119 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 787/1566] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:07.024890 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229eb9b-a894-4d46-972b-5089f04c46eb admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:07.034706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229eb9b-a894-4d46-972b-5089f04c46eb admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:07.039265 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c17577-615a-47e9-9477-776612cbdbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:07.039903 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c17577-615a-47e9-9477-776612cbdbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:07.040174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c17577-615a-47e9-9477-776612cbdbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:07.040453 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c17577-615a-47e9-9477-776612cbdbb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:07.041160 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c17577-615a-47e9-9477-776612cbdbb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:20:07.041465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c17577-615a-47e9-9477-776612cbdbb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:07.043083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c17577-615a-47e9-9477-776612cbdbb5 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:07.054935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 788/1567] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:20:07.055605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c17577-615a-47e9-9477-776612cbdbb5 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:07.064789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c17577-615a-47e9-9477-776612cbdbb5 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:07.071183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b19dc6-909e-4e8d-b5d1-d978534ca217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:07.071183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b19dc6-909e-4e8d-b5d1-d978534ca217 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:07.071183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b19dc6-909e-4e8d-b5d1-d978534ca217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:07.071506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b19dc6-909e-4e8d-b5d1-d978534ca217 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:07.072137 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b19dc6-909e-4e8d-b5d1-d978534ca217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:07.073127 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: WARNING py.warnings [None req-71b19dc6-909e-4e8d-b5d1-d978534ca217 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:20:07.073127 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: warnings.warn(msg) May 10 21:20:07.073127 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: May 10 21:20:07.074306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b19dc6-909e-4e8d-b5d1-d978534ca217 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:07.182917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 789/1568] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:07 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:07.183691 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b19dc6-909e-4e8d-b5d1-d978534ca217 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:07.204664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 780/1569] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:06 2022] POST /identity/v3/users => generated 296 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:07.204664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a8e01-5cc6-48e3-9da0-12671a4b8798 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:07.215954 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a8e01-5cc6-48e3-9da0-12671a4b8798 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:07.251950 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b19dc6-909e-4e8d-b5d1-d978534ca217 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:07.256553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa19bd3-97c1-4472-84ec-0e56de07a2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:07.257768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa19bd3-97c1-4472-84ec-0e56de07a2ac admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:07.258395 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa19bd3-97c1-4472-84ec-0e56de07a2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:07.258545 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa19bd3-97c1-4472-84ec-0e56de07a2ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:07.259210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa19bd3-97c1-4472-84ec-0e56de07a2ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:20:07.259514 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa19bd3-97c1-4472-84ec-0e56de07a2ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:07.261119 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa19bd3-97c1-4472-84ec-0e56de07a2ac admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:07.271090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b7412-89d6-4f28-a9cd-11b1d28a29db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:07.271756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b7412-89d6-4f28-a9cd-11b1d28a29db admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:07.273664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b7412-89d6-4f28-a9cd-11b1d28a29db admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:07.273664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b7412-89d6-4f28-a9cd-11b1d28a29db admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:07.273846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b7412-89d6-4f28-a9cd-11b1d28a29db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:07.281035 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 790/1570] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:20:07.281035 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa19bd3-97c1-4472-84ec-0e56de07a2ac admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:07.281220 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b7412-89d6-4f28-a9cd-11b1d28a29db admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:07.285433 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa19bd3-97c1-4472-84ec-0e56de07a2ac admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:07.290610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea1772-7e58-4815-bfef-f8f34c3c2ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:07.291269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea1772-7e58-4815-bfef-f8f34c3c2ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:07.291555 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea1772-7e58-4815-bfef-f8f34c3c2ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:07.291831 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea1772-7e58-4815-bfef-f8f34c3c2ec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:07.292521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea1772-7e58-4815-bfef-f8f34c3c2ec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:07.294488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea1772-7e58-4815-bfef-f8f34c3c2ec3 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:07.354704 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 781/1571] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:07 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:07.355539 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b7412-89d6-4f28-a9cd-11b1d28a29db admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:07.368479 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 791/1572] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:07 2022] POST /identity/v3/projects => generated 405 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:07.368479 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea1772-7e58-4815-bfef-f8f34c3c2ec3 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:07.416286 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b7412-89d6-4f28-a9cd-11b1d28a29db admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:07.426989 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea1772-7e58-4815-bfef-f8f34c3c2ec3 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:07.431730 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f9429-b061-4688-8c3c-5aa6d6d7a88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:07.432647 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f9429-b061-4688-8c3c-5aa6d6d7a88f admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:07.432981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f9429-b061-4688-8c3c-5aa6d6d7a88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:07.433204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f9429-b061-4688-8c3c-5aa6d6d7a88f admin admin] PATH_INFO: `/v3/projects/604bb43d90e344d3a89838c6575d12c2/users/05eb9dfc751a4b44a8d4d7a03138f0d4/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:07.448736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f9429-b061-4688-8c3c-5aa6d6d7a88f admin admin] RBAC: Authorizing `identity:create_grant(project_id=604bb43d90e344d3a89838c6575d12c2, user_id=05eb9dfc751a4b44a8d4d7a03138f0d4, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:07.449794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: WARNING py.warnings [None req-463f9429-b061-4688-8c3c-5aa6d6d7a88f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:20:07.449794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: warnings.warn(msg) May 10 21:20:07.449794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: May 10 21:20:07.451751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f9429-b061-4688-8c3c-5aa6d6d7a88f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:07.470360 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df946576-46bb-440a-a312-ebac28c5c07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:07.471052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df946576-46bb-440a-a312-ebac28c5c07c admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:07.471334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df946576-46bb-440a-a312-ebac28c5c07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:07.471607 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df946576-46bb-440a-a312-ebac28c5c07c admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:07.472296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df946576-46bb-440a-a312-ebac28c5c07c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:07.474161 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df946576-46bb-440a-a312-ebac28c5c07c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:07.506550 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 792/1573] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:07 2022] PUT /identity/v3/projects/604bb43d90e344d3a89838c6575d12c2/users/05eb9dfc751a4b44a8d4d7a03138f0d4/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:07.508569 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f9429-b061-4688-8c3c-5aa6d6d7a88f admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:07.568381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 782/1574] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:07 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:07.568575 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f9429-b061-4688-8c3c-5aa6d6d7a88f admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:07.568695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df946576-46bb-440a-a312-ebac28c5c07c admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:07.621749 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53003c-d5f9-4aed-b7ad-e81d11c78384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:07.622415 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53003c-d5f9-4aed-b7ad-e81d11c78384 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:07.622720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53003c-d5f9-4aed-b7ad-e81d11c78384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:07.622995 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53003c-d5f9-4aed-b7ad-e81d11c78384 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:07.623684 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53003c-d5f9-4aed-b7ad-e81d11c78384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:07.625587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53003c-d5f9-4aed-b7ad-e81d11c78384 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:07.629908 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df946576-46bb-440a-a312-ebac28c5c07c admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:07.639139 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f306189-c3ab-4a1a-898e-4375e371a9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:07.639139 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f306189-c3ab-4a1a-898e-4375e371a9cd admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:07.639139 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f306189-c3ab-4a1a-898e-4375e371a9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:07.639139 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f306189-c3ab-4a1a-898e-4375e371a9cd admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:07.639557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f306189-c3ab-4a1a-898e-4375e371a9cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:07.639930 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f306189-c3ab-4a1a-898e-4375e371a9cd admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:07.702343 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 783/1575] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:07 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:07.703201 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 793/1576] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:07 2022] POST /identity/v3/projects => generated 371 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:07.703453 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f306189-c3ab-4a1a-898e-4375e371a9cd admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:07.703856 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53003c-d5f9-4aed-b7ad-e81d11c78384 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:07.714377 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f306189-c3ab-4a1a-898e-4375e371a9cd admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:07.767763 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53003c-d5f9-4aed-b7ad-e81d11c78384 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:07.768938 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02607c-a29d-4624-892b-eeff0eba495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:07.769613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02607c-a29d-4624-892b-eeff0eba495b admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:07.769894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02607c-a29d-4624-892b-eeff0eba495b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:07.770170 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02607c-a29d-4624-892b-eeff0eba495b admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:07.770929 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02607c-a29d-4624-892b-eeff0eba495b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:07.772502 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02607c-a29d-4624-892b-eeff0eba495b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:07.772715 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfad7e-6d1d-4182-aa34-ec75c32dd219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:07.773598 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfad7e-6d1d-4182-aa34-ec75c32dd219 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:07.773922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfad7e-6d1d-4182-aa34-ec75c32dd219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:07.774204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfad7e-6d1d-4182-aa34-ec75c32dd219 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:07.774960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfad7e-6d1d-4182-aa34-ec75c32dd219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:07.776910 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfad7e-6d1d-4182-aa34-ec75c32dd219 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:07.783005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 784/1577] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:07.783781 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02607c-a29d-4624-892b-eeff0eba495b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:07.793784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02607c-a29d-4624-892b-eeff0eba495b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:07.798578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110d94e-0ae2-4d58-9978-2342dfdb8190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:07.799232 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110d94e-0ae2-4d58-9978-2342dfdb8190 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:07.800721 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110d94e-0ae2-4d58-9978-2342dfdb8190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:07.800721 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110d94e-0ae2-4d58-9978-2342dfdb8190 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:07.800721 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110d94e-0ae2-4d58-9978-2342dfdb8190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:07.802544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110d94e-0ae2-4d58-9978-2342dfdb8190 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:07.879979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 794/1578] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:07 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:07.883467 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfad7e-6d1d-4182-aa34-ec75c32dd219 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:07.894207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 785/1579] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:07 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:07.894207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa584a-a07c-48e3-a3cb-cb598e1c2a92 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:07.894207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa584a-a07c-48e3-a3cb-cb598e1c2a92 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:07.894207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa584a-a07c-48e3-a3cb-cb598e1c2a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:07.910159 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-4dfa584a-a07c-48e3-a3cb-cb598e1c2a92 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:07.912268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4dfa584a-a07c-48e3-a3cb-cb598e1c2a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:07.944483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfad7e-6d1d-4182-aa34-ec75c32dd219 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:07.949110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321dcdf-e514-495d-bd63-e1f8ab027bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:07.949779 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321dcdf-e514-495d-bd63-e1f8ab027bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:07.950058 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321dcdf-e514-495d-bd63-e1f8ab027bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:07.950333 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321dcdf-e514-495d-bd63-e1f8ab027bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:07.951055 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321dcdf-e514-495d-bd63-e1f8ab027bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:07.953034 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321dcdf-e514-495d-bd63-e1f8ab027bc7 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:07.968458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 786/1580] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:07.969674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa584a-a07c-48e3-a3cb-cb598e1c2a92 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:07.979170 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa584a-a07c-48e3-a3cb-cb598e1c2a92 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:07.983714 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d7209-e162-4303-9617-140bfe41712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:07.984713 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d7209-e162-4303-9617-140bfe41712f admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:07.984995 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d7209-e162-4303-9617-140bfe41712f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:07.985266 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d7209-e162-4303-9617-140bfe41712f admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:07.986016 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d7209-e162-4303-9617-140bfe41712f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:07.987927 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d7209-e162-4303-9617-140bfe41712f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.021349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 795/1581] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:07 2022] POST /identity/v3/users => generated 303 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:08.022178 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321dcdf-e514-495d-bd63-e1f8ab027bc7 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.031494 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321dcdf-e514-495d-bd63-e1f8ab027bc7 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.035982 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9a2ef-f829-46c7-8980-9706e39f22fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.036611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9a2ef-f829-46c7-8980-9706e39f22fe admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.036898 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9a2ef-f829-46c7-8980-9706e39f22fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.037177 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9a2ef-f829-46c7-8980-9706e39f22fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.037900 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9a2ef-f829-46c7-8980-9706e39f22fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.040294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9a2ef-f829-46c7-8980-9706e39f22fe admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.049845 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 796/1582] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:08.050612 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9a2ef-f829-46c7-8980-9706e39f22fe admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.060530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9a2ef-f829-46c7-8980-9706e39f22fe admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.065054 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884ef62-9dd7-4f8a-b1e2-647726aa9c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.065671 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884ef62-9dd7-4f8a-b1e2-647726aa9c90 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.065958 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884ef62-9dd7-4f8a-b1e2-647726aa9c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.066234 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884ef62-9dd7-4f8a-b1e2-647726aa9c90 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.066948 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884ef62-9dd7-4f8a-b1e2-647726aa9c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.068795 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884ef62-9dd7-4f8a-b1e2-647726aa9c90 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.095612 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 787/1583] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:07 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:08.096475 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d7209-e162-4303-9617-140bfe41712f admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.106262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d7209-e162-4303-9617-140bfe41712f admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.111108 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4362524-4888-4461-9e4a-aa77f87ba8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.111772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4362524-4888-4461-9e4a-aa77f87ba8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.112055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4362524-4888-4461-9e4a-aa77f87ba8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.112330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4362524-4888-4461-9e4a-aa77f87ba8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.113076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4362524-4888-4461-9e4a-aa77f87ba8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.114663 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4362524-4888-4461-9e4a-aa77f87ba8a0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.125000 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 788/1584] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:08.125881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4362524-4888-4461-9e4a-aa77f87ba8a0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.135084 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4362524-4888-4461-9e4a-aa77f87ba8a0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.139998 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384bd61-fb22-442a-b47b-7e2451325fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.140645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384bd61-fb22-442a-b47b-7e2451325fdc admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.140932 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384bd61-fb22-442a-b47b-7e2451325fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.141208 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384bd61-fb22-442a-b47b-7e2451325fdc admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.141884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384bd61-fb22-442a-b47b-7e2451325fdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.143872 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384bd61-fb22-442a-b47b-7e2451325fdc admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.152962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 797/1585] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:08 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:08.153851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884ef62-9dd7-4f8a-b1e2-647726aa9c90 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.164345 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884ef62-9dd7-4f8a-b1e2-647726aa9c90 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.168992 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265e871-840f-4fb3-999e-cc5fd2efaa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.169645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265e871-840f-4fb3-999e-cc5fd2efaa1c admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.169935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265e871-840f-4fb3-999e-cc5fd2efaa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.170235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265e871-840f-4fb3-999e-cc5fd2efaa1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.171002 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265e871-840f-4fb3-999e-cc5fd2efaa1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.172646 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265e871-840f-4fb3-999e-cc5fd2efaa1c admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.183582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 798/1586] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:08.184362 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265e871-840f-4fb3-999e-cc5fd2efaa1c admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.219546 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 789/1587] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:08 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:08.219546 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384bd61-fb22-442a-b47b-7e2451325fdc admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.227410 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384bd61-fb22-442a-b47b-7e2451325fdc admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.232039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958812c3-78d7-49a8-96e9-5acfd0968a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.232682 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958812c3-78d7-49a8-96e9-5acfd0968a07 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.232989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958812c3-78d7-49a8-96e9-5acfd0968a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.233262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958812c3-78d7-49a8-96e9-5acfd0968a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.234004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958812c3-78d7-49a8-96e9-5acfd0968a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.235630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958812c3-78d7-49a8-96e9-5acfd0968a07 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.236764 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265e871-840f-4fb3-999e-cc5fd2efaa1c admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.240454 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875556b-98ec-4894-8dda-f04b32aef8d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.241117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875556b-98ec-4894-8dda-f04b32aef8d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.241444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875556b-98ec-4894-8dda-f04b32aef8d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.241763 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875556b-98ec-4894-8dda-f04b32aef8d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.246658 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 790/1588] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:08.247449 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958812c3-78d7-49a8-96e9-5acfd0968a07 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.251859 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875556b-98ec-4894-8dda-f04b32aef8d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.253291 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875556b-98ec-4894-8dda-f04b32aef8d2 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.257136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958812c3-78d7-49a8-96e9-5acfd0968a07 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.261675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd117f-1028-45a9-8b4a-690482881f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.262304 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd117f-1028-45a9-8b4a-690482881f98 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.262615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd117f-1028-45a9-8b4a-690482881f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.263155 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd117f-1028-45a9-8b4a-690482881f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.263281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 799/1589] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:08.263875 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd117f-1028-45a9-8b4a-690482881f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.263992 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875556b-98ec-4894-8dda-f04b32aef8d2 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.265793 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd117f-1028-45a9-8b4a-690482881f98 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.274128 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875556b-98ec-4894-8dda-f04b32aef8d2 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.277390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 791/1590] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:08.278756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd117f-1028-45a9-8b4a-690482881f98 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.281954 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d37a0-4967-4aa8-9534-6d2298d7bf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.282732 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d37a0-4967-4aa8-9534-6d2298d7bf4f admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.283186 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d37a0-4967-4aa8-9534-6d2298d7bf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.283442 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d37a0-4967-4aa8-9534-6d2298d7bf4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.284249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d37a0-4967-4aa8-9534-6d2298d7bf4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.285917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d37a0-4967-4aa8-9534-6d2298d7bf4f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.289940 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd117f-1028-45a9-8b4a-690482881f98 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.294578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26b748-7c80-4285-854d-c6985ac7badb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.299776 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26b748-7c80-4285-854d-c6985ac7badb admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.299776 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26b748-7c80-4285-854d-c6985ac7badb admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.299776 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26b748-7c80-4285-854d-c6985ac7badb admin admin] PATH_INFO: `/v3/projects/78072ca90bf6402b83863597c266a178/users/02af0eded57547f489be63cd6dc09399/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.300070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 800/1591] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:08.300070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d37a0-4967-4aa8-9534-6d2298d7bf4f admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.307289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d37a0-4967-4aa8-9534-6d2298d7bf4f admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.311858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3591e22-3453-428e-91cf-5fd5d0bc581d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.312363 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26b748-7c80-4285-854d-c6985ac7badb admin admin] RBAC: Authorizing `identity:create_grant(project_id=78072ca90bf6402b83863597c266a178, user_id=02af0eded57547f489be63cd6dc09399, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.312488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3591e22-3453-428e-91cf-5fd5d0bc581d admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.312776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3591e22-3453-428e-91cf-5fd5d0bc581d admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.313055 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3591e22-3453-428e-91cf-5fd5d0bc581d admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.313768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3591e22-3453-428e-91cf-5fd5d0bc581d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.315039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26b748-7c80-4285-854d-c6985ac7badb admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.315359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3591e22-3453-428e-91cf-5fd5d0bc581d admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.325081 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 801/1592] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:08.325910 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3591e22-3453-428e-91cf-5fd5d0bc581d admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.334864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3591e22-3453-428e-91cf-5fd5d0bc581d admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.339877 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cc0f5-b655-4733-b23a-404adf21b4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.340498 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cc0f5-b655-4733-b23a-404adf21b4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.340780 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cc0f5-b655-4733-b23a-404adf21b4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.341056 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cc0f5-b655-4733-b23a-404adf21b4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.341760 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cc0f5-b655-4733-b23a-404adf21b4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.343358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cc0f5-b655-4733-b23a-404adf21b4f2 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.354284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 802/1593] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:08.355124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cc0f5-b655-4733-b23a-404adf21b4f2 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.365073 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cc0f5-b655-4733-b23a-404adf21b4f2 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.370425 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3392d4-4d83-4a17-8850-a5315b7b8ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.371115 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3392d4-4d83-4a17-8850-a5315b7b8ead admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.371398 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3392d4-4d83-4a17-8850-a5315b7b8ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.371673 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3392d4-4d83-4a17-8850-a5315b7b8ead admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.372397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3392d4-4d83-4a17-8850-a5315b7b8ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.373966 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3392d4-4d83-4a17-8850-a5315b7b8ead admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.383906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 803/1594] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:08.387353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3392d4-4d83-4a17-8850-a5315b7b8ead admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.397352 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3392d4-4d83-4a17-8850-a5315b7b8ead admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.403522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 792/1595] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:08 2022] PUT /identity/v3/projects/78072ca90bf6402b83863597c266a178/users/02af0eded57547f489be63cd6dc09399/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:08.404413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26b748-7c80-4285-854d-c6985ac7badb admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.456263 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb76d0f-3377-485c-a900-a6c5dd1f1f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.456936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb76d0f-3377-485c-a900-a6c5dd1f1f45 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.457222 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb76d0f-3377-485c-a900-a6c5dd1f1f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.457501 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb76d0f-3377-485c-a900-a6c5dd1f1f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.458253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb76d0f-3377-485c-a900-a6c5dd1f1f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.459936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb76d0f-3377-485c-a900-a6c5dd1f1f45 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.465210 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26b748-7c80-4285-854d-c6985ac7badb admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.470145 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87a1c0-5dd0-4eee-8bbd-c5c292c31b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.474132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 804/1596] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:08.474287 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87a1c0-5dd0-4eee-8bbd-c5c292c31b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.474287 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87a1c0-5dd0-4eee-8bbd-c5c292c31b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.474287 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87a1c0-5dd0-4eee-8bbd-c5c292c31b4b admin admin] PATH_INFO: `/v3/projects/802e2ef29f6f4b2c8ca69204b69cc142/users/d2267b0c3311480eb8d1f54df5296c4c/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.474573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb76d0f-3377-485c-a900-a6c5dd1f1f45 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.481855 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb76d0f-3377-485c-a900-a6c5dd1f1f45 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.486554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4b541-fcf3-4f5d-aea1-e1f4795feb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.486877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87a1c0-5dd0-4eee-8bbd-c5c292c31b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=802e2ef29f6f4b2c8ca69204b69cc142, user_id=d2267b0c3311480eb8d1f54df5296c4c, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.487237 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4b541-fcf3-4f5d-aea1-e1f4795feb55 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.487521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4b541-fcf3-4f5d-aea1-e1f4795feb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.487794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4b541-fcf3-4f5d-aea1-e1f4795feb55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.488500 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4b541-fcf3-4f5d-aea1-e1f4795feb55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.489525 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87a1c0-5dd0-4eee-8bbd-c5c292c31b4b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.490342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4b541-fcf3-4f5d-aea1-e1f4795feb55 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.500937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 805/1597] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:08.504440 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4b541-fcf3-4f5d-aea1-e1f4795feb55 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.514324 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4b541-fcf3-4f5d-aea1-e1f4795feb55 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.519053 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03d207-24af-4c0f-9c56-88e8e27a9f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.519710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03d207-24af-4c0f-9c56-88e8e27a9f3d admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.519992 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03d207-24af-4c0f-9c56-88e8e27a9f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.520268 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03d207-24af-4c0f-9c56-88e8e27a9f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.520983 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03d207-24af-4c0f-9c56-88e8e27a9f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.522607 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03d207-24af-4c0f-9c56-88e8e27a9f3d admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.533256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 806/1598] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:08.535401 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03d207-24af-4c0f-9c56-88e8e27a9f3d admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.545797 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03d207-24af-4c0f-9c56-88e8e27a9f3d admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.552719 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431fe91-7b39-40f2-9cbb-193a04d26c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.553611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431fe91-7b39-40f2-9cbb-193a04d26c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.553895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431fe91-7b39-40f2-9cbb-193a04d26c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.555178 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431fe91-7b39-40f2-9cbb-193a04d26c5c admin admin] PATH_INFO: `/v3/projects/8286226c580f4896aec72c65642fce30/users/ca39678abe6e476283f94c675d4ea369/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.570334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431fe91-7b39-40f2-9cbb-193a04d26c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8286226c580f4896aec72c65642fce30, user_id=ca39678abe6e476283f94c675d4ea369, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.572999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431fe91-7b39-40f2-9cbb-193a04d26c5c admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.588168 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 793/1599] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:08 2022] PUT /identity/v3/projects/802e2ef29f6f4b2c8ca69204b69cc142/users/d2267b0c3311480eb8d1f54df5296c4c/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:08.591777 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87a1c0-5dd0-4eee-8bbd-c5c292c31b4b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.645016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 807/1600] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:08 2022] PUT /identity/v3/projects/8286226c580f4896aec72c65642fce30/users/ca39678abe6e476283f94c675d4ea369/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:08.646859 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3690c-1afe-437a-87fa-bf91744a694f None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.647149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3690c-1afe-437a-87fa-bf91744a694f None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.647428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3690c-1afe-437a-87fa-bf91744a694f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.654914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87a1c0-5dd0-4eee-8bbd-c5c292c31b4b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.667168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-01e3690c-1afe-437a-87fa-bf91744a694f None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:08.668371 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-01e3690c-1afe-437a-87fa-bf91744a694f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:08.720232 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0a097-c1a0-4a48-855d-68d83f595e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.720232 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0a097-c1a0-4a48-855d-68d83f595e00 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.720574 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0a097-c1a0-4a48-855d-68d83f595e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.720658 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0a097-c1a0-4a48-855d-68d83f595e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.721695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0a097-c1a0-4a48-855d-68d83f595e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.723228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0a097-c1a0-4a48-855d-68d83f595e00 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.731276 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 808/1601] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:08.732084 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3690c-1afe-437a-87fa-bf91744a694f None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.738515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 794/1602] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:08.741026 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0a097-c1a0-4a48-855d-68d83f595e00 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.744035 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3690c-1afe-437a-87fa-bf91744a694f None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.749253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6b3ae-7101-4c70-a54a-b2c7910bd8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.750157 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6b3ae-7101-4c70-a54a-b2c7910bd8ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.750463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6b3ae-7101-4c70-a54a-b2c7910bd8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.750762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6b3ae-7101-4c70-a54a-b2c7910bd8ad admin admin] PATH_INFO: `/v3/projects/8ce7dc7c24b34647b2629a5244f80617/users/51e1176b71d741a3907409cb41461683/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.752227 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0a097-c1a0-4a48-855d-68d83f595e00 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.760339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a43d9-a601-4c6d-992d-01cc9997228b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.761116 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a43d9-a601-4c6d-992d-01cc9997228b admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.761465 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a43d9-a601-4c6d-992d-01cc9997228b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.761746 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a43d9-a601-4c6d-992d-01cc9997228b admin admin] PATH_INFO: `/v3/projects/e738363e9f184b01a86d3459779cdfb4/users/250d6a26720a4416b62f5f7b2c646c80/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.767237 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6b3ae-7101-4c70-a54a-b2c7910bd8ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce7dc7c24b34647b2629a5244f80617, user_id=51e1176b71d741a3907409cb41461683, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.769991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6b3ae-7101-4c70-a54a-b2c7910bd8ad admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.776937 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a43d9-a601-4c6d-992d-01cc9997228b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e738363e9f184b01a86d3459779cdfb4, user_id=250d6a26720a4416b62f5f7b2c646c80, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:08.779621 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a43d9-a601-4c6d-992d-01cc9997228b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:08.839622 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 809/1603] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:08 2022] PUT /identity/v3/projects/8ce7dc7c24b34647b2629a5244f80617/users/51e1176b71d741a3907409cb41461683/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:08.840693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6b3ae-7101-4c70-a54a-b2c7910bd8ad admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.858747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 795/1604] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:08 2022] PUT /identity/v3/projects/e738363e9f184b01a86d3459779cdfb4/users/250d6a26720a4416b62f5f7b2c646c80/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:08.860364 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698925bd-77f2-4ac0-a87c-91bd3ea76c08 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.860695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698925bd-77f2-4ac0-a87c-91bd3ea76c08 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.861030 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698925bd-77f2-4ac0-a87c-91bd3ea76c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.878651 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-698925bd-77f2-4ac0-a87c-91bd3ea76c08 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:08.879857 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-698925bd-77f2-4ac0-a87c-91bd3ea76c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:08.923456 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6b3ae-7101-4c70-a54a-b2c7910bd8ad admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:08.951112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 796/1605] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:08.952606 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070413d4-7730-4142-9e7f-f5bbd9cc8ba6 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.953397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070413d4-7730-4142-9e7f-f5bbd9cc8ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.953397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070413d4-7730-4142-9e7f-f5bbd9cc8ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.972569 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-070413d4-7730-4142-9e7f-f5bbd9cc8ba6 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:08.973790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-070413d4-7730-4142-9e7f-f5bbd9cc8ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:08.982638 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 797/1606] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:08.983562 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070413d4-7730-4142-9e7f-f5bbd9cc8ba6 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:08.990757 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a7c5d-e6c7-4ded-bd21-97f16ba23e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:08.992437 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a7c5d-e6c7-4ded-bd21-97f16ba23e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:08.993031 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a7c5d-e6c7-4ded-bd21-97f16ba23e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:08.993308 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a7c5d-e6c7-4ded-bd21-97f16ba23e96 admin admin] PATH_INFO: `/v3/projects/4b41b310b0064ec08e06330c518f70b2/users/657302f196854f7e91fe963884ca42dc/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:08.994958 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070413d4-7730-4142-9e7f-f5bbd9cc8ba6 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:09.000584 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a3fcc-1950-4dcb-993f-d83904b1935d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:09.001606 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a3fcc-1950-4dcb-993f-d83904b1935d admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:09.002006 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a3fcc-1950-4dcb-993f-d83904b1935d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:09.002378 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a3fcc-1950-4dcb-993f-d83904b1935d admin admin] PATH_INFO: `/v3/projects/56c9fbbebbd742198fe89c367ce3b8ae/users/05834b48b8c94e7c97f730ae7cc2f587/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:09.009384 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a7c5d-e6c7-4ded-bd21-97f16ba23e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b41b310b0064ec08e06330c518f70b2, user_id=657302f196854f7e91fe963884ca42dc, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:09.015769 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a7c5d-e6c7-4ded-bd21-97f16ba23e96 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:09.019456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a3fcc-1950-4dcb-993f-d83904b1935d admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c9fbbebbd742198fe89c367ce3b8ae, user_id=05834b48b8c94e7c97f730ae7cc2f587, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:09.022272 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a3fcc-1950-4dcb-993f-d83904b1935d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:09.108738 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 798/1607] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:08 2022] PUT /identity/v3/projects/56c9fbbebbd742198fe89c367ce3b8ae/users/05834b48b8c94e7c97f730ae7cc2f587/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:09.109972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a3fcc-1950-4dcb-993f-d83904b1935d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:09.120092 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-944a3fcc-1950-4dcb-993f-d83904b1935d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:09.120421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 810/1608] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:08 2022] PUT /identity/v3/projects/4b41b310b0064ec08e06330c518f70b2/users/657302f196854f7e91fe963884ca42dc/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:09.121932 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18b73b-3cf8-48ed-90b0-339c86f4e4cc None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:09.122224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18b73b-3cf8-48ed-90b0-339c86f4e4cc None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:09.123995 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18b73b-3cf8-48ed-90b0-339c86f4e4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:09.149358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-2a18b73b-3cf8-48ed-90b0-339c86f4e4cc None None] MFA Rules not processed for user `51e1176b71d741a3907409cb41461683`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:09.150586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-2a18b73b-3cf8-48ed-90b0-339c86f4e4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:09.179916 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a3fcc-1950-4dcb-993f-d83904b1935d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:09.183933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48e8a1-ded7-46bc-b2be-0c1ef42f9a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:09.184590 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48e8a1-ded7-46bc-b2be-0c1ef42f9a69 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:09.184881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48e8a1-ded7-46bc-b2be-0c1ef42f9a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:09.185161 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48e8a1-ded7-46bc-b2be-0c1ef42f9a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:09.224555 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 811/1609] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:09.226985 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2e39a-7b1a-4dc9-aa25-2b9a1b011263 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:09.227665 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2e39a-7b1a-4dc9-aa25-2b9a1b011263 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:09.228377 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2e39a-7b1a-4dc9-aa25-2b9a1b011263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:09.247112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48e8a1-ded7-46bc-b2be-0c1ef42f9a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:09.248353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-24a2e39a-7b1a-4dc9-aa25-2b9a1b011263 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:09.248534 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48e8a1-ded7-46bc-b2be-0c1ef42f9a69 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:09.249858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-24a2e39a-7b1a-4dc9-aa25-2b9a1b011263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:09.258528 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 812/1610] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:09.261814 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 799/1611] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:09.261814 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48e8a1-ded7-46bc-b2be-0c1ef42f9a69 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:09.267380 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2e39a-7b1a-4dc9-aa25-2b9a1b011263 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:09.267784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48e8a1-ded7-46bc-b2be-0c1ef42f9a69 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:09.271698 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2afe4c-f2a5-4442-9aa9-4aca2a7b44b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:09.272547 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2afe4c-f2a5-4442-9aa9-4aca2a7b44b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:09.273506 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2afe4c-f2a5-4442-9aa9-4aca2a7b44b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:09.273948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2afe4c-f2a5-4442-9aa9-4aca2a7b44b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:09.283220 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2e39a-7b1a-4dc9-aa25-2b9a1b011263 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:09.283980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2afe4c-f2a5-4442-9aa9-4aca2a7b44b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:09.285930 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2afe4c-f2a5-4442-9aa9-4aca2a7b44b3 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:09.289095 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec2844-8afa-4223-9092-87a33db1bff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:09.293915 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec2844-8afa-4223-9092-87a33db1bff5 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:09.293915 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec2844-8afa-4223-9092-87a33db1bff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:09.293915 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec2844-8afa-4223-9092-87a33db1bff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:09.296538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 800/1612] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:09.297796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08c4ad-115d-4cac-849b-c5ca1b280cfa None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:09.298080 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08c4ad-115d-4cac-849b-c5ca1b280cfa None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:09.298353 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08c4ad-115d-4cac-849b-c5ca1b280cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:09.301162 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec2844-8afa-4223-9092-87a33db1bff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:09.302634 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec2844-8afa-4223-9092-87a33db1bff5 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:09.313669 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 813/1613] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:09.315163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86459c0d-1792-4bbf-b854-e3f6e41ad553 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:09.315492 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86459c0d-1792-4bbf-b854-e3f6e41ad553 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:09.315745 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86459c0d-1792-4bbf-b854-e3f6e41ad553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:09.325967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6d08c4ad-115d-4cac-849b-c5ca1b280cfa None None] MFA Rules not processed for user `05834b48b8c94e7c97f730ae7cc2f587`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:09.327285 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6d08c4ad-115d-4cac-849b-c5ca1b280cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:09.343738 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-86459c0d-1792-4bbf-b854-e3f6e41ad553 None None] MFA Rules not processed for user `657302f196854f7e91fe963884ca42dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:09.345019 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-86459c0d-1792-4bbf-b854-e3f6e41ad553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:09.403013 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 801/1614] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:09.403993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08c4ad-115d-4cac-849b-c5ca1b280cfa None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:09.414691 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 814/1615] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:09.415981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86459c0d-1792-4bbf-b854-e3f6e41ad553 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:09.425524 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08c4ad-115d-4cac-849b-c5ca1b280cfa None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:09.430972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5643e-9efe-4c9a-a5ea-99ed52ad40ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:09.431900 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5643e-9efe-4c9a-a5ea-99ed52ad40ff admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:09.432238 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5643e-9efe-4c9a-a5ea-99ed52ad40ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:09.432935 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5643e-9efe-4c9a-a5ea-99ed52ad40ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:09.433860 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5643e-9efe-4c9a-a5ea-99ed52ad40ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:09.435811 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5643e-9efe-4c9a-a5ea-99ed52ad40ff admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:09.438496 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86459c0d-1792-4bbf-b854-e3f6e41ad553 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:09.443522 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7cad3-14fc-4b1b-9533-56c5e2af6f33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:09.444186 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7cad3-14fc-4b1b-9533-56c5e2af6f33 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:09.445495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7cad3-14fc-4b1b-9533-56c5e2af6f33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:09.445789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7cad3-14fc-4b1b-9533-56c5e2af6f33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:09.456786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7cad3-14fc-4b1b-9533-56c5e2af6f33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:09.458322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7cad3-14fc-4b1b-9533-56c5e2af6f33 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:09.472782 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 815/1616] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:09.478983 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d5b53-27bf-4379-b5d0-c344cbc27f98 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:09.478983 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d5b53-27bf-4379-b5d0-c344cbc27f98 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:09.478983 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d5b53-27bf-4379-b5d0-c344cbc27f98 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:09.478983 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 816/1617] 10.222.0.25 () {54 vars in 961 bytes} [Tue May 10 21:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:20:09.484335 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20a3f7-6dc0-4bdc-8bda-6e0c3e49fef6 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:09.484625 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20a3f7-6dc0-4bdc-8bda-6e0c3e49fef6 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:09.484910 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20a3f7-6dc0-4bdc-8bda-6e0c3e49fef6 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:09.486547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 817/1618] 10.222.0.25 () {54 vars in 961 bytes} [Tue May 10 21:20:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:20:09.487659 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62536d-5fb8-43fc-879e-e8c1f04b36d0 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:09.488243 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62536d-5fb8-43fc-879e-e8c1f04b36d0 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:09.488522 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62536d-5fb8-43fc-879e-e8c1f04b36d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:09.511041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-6e62536d-5fb8-43fc-879e-e8c1f04b36d0 None None] MFA Rules not processed for user `c4c16a3b07c64a22bfc3df2a5a90c3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:09.512845 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-6e62536d-5fb8-43fc-879e-e8c1f04b36d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:09.535377 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 802/1619] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:09 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:09.535377 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a20555-97c9-48b1-af89-1e55b2b0feb8 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:09.535377 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a20555-97c9-48b1-af89-1e55b2b0feb8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:09.535377 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a20555-97c9-48b1-af89-1e55b2b0feb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:09.579751 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-79a20555-97c9-48b1-af89-1e55b2b0feb8 None None] MFA Rules not processed for user `c4c16a3b07c64a22bfc3df2a5a90c3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:09.582017 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-79a20555-97c9-48b1-af89-1e55b2b0feb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:09.667112 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 818/1620] 10.222.0.25 () {58 vars in 1058 bytes} [Tue May 10 21:20:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:09.670150 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62536d-5fb8-43fc-879e-e8c1f04b36d0 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:09.697930 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62536d-5fb8-43fc-879e-e8c1f04b36d0 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:09.698796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 803/1621] 10.222.0.25 () {58 vars in 1058 bytes} [Tue May 10 21:20:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:09.699880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a20555-97c9-48b1-af89-1e55b2b0feb8 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:09.720761 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a20555-97c9-48b1-af89-1e55b2b0feb8 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:09.735686 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a74e4f-0e20-4d5e-8b09-3c669c872e5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:09.735913 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a74e4f-0e20-4d5e-8b09-3c669c872e5f service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:09.736163 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a74e4f-0e20-4d5e-8b09-3c669c872e5f service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:09.736590 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a74e4f-0e20-4d5e-8b09-3c669c872e5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:09.785427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220119c-9ed2-4fb5-b9a7-1cab5cf69666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:09.786700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220119c-9ed2-4fb5-b9a7-1cab5cf69666 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:09.786700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220119c-9ed2-4fb5-b9a7-1cab5cf69666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:09.787054 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220119c-9ed2-4fb5-b9a7-1cab5cf69666 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:09.788294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220119c-9ed2-4fb5-b9a7-1cab5cf69666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:09.790821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220119c-9ed2-4fb5-b9a7-1cab5cf69666 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:09.836765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a74e4f-0e20-4d5e-8b09-3c669c872e5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:09.839043 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a74e4f-0e20-4d5e-8b09-3c669c872e5f service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:09.848656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 804/1622] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:09.849380 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a74e4f-0e20-4d5e-8b09-3c669c872e5f service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:09.864385 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a74e4f-0e20-4d5e-8b09-3c669c872e5f service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:09.871854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82324e5-ee38-4995-8524-813f65fbc30e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:09.872712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82324e5-ee38-4995-8524-813f65fbc30e service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:09.873000 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82324e5-ee38-4995-8524-813f65fbc30e service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:09.873371 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82324e5-ee38-4995-8524-813f65fbc30e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:09.897418 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 819/1623] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:09 2022] POST /identity/v3/users => generated 309 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:09.901949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220119c-9ed2-4fb5-b9a7-1cab5cf69666 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:09.919525 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220119c-9ed2-4fb5-b9a7-1cab5cf69666 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:09.932318 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc6c33-a762-42a0-9464-34370cd58db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:09.933316 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc6c33-a762-42a0-9464-34370cd58db5 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:09.933607 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc6c33-a762-42a0-9464-34370cd58db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:09.935104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc6c33-a762-42a0-9464-34370cd58db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:09.936245 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc6c33-a762-42a0-9464-34370cd58db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:09.937860 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc6c33-a762-42a0-9464-34370cd58db5 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:09.959117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 820/1624] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:20:09.961264 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc6c33-a762-42a0-9464-34370cd58db5 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:09.972539 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82324e5-ee38-4995-8524-813f65fbc30e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:09.974967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82324e5-ee38-4995-8524-813f65fbc30e service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:09.978207 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc6c33-a762-42a0-9464-34370cd58db5 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:09.987247 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 805/1625] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:09.997393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c9ab2-e7a6-4aac-a82a-6b8815686b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:09.998569 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c9ab2-e7a6-4aac-a82a-6b8815686b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:09.999004 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c9ab2-e7a6-4aac-a82a-6b8815686b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:09.999477 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c9ab2-e7a6-4aac-a82a-6b8815686b6b admin admin] PATH_INFO: `/v3/projects/c034054032184ff2958617dbf28e62bb/users/49f0ca47a5f44c57afc3a9faa98df64c/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:10.019886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c9ab2-e7a6-4aac-a82a-6b8815686b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c034054032184ff2958617dbf28e62bb, user_id=49f0ca47a5f44c57afc3a9faa98df64c, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:10.025227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c9ab2-e7a6-4aac-a82a-6b8815686b6b admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:10.115822 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82324e5-ee38-4995-8524-813f65fbc30e service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:10.131703 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 821/1626] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:09 2022] PUT /identity/v3/projects/c034054032184ff2958617dbf28e62bb/users/49f0ca47a5f44c57afc3a9faa98df64c/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:10.141168 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82324e5-ee38-4995-8524-813f65fbc30e service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:10.319639 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241ed14-bdcf-48f5-9868-0a4f591940e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:10.323786 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241ed14-bdcf-48f5-9868-0a4f591940e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:10.327823 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241ed14-bdcf-48f5-9868-0a4f591940e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:10.327823 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241ed14-bdcf-48f5-9868-0a4f591940e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:10.327823 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241ed14-bdcf-48f5-9868-0a4f591940e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:10.330148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241ed14-bdcf-48f5-9868-0a4f591940e4 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:10.357259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 806/1627] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:10.362309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c9ab2-e7a6-4aac-a82a-6b8815686b6b admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:10.365073 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16502d7-b237-41ea-96ea-df31070154fa None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:10.365376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16502d7-b237-41ea-96ea-df31070154fa None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:10.365662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16502d7-b237-41ea-96ea-df31070154fa None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:10.368010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 807/1628] 10.222.0.25 () {54 vars in 912 bytes} [Tue May 10 21:20:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:20:10.373339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed512805-440d-4ddf-a2c0-4f522e94b0db None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:10.373694 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed512805-440d-4ddf-a2c0-4f522e94b0db None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:10.373913 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed512805-440d-4ddf-a2c0-4f522e94b0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:10.379672 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c9ab2-e7a6-4aac-a82a-6b8815686b6b admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:10.395364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ff148-4b30-464c-b346-2945180ffa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:10.402400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ff148-4b30-464c-b346-2945180ffa09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:10.402400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ff148-4b30-464c-b346-2945180ffa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:10.402400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ff148-4b30-464c-b346-2945180ffa09 admin admin] PATH_INFO: `/v3/projects/c034054032184ff2958617dbf28e62bb/users/49f0ca47a5f44c57afc3a9faa98df64c/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:10.402915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-ed512805-440d-4ddf-a2c0-4f522e94b0db None None] MFA Rules not processed for user `c4c16a3b07c64a22bfc3df2a5a90c3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:10.402915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ed512805-440d-4ddf-a2c0-4f522e94b0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:10.403072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ff148-4b30-464c-b346-2945180ffa09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c034054032184ff2958617dbf28e62bb, user_id=49f0ca47a5f44c57afc3a9faa98df64c, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:10.412946 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ff148-4b30-464c-b346-2945180ffa09 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:10.442314 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 822/1629] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:10 2022] PUT /identity/v3/projects/c034054032184ff2958617dbf28e62bb/users/49f0ca47a5f44c57afc3a9faa98df64c/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:10.454883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32df417-fd90-487c-81e0-c29150e770b9 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:10.455175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32df417-fd90-487c-81e0-c29150e770b9 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:10.455461 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32df417-fd90-487c-81e0-c29150e770b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:10.478237 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 808/1630] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 10 21:20:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:20:10.479809 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9451b-f13d-4428-abb0-9bcb93edc432 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:10.480101 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9451b-f13d-4428-abb0-9bcb93edc432 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:10.480377 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9451b-f13d-4428-abb0-9bcb93edc432 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:10.482007 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 809/1631] 10.222.0.25 () {54 vars in 912 bytes} [Tue May 10 21:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:20:10.487913 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2906a2a-2642-4da3-91a1-95dfaf5a4aa9 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:10.488211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2906a2a-2642-4da3-91a1-95dfaf5a4aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:10.488493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2906a2a-2642-4da3-91a1-95dfaf5a4aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:10.501470 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-a32df417-fd90-487c-81e0-c29150e770b9 None None] MFA Rules not processed for user `49f0ca47a5f44c57afc3a9faa98df64c`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:10.504937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a32df417-fd90-487c-81e0-c29150e770b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:10.513205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b2906a2a-2642-4da3-91a1-95dfaf5a4aa9 None None] MFA Rules not processed for user `c4c16a3b07c64a22bfc3df2a5a90c3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:10.514786 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b2906a2a-2642-4da3-91a1-95dfaf5a4aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:10.599169 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 823/1632] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:10 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:10.600839 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32df417-fd90-487c-81e0-c29150e770b9 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:10.612681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 810/1633] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 10 21:20:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:10.620331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2906a2a-2642-4da3-91a1-95dfaf5a4aa9 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:10.784376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2906a2a-2642-4da3-91a1-95dfaf5a4aa9 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:10.784376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7766045-2218-4d1b-9c48-5f35d909f093 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:10.784376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7766045-2218-4d1b-9c48-5f35d909f093 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:10.784376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7766045-2218-4d1b-9c48-5f35d909f093 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:10.785827 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7766045-2218-4d1b-9c48-5f35d909f093 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:10.789110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32df417-fd90-487c-81e0-c29150e770b9 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:10.791169 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7766045-2218-4d1b-9c48-5f35d909f093 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:10.792478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7766045-2218-4d1b-9c48-5f35d909f093 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:10.806758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa69327-641e-4569-9cc8-638e82469998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:10.807439 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa69327-641e-4569-9cc8-638e82469998 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:10.807587 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 811/1634] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:10.807699 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa69327-641e-4569-9cc8-638e82469998 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:10.807990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa69327-641e-4569-9cc8-638e82469998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:10.825155 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa69327-641e-4569-9cc8-638e82469998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:10.826838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa69327-641e-4569-9cc8-638e82469998 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:10.855149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 824/1635] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:11.011475 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7766045-2218-4d1b-9c48-5f35d909f093 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:11.031724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7766045-2218-4d1b-9c48-5f35d909f093 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:11.045736 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd7d81-5c8f-4e4b-9b2b-121a09929f9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:11.049982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd7d81-5c8f-4e4b-9b2b-121a09929f9c service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:11.049982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd7d81-5c8f-4e4b-9b2b-121a09929f9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:11.049982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd7d81-5c8f-4e4b-9b2b-121a09929f9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:11.100824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd7d81-5c8f-4e4b-9b2b-121a09929f9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:11.103244 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd7d81-5c8f-4e4b-9b2b-121a09929f9c service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:11.161411 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 812/1636] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:11 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:11.371488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa69327-641e-4569-9cc8-638e82469998 service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:11.477091 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd7d81-5c8f-4e4b-9b2b-121a09929f9c service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:11.505092 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa69327-641e-4569-9cc8-638e82469998 service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:11.511676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff45c8-bcb9-4004-9daa-dafe2f1ebe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:11.513098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff45c8-bcb9-4004-9daa-dafe2f1ebe39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:11.513567 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff45c8-bcb9-4004-9daa-dafe2f1ebe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:11.513899 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff45c8-bcb9-4004-9daa-dafe2f1ebe39 admin admin] PATH_INFO: `/v3/users/657302f196854f7e91fe963884ca42dc` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:11.515237 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff45c8-bcb9-4004-9daa-dafe2f1ebe39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=657302f196854f7e91fe963884ca42dc)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:11.516261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: WARNING py.warnings [None req-9dff45c8-bcb9-4004-9daa-dafe2f1ebe39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:20:11.516261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: warnings.warn(msg) May 10 21:20:11.516261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: May 10 21:20:11.520320 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff45c8-bcb9-4004-9daa-dafe2f1ebe39 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:11.607765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd7d81-5c8f-4e4b-9b2b-121a09929f9c service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:11.621411 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70223afa-fb19-48fe-b16c-d6db1c3715d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:11.622625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70223afa-fb19-48fe-b16c-d6db1c3715d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:11.622909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70223afa-fb19-48fe-b16c-d6db1c3715d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:11.623370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70223afa-fb19-48fe-b16c-d6db1c3715d9 admin admin] PATH_INFO: `/v3/users/51e1176b71d741a3907409cb41461683` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:11.624899 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70223afa-fb19-48fe-b16c-d6db1c3715d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51e1176b71d741a3907409cb41461683)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:11.627218 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70223afa-fb19-48fe-b16c-d6db1c3715d9 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:11.810015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9dff45c8-bcb9-4004-9daa-dafe2f1ebe39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '657302f196854f7e91fe963884ca42dc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:11.810821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9dff45c8-bcb9-4004-9daa-dafe2f1ebe39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '657302f196854f7e91fe963884ca42dc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:11.869414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9dff45c8-bcb9-4004-9daa-dafe2f1ebe39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '657302f196854f7e91fe963884ca42dc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:11.870233 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9dff45c8-bcb9-4004-9daa-dafe2f1ebe39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '657302f196854f7e91fe963884ca42dc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:11.882313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-70223afa-fb19-48fe-b16c-d6db1c3715d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51e1176b71d741a3907409cb41461683'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:11.883679 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-70223afa-fb19-48fe-b16c-d6db1c3715d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51e1176b71d741a3907409cb41461683'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:11.884732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-70223afa-fb19-48fe-b16c-d6db1c3715d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51e1176b71d741a3907409cb41461683'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:11.888938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9dff45c8-bcb9-4004-9daa-dafe2f1ebe39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '657302f196854f7e91fe963884ca42dc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:11.908133 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-70223afa-fb19-48fe-b16c-d6db1c3715d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51e1176b71d741a3907409cb41461683'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:11.917517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-70223afa-fb19-48fe-b16c-d6db1c3715d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51e1176b71d741a3907409cb41461683'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:12.000266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 825/1637] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:20:11 2022] DELETE /identity/v3/users/657302f196854f7e91fe963884ca42dc => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:12.004522 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe63b6f-f631-4196-8147-0f1b00daab8b None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:12.006004 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe63b6f-f631-4196-8147-0f1b00daab8b None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:12.006004 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe63b6f-f631-4196-8147-0f1b00daab8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:12.044912 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-dfe63b6f-f631-4196-8147-0f1b00daab8b None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:12.046173 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-dfe63b6f-f631-4196-8147-0f1b00daab8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:12.098948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 813/1638] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:20:11 2022] DELETE /identity/v3/users/51e1176b71d741a3907409cb41461683 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:12.104032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e061b47-e801-4fda-969b-6e737122438e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:12.104510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e061b47-e801-4fda-969b-6e737122438e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:12.104948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e061b47-e801-4fda-969b-6e737122438e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:12.157871 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-9e061b47-e801-4fda-969b-6e737122438e None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:12.159351 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9e061b47-e801-4fda-969b-6e737122438e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:12.214560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 826/1639] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:20:12.223301 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe63b6f-f631-4196-8147-0f1b00daab8b None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:12.233068 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-dfe63b6f-f631-4196-8147-0f1b00daab8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:12.267951 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 814/1640] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:12.351347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e061b47-e801-4fda-969b-6e737122438e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:12.353579 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9e061b47-e801-4fda-969b-6e737122438e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:12.482334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e061b47-e801-4fda-969b-6e737122438e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:12.500680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74079b4-0d38-480c-bd5d-82187c13eede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:12.501758 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74079b4-0d38-480c-bd5d-82187c13eede service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:12.502422 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74079b4-0d38-480c-bd5d-82187c13eede service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:12.502958 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74079b4-0d38-480c-bd5d-82187c13eede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:12.526366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74079b4-0d38-480c-bd5d-82187c13eede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:12.528010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74079b4-0d38-480c-bd5d-82187c13eede service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:12.561220 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 815/1641] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:20:12.567248 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6907b-b3fe-40df-b8e8-ce556495d761 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:12.570617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6907b-b3fe-40df-b8e8-ce556495d761 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:12.571291 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6907b-b3fe-40df-b8e8-ce556495d761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:12.670823 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f8f6907b-b3fe-40df-b8e8-ce556495d761 None None] MFA Rules not processed for user `250d6a26720a4416b62f5f7b2c646c80`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:12.670823 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f8f6907b-b3fe-40df-b8e8-ce556495d761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:12.671736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe63b6f-f631-4196-8147-0f1b00daab8b None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:12.671736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e967fa-4243-4030-842c-d39c6d87272e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:12.672936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e967fa-4243-4030-842c-d39c6d87272e service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:12.673319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e967fa-4243-4030-842c-d39c6d87272e service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:12.674816 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e967fa-4243-4030-842c-d39c6d87272e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:12.689768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e967fa-4243-4030-842c-d39c6d87272e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:12.691690 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e967fa-4243-4030-842c-d39c6d87272e service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:12.722108 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 827/1642] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:20:12.751228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 816/1643] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:12.766627 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bce8c-4a6e-4ed2-b1e3-045f969f28a2 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:12.766917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bce8c-4a6e-4ed2-b1e3-045f969f28a2 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:12.767802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bce8c-4a6e-4ed2-b1e3-045f969f28a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:12.790498 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-469bce8c-4a6e-4ed2-b1e3-045f969f28a2 None None] MFA Rules not processed for user `250d6a26720a4416b62f5f7b2c646c80`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:12.792508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-469bce8c-4a6e-4ed2-b1e3-045f969f28a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:12.801387 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 828/1644] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:12.819030 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6907b-b3fe-40df-b8e8-ce556495d761 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:12.821369 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f8f6907b-b3fe-40df-b8e8-ce556495d761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:12.914580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6907b-b3fe-40df-b8e8-ce556495d761 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:12.920703 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1e773-a64d-4fd2-9332-74366d47bdf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:12.925801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1e773-a64d-4fd2-9332-74366d47bdf0 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:12.925801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1e773-a64d-4fd2-9332-74366d47bdf0 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:12.925801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1e773-a64d-4fd2-9332-74366d47bdf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:12.935520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1e773-a64d-4fd2-9332-74366d47bdf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:12.938299 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1e773-a64d-4fd2-9332-74366d47bdf0 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:12.949367 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 817/1645] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:20:13.346198 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bce8c-4a6e-4ed2-b1e3-045f969f28a2 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:13.347623 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-469bce8c-4a6e-4ed2-b1e3-045f969f28a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:13.374224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bce8c-4a6e-4ed2-b1e3-045f969f28a2 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:13.381467 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c680ae-e747-4a95-b373-9fbe5af0c515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:13.381467 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c680ae-e747-4a95-b373-9fbe5af0c515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:13.381467 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c680ae-e747-4a95-b373-9fbe5af0c515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:13.381467 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c680ae-e747-4a95-b373-9fbe5af0c515 admin admin] PATH_INFO: `/v3/projects/4b41b310b0064ec08e06330c518f70b2` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:13.384136 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c680ae-e747-4a95-b373-9fbe5af0c515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b41b310b0064ec08e06330c518f70b2)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:13.386249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c680ae-e747-4a95-b373-9fbe5af0c515 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:13.515362 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-73c680ae-e747-4a95-b373-9fbe5af0c515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b41b310b0064ec08e06330c518f70b2', 'request_id': 'req-73c680ae-e747-4a95-b373-9fbe5af0c515'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:13.803357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-73c680ae-e747-4a95-b373-9fbe5af0c515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b41b310b0064ec08e06330c518f70b2', 'request_id': 'req-73c680ae-e747-4a95-b373-9fbe5af0c515'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:13.803357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-73c680ae-e747-4a95-b373-9fbe5af0c515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b41b310b0064ec08e06330c518f70b2', 'request_id': 'req-73c680ae-e747-4a95-b373-9fbe5af0c515'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:13.803357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-73c680ae-e747-4a95-b373-9fbe5af0c515 admin admin] The token cache is being invalidate because project 4b41b310b0064ec08e06330c518f70b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:20:13.803357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-73c680ae-e747-4a95-b373-9fbe5af0c515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:13.805657 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-73c680ae-e747-4a95-b373-9fbe5af0c515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:13.805657 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 829/1646] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:20:13 2022] DELETE /identity/v3/projects/4b41b310b0064ec08e06330c518f70b2 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:13.811644 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97a7e5-4884-44d7-a364-1cda5bcf3187 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:13.811644 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97a7e5-4884-44d7-a364-1cda5bcf3187 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:13.811644 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97a7e5-4884-44d7-a364-1cda5bcf3187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:13.811644 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-fe97a7e5-4884-44d7-a364-1cda5bcf3187 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:13.811644 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fe97a7e5-4884-44d7-a364-1cda5bcf3187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:13.811644 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 818/1647] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:13.813031 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08487fca-7c66-4eaa-9bff-f83d14366463 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:13.813031 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08487fca-7c66-4eaa-9bff-f83d14366463 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:13.813031 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08487fca-7c66-4eaa-9bff-f83d14366463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:13.813031 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-08487fca-7c66-4eaa-9bff-f83d14366463 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:13.813031 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-08487fca-7c66-4eaa-9bff-f83d14366463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:13.813031 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 830/1648] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:20:13.814900 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97a7e5-4884-44d7-a364-1cda5bcf3187 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:13.814900 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97a7e5-4884-44d7-a364-1cda5bcf3187 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:13.835921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb229ad-7899-4f50-ac77-b18191c971f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:13.835921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb229ad-7899-4f50-ac77-b18191c971f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:13.835921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb229ad-7899-4f50-ac77-b18191c971f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:13.835921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb229ad-7899-4f50-ac77-b18191c971f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:13.836156 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb229ad-7899-4f50-ac77-b18191c971f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:20:13.836156 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb229ad-7899-4f50-ac77-b18191c971f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:13.836156 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb229ad-7899-4f50-ac77-b18191c971f7 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:13.842111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 819/1649] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:20:13.846652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08487fca-7c66-4eaa-9bff-f83d14366463 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:13.866029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08487fca-7c66-4eaa-9bff-f83d14366463 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:13.873199 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8829152-1f2c-472d-8f3c-1537f6a8c5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:13.874292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8829152-1f2c-472d-8f3c-1537f6a8c5ac admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:13.874892 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8829152-1f2c-472d-8f3c-1537f6a8c5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:13.875324 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8829152-1f2c-472d-8f3c-1537f6a8c5ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:13.876180 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8829152-1f2c-472d-8f3c-1537f6a8c5ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:13.879290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8829152-1f2c-472d-8f3c-1537f6a8c5ac admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:13.986257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191002b-dc37-4702-8e81-7165d9b9737b None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:13.986853 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191002b-dc37-4702-8e81-7165d9b9737b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:13.987283 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191002b-dc37-4702-8e81-7165d9b9737b None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:13.988942 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 820/1650] 10.222.0.25 () {54 vars in 912 bytes} [Tue May 10 21:20:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:20:13.997282 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51124636-a54f-40eb-92ce-3141f50a37fd None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:13.997877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51124636-a54f-40eb-92ce-3141f50a37fd None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:13.998523 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51124636-a54f-40eb-92ce-3141f50a37fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:14.030783 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 831/1651] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:13 2022] POST /identity/v3/projects => generated 363 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:14.033268 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8829152-1f2c-472d-8f3c-1537f6a8c5ac admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:14.089236 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-51124636-a54f-40eb-92ce-3141f50a37fd None None] MFA Rules not processed for user `2fa7da0ccf954be1a582411cdc617b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:14.090785 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-51124636-a54f-40eb-92ce-3141f50a37fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:14.168007 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 821/1652] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 10 21:20:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:20:14.186769 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51124636-a54f-40eb-92ce-3141f50a37fd None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:14.190847 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-51124636-a54f-40eb-92ce-3141f50a37fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:14.254121 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8829152-1f2c-472d-8f3c-1537f6a8c5ac admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:14.277340 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6ad6f-9893-4c24-b4ed-c0570f9f7a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:14.281371 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6ad6f-9893-4c24-b4ed-c0570f9f7a2c admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:14.281882 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6ad6f-9893-4c24-b4ed-c0570f9f7a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:14.282232 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6ad6f-9893-4c24-b4ed-c0570f9f7a2c admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:14.285814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6ad6f-9893-4c24-b4ed-c0570f9f7a2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:14.293782 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6ad6f-9893-4c24-b4ed-c0570f9f7a2c admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:14.391287 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 832/1653] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:14 2022] POST /identity/v3/users => generated 282 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:14.399599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6ad6f-9893-4c24-b4ed-c0570f9f7a2c admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:14.406568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-71c6ad6f-9893-4c24-b4ed-c0570f9f7a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:14.453575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51124636-a54f-40eb-92ce-3141f50a37fd None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:14.457781 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6ad6f-9893-4c24-b4ed-c0570f9f7a2c admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:14.466258 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98b225-f364-4cdc-8028-d6f1c4975540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:14.466974 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98b225-f364-4cdc-8028-d6f1c4975540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:14.467700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da5e80-f81e-4615-9720-0e07a907d6e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:14.468419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da5e80-f81e-4615-9720-0e07a907d6e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:14.468776 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98b225-f364-4cdc-8028-d6f1c4975540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:14.469125 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da5e80-f81e-4615-9720-0e07a907d6e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:14.469470 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98b225-f364-4cdc-8028-d6f1c4975540 admin admin] PATH_INFO: `/v3/projects/8ce7dc7c24b34647b2629a5244f80617` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:14.469823 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da5e80-f81e-4615-9720-0e07a907d6e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:14.471863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98b225-f364-4cdc-8028-d6f1c4975540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ce7dc7c24b34647b2629a5244f80617)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:14.473324 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: WARNING py.warnings [None req-ba98b225-f364-4cdc-8028-d6f1c4975540 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:20:14.473324 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: warnings.warn(msg) May 10 21:20:14.473324 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: May 10 21:20:14.479627 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98b225-f364-4cdc-8028-d6f1c4975540 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:14.491798 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da5e80-f81e-4615-9720-0e07a907d6e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:14.493465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da5e80-f81e-4615-9720-0e07a907d6e0 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:14.520539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 833/1654] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:14.522758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da5e80-f81e-4615-9720-0e07a907d6e0 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:14.563864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da5e80-f81e-4615-9720-0e07a907d6e0 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:14.582474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3655ca-7d06-4ac2-94a5-c282c2b99f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:14.583160 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3655ca-7d06-4ac2-94a5-c282c2b99f6e admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:14.583469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3655ca-7d06-4ac2-94a5-c282c2b99f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:14.583747 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3655ca-7d06-4ac2-94a5-c282c2b99f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:14.584481 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3655ca-7d06-4ac2-94a5-c282c2b99f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:14.586786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3655ca-7d06-4ac2-94a5-c282c2b99f6e admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:14.603271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 834/1655] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:14.609602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3655ca-7d06-4ac2-94a5-c282c2b99f6e admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:14.634794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3655ca-7d06-4ac2-94a5-c282c2b99f6e admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:14.683144 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ba98b225-f364-4cdc-8028-d6f1c4975540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ce7dc7c24b34647b2629a5244f80617', 'request_id': 'req-ba98b225-f364-4cdc-8028-d6f1c4975540'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:14.752462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ba98b225-f364-4cdc-8028-d6f1c4975540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ce7dc7c24b34647b2629a5244f80617', 'request_id': 'req-ba98b225-f364-4cdc-8028-d6f1c4975540'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:14.763377 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ba98b225-f364-4cdc-8028-d6f1c4975540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ce7dc7c24b34647b2629a5244f80617', 'request_id': 'req-ba98b225-f364-4cdc-8028-d6f1c4975540'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:14.783421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a4e3a-68e5-465d-bdaf-18b8b3db1c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:14.784411 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a4e3a-68e5-465d-bdaf-18b8b3db1c6d admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:14.785837 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a4e3a-68e5-465d-bdaf-18b8b3db1c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:14.785837 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a4e3a-68e5-465d-bdaf-18b8b3db1c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:14.790453 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a4e3a-68e5-465d-bdaf-18b8b3db1c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:14.799374 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a4e3a-68e5-465d-bdaf-18b8b3db1c6d admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:14.814721 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ba98b225-f364-4cdc-8028-d6f1c4975540 admin admin] The token cache is being invalidate because project 8ce7dc7c24b34647b2629a5244f80617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:20:14.817957 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ba98b225-f364-4cdc-8028-d6f1c4975540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:14.818063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ba98b225-f364-4cdc-8028-d6f1c4975540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:14.822850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 835/1656] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:14.825896 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 822/1657] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:20:14 2022] DELETE /identity/v3/projects/8ce7dc7c24b34647b2629a5244f80617 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:14.827986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98b225-f364-4cdc-8028-d6f1c4975540 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:14.828529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a4e3a-68e5-465d-bdaf-18b8b3db1c6d admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:14.831047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ba98b225-f364-4cdc-8028-d6f1c4975540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:14.832694 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-d00a4e3a-68e5-465d-bdaf-18b8b3db1c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:14.861317 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a4e3a-68e5-465d-bdaf-18b8b3db1c6d admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:14.864579 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98b225-f364-4cdc-8028-d6f1c4975540 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:14.873554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17429d5-1517-43a1-8998-f5dbca1fd9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:14.878618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd266ec-1b60-437a-8872-5ee0d1cf602b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:14.878618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd266ec-1b60-437a-8872-5ee0d1cf602b admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:14.878618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd266ec-1b60-437a-8872-5ee0d1cf602b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:14.878618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd266ec-1b60-437a-8872-5ee0d1cf602b admin admin] PATH_INFO: `/v3/projects/8c42d3bca98549cea5c98989f41eca46/users/46054e2bf1504b3ab8dfc53ef22f1761/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:14.879064 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17429d5-1517-43a1-8998-f5dbca1fd9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:14.879064 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17429d5-1517-43a1-8998-f5dbca1fd9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:14.879064 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17429d5-1517-43a1-8998-f5dbca1fd9e0 admin admin] PATH_INFO: `/v3/users/49f0ca47a5f44c57afc3a9faa98df64c` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:14.880915 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17429d5-1517-43a1-8998-f5dbca1fd9e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49f0ca47a5f44c57afc3a9faa98df64c)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:14.886072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17429d5-1517-43a1-8998-f5dbca1fd9e0 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:14.920782 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd266ec-1b60-437a-8872-5ee0d1cf602b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c42d3bca98549cea5c98989f41eca46, user_id=46054e2bf1504b3ab8dfc53ef22f1761, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:14.927576 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd266ec-1b60-437a-8872-5ee0d1cf602b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:15.024731 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 823/1658] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:14 2022] PUT /identity/v3/projects/8c42d3bca98549cea5c98989f41eca46/users/46054e2bf1504b3ab8dfc53ef22f1761/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:15.050023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa708900-a1e8-43ea-8ff6-f63ee45a389b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:15.050023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa708900-a1e8-43ea-8ff6-f63ee45a389b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:15.050023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa708900-a1e8-43ea-8ff6-f63ee45a389b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:15.089367 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-fa708900-a1e8-43ea-8ff6-f63ee45a389b None None] MFA Rules not processed for user `46054e2bf1504b3ab8dfc53ef22f1761`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:15.090921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fa708900-a1e8-43ea-8ff6-f63ee45a389b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:15.140365 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d17429d5-1517-43a1-8998-f5dbca1fd9e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49f0ca47a5f44c57afc3a9faa98df64c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:15.148033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d17429d5-1517-43a1-8998-f5dbca1fd9e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49f0ca47a5f44c57afc3a9faa98df64c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:15.176762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d17429d5-1517-43a1-8998-f5dbca1fd9e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49f0ca47a5f44c57afc3a9faa98df64c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:15.178347 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d17429d5-1517-43a1-8998-f5dbca1fd9e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49f0ca47a5f44c57afc3a9faa98df64c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:15.208683 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d17429d5-1517-43a1-8998-f5dbca1fd9e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49f0ca47a5f44c57afc3a9faa98df64c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:15.253798 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 824/1659] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:15 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:15.258342 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa708900-a1e8-43ea-8ff6-f63ee45a389b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:15.261761 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fa708900-a1e8-43ea-8ff6-f63ee45a389b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:15.307792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 836/1660] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:20:14 2022] DELETE /identity/v3/users/49f0ca47a5f44c57afc3a9faa98df64c => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:20:15.389375 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa708900-a1e8-43ea-8ff6-f63ee45a389b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:15.498465 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7de70-40d5-4a23-bb2d-405883d112e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:15.499249 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7de70-40d5-4a23-bb2d-405883d112e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:15.499530 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7de70-40d5-4a23-bb2d-405883d112e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:15.499912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7de70-40d5-4a23-bb2d-405883d112e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:15.500832 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7de70-40d5-4a23-bb2d-405883d112e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:15.503082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7de70-40d5-4a23-bb2d-405883d112e3 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:15.598345 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 825/1661] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:15 2022] POST /identity/v3/projects => generated 363 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:15.604468 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17429d5-1517-43a1-8998-f5dbca1fd9e0 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:15.638305 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17429d5-1517-43a1-8998-f5dbca1fd9e0 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:15.891467 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1531c-920f-46e2-a2bc-b40dbed188d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:15.892344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1531c-920f-46e2-a2bc-b40dbed188d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:15.892637 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1531c-920f-46e2-a2bc-b40dbed188d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:15.892915 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1531c-920f-46e2-a2bc-b40dbed188d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:15.893640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1531c-920f-46e2-a2bc-b40dbed188d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:15.895627 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1531c-920f-46e2-a2bc-b40dbed188d7 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:15.911294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cd232-d1f5-49b6-991a-2c2db07490d4 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:15.912403 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cd232-d1f5-49b6-991a-2c2db07490d4 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:15.912834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cd232-d1f5-49b6-991a-2c2db07490d4 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:15.914784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 826/1662] 10.222.0.25 () {54 vars in 960 bytes} [Tue May 10 21:20:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:20:15.921823 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d42653-0311-4c40-a169-3001b90016b6 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:15.922545 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d42653-0311-4c40-a169-3001b90016b6 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:15.922982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d42653-0311-4c40-a169-3001b90016b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:15.948262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-45d42653-0311-4c40-a169-3001b90016b6 None None] MFA Rules not processed for user `9a13ad1e10ff44c4b870b45b7416b70f`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:15.949812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-45d42653-0311-4c40-a169-3001b90016b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:16.055016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 837/1663] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:15 2022] POST /identity/v3/users => generated 288 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:20:16.067706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1531c-920f-46e2-a2bc-b40dbed188d7 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:16.080719 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1531c-920f-46e2-a2bc-b40dbed188d7 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:16.091728 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 827/1664] 10.222.0.25 () {58 vars in 1057 bytes} [Tue May 10 21:20:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:16.093006 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d42653-0311-4c40-a169-3001b90016b6 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:16.094824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9503ed-668f-4da3-806e-50b4e7caa35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:16.095534 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9503ed-668f-4da3-806e-50b4e7caa35c admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:16.095823 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9503ed-668f-4da3-806e-50b4e7caa35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:16.096107 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9503ed-668f-4da3-806e-50b4e7caa35c admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:16.096855 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9503ed-668f-4da3-806e-50b4e7caa35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:16.098848 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9503ed-668f-4da3-806e-50b4e7caa35c admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:16.107944 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d42653-0311-4c40-a169-3001b90016b6 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:16.115711 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf180400-033a-44cb-b420-35e8cef34cbb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a13ad1e10ff44c4b870b45b7416b70f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:16.117675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf180400-033a-44cb-b420-35e8cef34cbb service placement] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:16.117675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf180400-033a-44cb-b420-35e8cef34cbb service placement] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:16.117675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf180400-033a-44cb-b420-35e8cef34cbb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:16.120615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-cf180400-033a-44cb-b420-35e8cef34cbb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:16.137486 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf180400-033a-44cb-b420-35e8cef34cbb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:16.138941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 838/1665] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:16.145879 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf180400-033a-44cb-b420-35e8cef34cbb service placement] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:16.146031 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9503ed-668f-4da3-806e-50b4e7caa35c admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:16.160695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9503ed-668f-4da3-806e-50b4e7caa35c admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:16.166363 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 828/1666] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:16.168243 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13893593-324e-435e-ae5a-446cf985aec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:16.169325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13893593-324e-435e-ae5a-446cf985aec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:16.169614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13893593-324e-435e-ae5a-446cf985aec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:16.169933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13893593-324e-435e-ae5a-446cf985aec9 admin admin] PATH_INFO: `/v3/projects/9df3e5acc40543d5a62bfb1013815d98/users/5d15bbfb895c4bc9a060b0ef750219a1/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:16.190379 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13893593-324e-435e-ae5a-446cf985aec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df3e5acc40543d5a62bfb1013815d98, user_id=5d15bbfb895c4bc9a060b0ef750219a1, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:16.193274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13893593-324e-435e-ae5a-446cf985aec9 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:16.269783 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 839/1667] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:16 2022] PUT /identity/v3/projects/9df3e5acc40543d5a62bfb1013815d98/users/5d15bbfb895c4bc9a060b0ef750219a1/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:16.269913 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf180400-033a-44cb-b420-35e8cef34cbb service placement] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:16.288591 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf180400-033a-44cb-b420-35e8cef34cbb service placement] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:16.443718 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a878b-7d6e-4641-9722-5c0a858fca28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:16.447222 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a878b-7d6e-4641-9722-5c0a858fca28 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:16.447222 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a878b-7d6e-4641-9722-5c0a858fca28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:16.447222 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a878b-7d6e-4641-9722-5c0a858fca28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:16.448616 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a878b-7d6e-4641-9722-5c0a858fca28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:16.455185 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a878b-7d6e-4641-9722-5c0a858fca28 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:16.479836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13893593-324e-435e-ae5a-446cf985aec9 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:16.493484 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13893593-324e-435e-ae5a-446cf985aec9 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:16.496847 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 829/1668] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:16.507497 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e538b-942c-4f1e-9aee-7f7dc7d5d10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:16.511543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e538b-942c-4f1e-9aee-7f7dc7d5d10f admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:16.511944 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e538b-942c-4f1e-9aee-7f7dc7d5d10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:16.513039 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e538b-942c-4f1e-9aee-7f7dc7d5d10f admin admin] PATH_INFO: `/v3/projects/9df3e5acc40543d5a62bfb1013815d98/users/5d15bbfb895c4bc9a060b0ef750219a1/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:16.518370 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e538b-942c-4f1e-9aee-7f7dc7d5d10f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df3e5acc40543d5a62bfb1013815d98, user_id=5d15bbfb895c4bc9a060b0ef750219a1, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:16.526363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e538b-942c-4f1e-9aee-7f7dc7d5d10f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:16.556944 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 840/1669] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:16 2022] PUT /identity/v3/projects/9df3e5acc40543d5a62bfb1013815d98/users/5d15bbfb895c4bc9a060b0ef750219a1/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:20:16.567503 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e3af0-c130-4d92-97fd-7e827fd2560a None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:16.567794 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e3af0-c130-4d92-97fd-7e827fd2560a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:16.568072 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e3af0-c130-4d92-97fd-7e827fd2560a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:16.676640 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-fe9e3af0-c130-4d92-97fd-7e827fd2560a None None] MFA Rules not processed for user `5d15bbfb895c4bc9a060b0ef750219a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:16.676640 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fe9e3af0-c130-4d92-97fd-7e827fd2560a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:16.838024 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 830/1670] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:16 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:16.855938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e538b-942c-4f1e-9aee-7f7dc7d5d10f admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:16.857683 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-dd0e538b-942c-4f1e-9aee-7f7dc7d5d10f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:16.866097 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e3af0-c130-4d92-97fd-7e827fd2560a None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:16.866097 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fe9e3af0-c130-4d92-97fd-7e827fd2560a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:17.065295 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e3af0-c130-4d92-97fd-7e827fd2560a None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:17.079290 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a37761-997b-4690-b805-621da78c280d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:17.079980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a37761-997b-4690-b805-621da78c280d service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:17.080259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a37761-997b-4690-b805-621da78c280d service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:17.080794 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a37761-997b-4690-b805-621da78c280d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:17.102228 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e538b-942c-4f1e-9aee-7f7dc7d5d10f admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:17.106123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a37761-997b-4690-b805-621da78c280d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:17.107611 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a37761-997b-4690-b805-621da78c280d service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:17.111579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010bb4a-718c-49b5-a866-a31ac584d09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:17.112692 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010bb4a-718c-49b5-a866-a31ac584d09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:17.113884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010bb4a-718c-49b5-a866-a31ac584d09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:17.114319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010bb4a-718c-49b5-a866-a31ac584d09b admin admin] PATH_INFO: `/v3/projects/c034054032184ff2958617dbf28e62bb` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:17.115861 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010bb4a-718c-49b5-a866-a31ac584d09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c034054032184ff2958617dbf28e62bb)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:17.118496 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010bb4a-718c-49b5-a866-a31ac584d09b admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:17.143792 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 831/1671] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:16 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:20:17.397911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4010bb4a-718c-49b5-a866-a31ac584d09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c034054032184ff2958617dbf28e62bb', 'request_id': 'req-4010bb4a-718c-49b5-a866-a31ac584d09b'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:17.495783 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4010bb4a-718c-49b5-a866-a31ac584d09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c034054032184ff2958617dbf28e62bb', 'request_id': 'req-4010bb4a-718c-49b5-a866-a31ac584d09b'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:17.502698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4010bb4a-718c-49b5-a866-a31ac584d09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c034054032184ff2958617dbf28e62bb', 'request_id': 'req-4010bb4a-718c-49b5-a866-a31ac584d09b'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:17.526550 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4010bb4a-718c-49b5-a866-a31ac584d09b admin admin] The token cache is being invalidate because project c034054032184ff2958617dbf28e62bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:20:17.528906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4010bb4a-718c-49b5-a866-a31ac584d09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:17.529943 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4010bb4a-718c-49b5-a866-a31ac584d09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:17.534878 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 841/1672] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:20:16 2022] DELETE /identity/v3/projects/c034054032184ff2958617dbf28e62bb => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:17.540024 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4dca7-c0fd-4323-8b20-26b35af61ef2 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:17.540317 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4dca7-c0fd-4323-8b20-26b35af61ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:17.540597 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4dca7-c0fd-4323-8b20-26b35af61ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:17.581008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-60e4dca7-c0fd-4323-8b20-26b35af61ef2 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:17.582354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-60e4dca7-c0fd-4323-8b20-26b35af61ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:17.676997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010bb4a-718c-49b5-a866-a31ac584d09b admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:17.679083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4010bb4a-718c-49b5-a866-a31ac584d09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:17.679510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 832/1673] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:17.688523 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7f24b-0cd0-4563-bf31-b393681d0cb4 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:17.689043 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7f24b-0cd0-4563-bf31-b393681d0cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:17.689672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7f24b-0cd0-4563-bf31-b393681d0cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:17.723061 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2bd7f24b-0cd0-4563-bf31-b393681d0cb4 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:17.725298 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2bd7f24b-0cd0-4563-bf31-b393681d0cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:17.744107 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 833/1674] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:17.745483 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7f24b-0cd0-4563-bf31-b393681d0cb4 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:17.758183 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7f24b-0cd0-4563-bf31-b393681d0cb4 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:17.767655 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a47798-2c09-41ae-8ed7-6aebb7f6a9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:17.768850 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a47798-2c09-41ae-8ed7-6aebb7f6a9bc admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:17.776943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a47798-2c09-41ae-8ed7-6aebb7f6a9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:17.776943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a47798-2c09-41ae-8ed7-6aebb7f6a9bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:17.776943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a47798-2c09-41ae-8ed7-6aebb7f6a9bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:20:17.776943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a47798-2c09-41ae-8ed7-6aebb7f6a9bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:17.776943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a47798-2c09-41ae-8ed7-6aebb7f6a9bc admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:17.794083 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 834/1675] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:20:17.795405 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a47798-2c09-41ae-8ed7-6aebb7f6a9bc admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:17.809006 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a47798-2c09-41ae-8ed7-6aebb7f6a9bc admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:17.815700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35c359-fd6d-453b-8049-b1a1e25c57c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:17.816412 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35c359-fd6d-453b-8049-b1a1e25c57c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:17.816844 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35c359-fd6d-453b-8049-b1a1e25c57c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:17.817228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35c359-fd6d-453b-8049-b1a1e25c57c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:17.818348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35c359-fd6d-453b-8049-b1a1e25c57c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:17.821688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35c359-fd6d-453b-8049-b1a1e25c57c4 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:17.849742 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010bb4a-718c-49b5-a866-a31ac584d09b admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:17.863757 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb734b5a-7079-481c-a79c-40c8db389d8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:17.864656 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb734b5a-7079-481c-a79c-40c8db389d8c service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:17.865105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb734b5a-7079-481c-a79c-40c8db389d8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:17.865511 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb734b5a-7079-481c-a79c-40c8db389d8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:17.868392 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-cb734b5a-7079-481c-a79c-40c8db389d8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:17.927770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 835/1676] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:17 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:17.933582 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35c359-fd6d-453b-8049-b1a1e25c57c4 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:18.002501 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb734b5a-7079-481c-a79c-40c8db389d8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:18.003969 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb734b5a-7079-481c-a79c-40c8db389d8c service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:18.033003 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 842/1677] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:17 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:20:18.119859 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35c359-fd6d-453b-8049-b1a1e25c57c4 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:18.130768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11a0bb-b652-4b4d-9bab-c500729b7f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:18.131888 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11a0bb-b652-4b4d-9bab-c500729b7f27 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:18.134212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11a0bb-b652-4b4d-9bab-c500729b7f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:18.135230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11a0bb-b652-4b4d-9bab-c500729b7f27 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:18.137492 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11a0bb-b652-4b4d-9bab-c500729b7f27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:18.140224 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11a0bb-b652-4b4d-9bab-c500729b7f27 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:18.291521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 836/1678] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:17 2022] POST /identity/v3/users => generated 289 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:18.293490 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb734b5a-7079-481c-a79c-40c8db389d8c service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:18.324828 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb734b5a-7079-481c-a79c-40c8db389d8c service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:18.347647 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ef366-c466-4c5d-8c07-80d6c3409e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:18.352208 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ef366-c466-4c5d-8c07-80d6c3409e3a admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:18.354110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ef366-c466-4c5d-8c07-80d6c3409e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:18.355065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ef366-c466-4c5d-8c07-80d6c3409e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:18.365472 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ef366-c466-4c5d-8c07-80d6c3409e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:18.367492 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ef366-c466-4c5d-8c07-80d6c3409e3a admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:18.397987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 843/1679] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:18.402624 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11a0bb-b652-4b4d-9bab-c500729b7f27 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:18.416119 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11a0bb-b652-4b4d-9bab-c500729b7f27 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:18.430002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4b309-e370-42b8-9df2-dd8caa2353e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:18.432434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4b309-e370-42b8-9df2-dd8caa2353e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:18.432846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4b309-e370-42b8-9df2-dd8caa2353e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:18.437087 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4b309-e370-42b8-9df2-dd8caa2353e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:18.438413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4b309-e370-42b8-9df2-dd8caa2353e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:18.445581 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4b309-e370-42b8-9df2-dd8caa2353e2 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:18.486052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 837/1680] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:18.488526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ef366-c466-4c5d-8c07-80d6c3409e3a admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:18.521915 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ef366-c466-4c5d-8c07-80d6c3409e3a admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:18.529758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2d880-2205-4513-9f22-8590faacd8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:18.531231 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2d880-2205-4513-9f22-8590faacd8c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:18.532447 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2d880-2205-4513-9f22-8590faacd8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:18.532991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2d880-2205-4513-9f22-8590faacd8c8 admin admin] PATH_INFO: `/v3/projects/b6928169fe5a4e14b286ec35fe91785c/users/5cbf8e77764a4416811cea46774f20c6/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:18.620654 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2d880-2205-4513-9f22-8590faacd8c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6928169fe5a4e14b286ec35fe91785c, user_id=5cbf8e77764a4416811cea46774f20c6, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:18.627335 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2d880-2205-4513-9f22-8590faacd8c8 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:18.739800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 844/1681] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:18 2022] PUT /identity/v3/projects/b6928169fe5a4e14b286ec35fe91785c/users/5cbf8e77764a4416811cea46774f20c6/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:18.751160 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d73f57-9019-4ef6-975d-f0190bc8bbb7 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:18.751352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d73f57-9019-4ef6-975d-f0190bc8bbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:18.751639 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d73f57-9019-4ef6-975d-f0190bc8bbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:18.860299 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d9d73f57-9019-4ef6-975d-f0190bc8bbb7 None None] MFA Rules not processed for user `5cbf8e77764a4416811cea46774f20c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:18.862377 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d9d73f57-9019-4ef6-975d-f0190bc8bbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:19.019520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 838/1682] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:19.020722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2d880-2205-4513-9f22-8590faacd8c8 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:19.147117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2d880-2205-4513-9f22-8590faacd8c8 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:19.163227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40029d4-7c1f-4626-8db4-37497f896b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:19.164308 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40029d4-7c1f-4626-8db4-37497f896b1e admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:19.164741 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40029d4-7c1f-4626-8db4-37497f896b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:19.165155 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40029d4-7c1f-4626-8db4-37497f896b1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:19.165993 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40029d4-7c1f-4626-8db4-37497f896b1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:19.168084 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40029d4-7c1f-4626-8db4-37497f896b1e admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:19.277683 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 845/1683] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:19 2022] POST /identity/v3/projects => generated 377 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:19.281523 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d73f57-9019-4ef6-975d-f0190bc8bbb7 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:19.297820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d73f57-9019-4ef6-975d-f0190bc8bbb7 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:19.425904 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c0520-c9de-44a8-8369-62d775a1825c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:19.426797 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c0520-c9de-44a8-8369-62d775a1825c admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:19.427409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c0520-c9de-44a8-8369-62d775a1825c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:19.427780 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c0520-c9de-44a8-8369-62d775a1825c admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:19.428878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c0520-c9de-44a8-8369-62d775a1825c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:19.439364 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c0520-c9de-44a8-8369-62d775a1825c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:19.552721 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 839/1684] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:19 2022] POST /identity/v3/users => generated 295 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:19.556898 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40029d4-7c1f-4626-8db4-37497f896b1e admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:19.567372 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40029d4-7c1f-4626-8db4-37497f896b1e admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:19.583857 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef35770-5179-4037-811a-578e01865e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:19.585184 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef35770-5179-4037-811a-578e01865e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:19.585527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef35770-5179-4037-811a-578e01865e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:19.585807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef35770-5179-4037-811a-578e01865e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:19.587516 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef35770-5179-4037-811a-578e01865e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:19.589194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef35770-5179-4037-811a-578e01865e29 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:19.617362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c0520-c9de-44a8-8369-62d775a1825c admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:19.621875 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 846/1685] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:19.626028 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c0520-c9de-44a8-8369-62d775a1825c admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:19.638050 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2693a-be7e-4dce-9d19-3a41e1eb345a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:19.639248 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2693a-be7e-4dce-9d19-3a41e1eb345a admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:19.639676 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2693a-be7e-4dce-9d19-3a41e1eb345a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:19.640103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2693a-be7e-4dce-9d19-3a41e1eb345a admin admin] PATH_INFO: `/v3/projects/8dc719e052654e7187c85e8eda18137d/users/ed78cbbfeb424022bfdd3758594572ee/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:19.673546 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2693a-be7e-4dce-9d19-3a41e1eb345a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc719e052654e7187c85e8eda18137d, user_id=ed78cbbfeb424022bfdd3758594572ee, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:19.676306 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2693a-be7e-4dce-9d19-3a41e1eb345a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:19.801554 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 840/1686] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:19 2022] PUT /identity/v3/projects/8dc719e052654e7187c85e8eda18137d/users/ed78cbbfeb424022bfdd3758594572ee/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:20:19.802612 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef35770-5179-4037-811a-578e01865e29 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:19.813400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef35770-5179-4037-811a-578e01865e29 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:19.961367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22d9fe-459a-46f9-b4e9-63317053097f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:19.962327 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22d9fe-459a-46f9-b4e9-63317053097f admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:19.963381 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22d9fe-459a-46f9-b4e9-63317053097f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:19.963826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22d9fe-459a-46f9-b4e9-63317053097f admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:19.964840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22d9fe-459a-46f9-b4e9-63317053097f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:19.967902 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22d9fe-459a-46f9-b4e9-63317053097f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:20.014591 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 847/1687] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:20.026755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2693a-be7e-4dce-9d19-3a41e1eb345a admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:20.045479 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2693a-be7e-4dce-9d19-3a41e1eb345a admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:20.056942 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30f53a-0272-4d03-b4bf-ff86de00cb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:20.058338 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30f53a-0272-4d03-b4bf-ff86de00cb6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:20.061825 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30f53a-0272-4d03-b4bf-ff86de00cb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:20.062562 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30f53a-0272-4d03-b4bf-ff86de00cb6c admin admin] PATH_INFO: `/v3/projects/8dc719e052654e7187c85e8eda18137d/users/ed78cbbfeb424022bfdd3758594572ee/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:20.069500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30f53a-0272-4d03-b4bf-ff86de00cb6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc719e052654e7187c85e8eda18137d, user_id=ed78cbbfeb424022bfdd3758594572ee, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:20.073874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30f53a-0272-4d03-b4bf-ff86de00cb6c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:20.120115 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 841/1688] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:20 2022] PUT /identity/v3/projects/8dc719e052654e7187c85e8eda18137d/users/ed78cbbfeb424022bfdd3758594572ee/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:20.122248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3903b-9416-4b46-b335-af05782a522d None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:20.122589 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3903b-9416-4b46-b335-af05782a522d None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:20.122875 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3903b-9416-4b46-b335-af05782a522d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:20.166577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-5bd3903b-9416-4b46-b335-af05782a522d None None] MFA Rules not processed for user `ed78cbbfeb424022bfdd3758594572ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:20.169352 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-5bd3903b-9416-4b46-b335-af05782a522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:20.355571 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 848/1689] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:20.368933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30f53a-0272-4d03-b4bf-ff86de00cb6c admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:20.371930 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8f30f53a-0272-4d03-b4bf-ff86de00cb6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:20.517571 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30f53a-0272-4d03-b4bf-ff86de00cb6c admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:20.528740 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe1590-4dde-4311-ac20-6a991a489e5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:20.531082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe1590-4dde-4311-ac20-6a991a489e5d service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:20.532147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe1590-4dde-4311-ac20-6a991a489e5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:20.532436 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe1590-4dde-4311-ac20-6a991a489e5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:20.681010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe1590-4dde-4311-ac20-6a991a489e5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:20.682765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe1590-4dde-4311-ac20-6a991a489e5d service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:20.712922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 842/1690] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:21.552786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3903b-9416-4b46-b335-af05782a522d None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:21.552786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-5bd3903b-9416-4b46-b335-af05782a522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:21.591153 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ce255-36bb-4bdd-bd30-1e17b9b4202b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:21.591685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ce255-36bb-4bdd-bd30-1e17b9b4202b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:21.591803 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ce255-36bb-4bdd-bd30-1e17b9b4202b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:21.665726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-ee3ce255-36bb-4bdd-bd30-1e17b9b4202b None None] MFA Rules not processed for user `c0fc3052af194b48b7ce036ff605ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:21.667167 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ee3ce255-36bb-4bdd-bd30-1e17b9b4202b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:21.702286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3903b-9416-4b46-b335-af05782a522d None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:21.713573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc736aa1-91aa-4a6a-aaea-27d29021e485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:21.714773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc736aa1-91aa-4a6a-aaea-27d29021e485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:21.716548 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc736aa1-91aa-4a6a-aaea-27d29021e485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:21.717041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc736aa1-91aa-4a6a-aaea-27d29021e485 admin admin] PATH_INFO: `/v3/users/05834b48b8c94e7c97f730ae7cc2f587` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:21.720577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc736aa1-91aa-4a6a-aaea-27d29021e485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05834b48b8c94e7c97f730ae7cc2f587)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:21.726571 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc736aa1-91aa-4a6a-aaea-27d29021e485 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:21.814343 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 843/1691] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 10 21:20:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:20:22.024616 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-fc736aa1-91aa-4a6a-aaea-27d29021e485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05834b48b8c94e7c97f730ae7cc2f587'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:22.027715 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-fc736aa1-91aa-4a6a-aaea-27d29021e485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05834b48b8c94e7c97f730ae7cc2f587'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:22.067161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-fc736aa1-91aa-4a6a-aaea-27d29021e485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05834b48b8c94e7c97f730ae7cc2f587'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:22.068319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-fc736aa1-91aa-4a6a-aaea-27d29021e485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05834b48b8c94e7c97f730ae7cc2f587'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:22.091968 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-fc736aa1-91aa-4a6a-aaea-27d29021e485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05834b48b8c94e7c97f730ae7cc2f587'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:22.203643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 849/1692] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:20:21 2022] DELETE /identity/v3/users/05834b48b8c94e7c97f730ae7cc2f587 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:22.208502 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f059a-3127-452e-b810-5ad502c9e897 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:22.208926 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f059a-3127-452e-b810-5ad502c9e897 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:22.209094 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f059a-3127-452e-b810-5ad502c9e897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:22.231203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f95f059a-3127-452e-b810-5ad502c9e897 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:22.232806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f95f059a-3127-452e-b810-5ad502c9e897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:22.294578 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc736aa1-91aa-4a6a-aaea-27d29021e485 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:22.296283 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-fc736aa1-91aa-4a6a-aaea-27d29021e485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:22.387646 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 844/1693] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:22.404907 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f059a-3127-452e-b810-5ad502c9e897 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:22.409235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f95f059a-3127-452e-b810-5ad502c9e897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:22.474251 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc736aa1-91aa-4a6a-aaea-27d29021e485 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:22.491863 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f1135-2d21-456b-b8da-a4ebcb52c039 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76040882d4374087bb7458fd8b5c1d8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:22.492538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f1135-2d21-456b-b8da-a4ebcb52c039 service swift] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:22.495882 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f1135-2d21-456b-b8da-a4ebcb52c039 service swift] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:22.496211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f1135-2d21-456b-b8da-a4ebcb52c039 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:22.503692 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-f81f1135-2d21-456b-b8da-a4ebcb52c039 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:22.592304 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f059a-3127-452e-b810-5ad502c9e897 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:22.611165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413185ca-bc7e-4ce7-85c0-0b9b6943ccad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:22.611165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413185ca-bc7e-4ce7-85c0-0b9b6943ccad service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:22.611165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413185ca-bc7e-4ce7-85c0-0b9b6943ccad service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:22.611165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413185ca-bc7e-4ce7-85c0-0b9b6943ccad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:22.635433 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f1135-2d21-456b-b8da-a4ebcb52c039 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:22.639701 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413185ca-bc7e-4ce7-85c0-0b9b6943ccad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:22.641164 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413185ca-bc7e-4ce7-85c0-0b9b6943ccad service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:22.643990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f1135-2d21-456b-b8da-a4ebcb52c039 service swift] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:22.675368 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 850/1694] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 10 21:20:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 21:20:22.686685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 845/1695] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:24.487776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8b151-84fd-4e07-9996-067f8d24d1d4 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:24.488779 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8b151-84fd-4e07-9996-067f8d24d1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:24.489278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8b151-84fd-4e07-9996-067f8d24d1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:24.563721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-01c8b151-84fd-4e07-9996-067f8d24d1d4 None None] MFA Rules not processed for user `05eb9dfc751a4b44a8d4d7a03138f0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:24.565335 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-01c8b151-84fd-4e07-9996-067f8d24d1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:24.777898 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 851/1696] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:24.793516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413185ca-bc7e-4ce7-85c0-0b9b6943ccad service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:24.794992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-413185ca-bc7e-4ce7-85c0-0b9b6943ccad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:24.828340 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8b151-84fd-4e07-9996-067f8d24d1d4 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:24.829915 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-01c8b151-84fd-4e07-9996-067f8d24d1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:24.872878 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8b151-84fd-4e07-9996-067f8d24d1d4 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:24.893104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8fec3-a0e8-456b-a0ff-c4beb82c02f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:24.894253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8fec3-a0e8-456b-a0ff-c4beb82c02f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:24.894718 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8fec3-a0e8-456b-a0ff-c4beb82c02f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:24.895150 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8fec3-a0e8-456b-a0ff-c4beb82c02f2 admin admin] PATH_INFO: `/v3/projects/56c9fbbebbd742198fe89c367ce3b8ae` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:24.897463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8fec3-a0e8-456b-a0ff-c4beb82c02f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56c9fbbebbd742198fe89c367ce3b8ae)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:24.901494 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8fec3-a0e8-456b-a0ff-c4beb82c02f2 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:24.998082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413185ca-bc7e-4ce7-85c0-0b9b6943ccad service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:25.014146 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183800bb-830e-4692-9508-f22188469fc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:25.018053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183800bb-830e-4692-9508-f22188469fc8 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:25.018492 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183800bb-830e-4692-9508-f22188469fc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:25.018884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183800bb-830e-4692-9508-f22188469fc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:25.049501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183800bb-830e-4692-9508-f22188469fc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:25.053730 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183800bb-830e-4692-9508-f22188469fc8 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:25.094408 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 846/1697] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:25.108323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-02d8fec3-a0e8-456b-a0ff-c4beb82c02f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56c9fbbebbd742198fe89c367ce3b8ae', 'request_id': 'req-02d8fec3-a0e8-456b-a0ff-c4beb82c02f2'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:25.204572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-02d8fec3-a0e8-456b-a0ff-c4beb82c02f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56c9fbbebbd742198fe89c367ce3b8ae', 'request_id': 'req-02d8fec3-a0e8-456b-a0ff-c4beb82c02f2'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:25.211671 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-02d8fec3-a0e8-456b-a0ff-c4beb82c02f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56c9fbbebbd742198fe89c367ce3b8ae', 'request_id': 'req-02d8fec3-a0e8-456b-a0ff-c4beb82c02f2'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:25.253896 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-02d8fec3-a0e8-456b-a0ff-c4beb82c02f2 admin admin] The token cache is being invalidate because project 56c9fbbebbd742198fe89c367ce3b8ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:20:25.253896 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-02d8fec3-a0e8-456b-a0ff-c4beb82c02f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:25.254546 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-02d8fec3-a0e8-456b-a0ff-c4beb82c02f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:25.274331 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 852/1698] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:20:24 2022] DELETE /identity/v3/projects/56c9fbbebbd742198fe89c367ce3b8ae => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:20:25.275953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73209da9-609e-4e11-85b5-6b1e720afe07 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:25.277046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73209da9-609e-4e11-85b5-6b1e720afe07 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:25.277597 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73209da9-609e-4e11-85b5-6b1e720afe07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:25.316831 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-73209da9-609e-4e11-85b5-6b1e720afe07 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:25.319380 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-73209da9-609e-4e11-85b5-6b1e720afe07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:25.441058 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 847/1699] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:20:25.450714 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9e456-f70a-4c4d-b501-bc84572f89e6 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:25.450714 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9e456-f70a-4c4d-b501-bc84572f89e6 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:25.451032 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9e456-f70a-4c4d-b501-bc84572f89e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:25.494163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-dee9e456-f70a-4c4d-b501-bc84572f89e6 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:25.495463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-dee9e456-f70a-4c4d-b501-bc84572f89e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:25.530230 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 853/1700] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:25.534717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73209da9-609e-4e11-85b5-6b1e720afe07 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:25.555691 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73209da9-609e-4e11-85b5-6b1e720afe07 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:25.562777 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50d658-013e-4fa7-b05d-a2c375f1033f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:25.565799 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50d658-013e-4fa7-b05d-a2c375f1033f admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:25.565799 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50d658-013e-4fa7-b05d-a2c375f1033f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:25.565799 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50d658-013e-4fa7-b05d-a2c375f1033f admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:25.565799 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50d658-013e-4fa7-b05d-a2c375f1033f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:20:25.565799 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50d658-013e-4fa7-b05d-a2c375f1033f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:25.570327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50d658-013e-4fa7-b05d-a2c375f1033f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:25.585715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 848/1701] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:20:25.589874 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9e456-f70a-4c4d-b501-bc84572f89e6 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:25.603681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9e456-f70a-4c4d-b501-bc84572f89e6 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:25.610685 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08d6bf-5d46-4356-b50e-6a60b5b5cb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:25.611630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08d6bf-5d46-4356-b50e-6a60b5b5cb2d admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:25.613269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08d6bf-5d46-4356-b50e-6a60b5b5cb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:25.638453 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08d6bf-5d46-4356-b50e-6a60b5b5cb2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:25.644188 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08d6bf-5d46-4356-b50e-6a60b5b5cb2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:25.654198 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08d6bf-5d46-4356-b50e-6a60b5b5cb2d admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:25.824258 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 854/1702] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:25 2022] POST /identity/v3/projects => generated 373 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:25.828452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50d658-013e-4fa7-b05d-a2c375f1033f admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:25.853991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50d658-013e-4fa7-b05d-a2c375f1033f admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:26.067205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbda00d-5ecd-49df-b91f-6f3c136bfad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:26.072260 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbda00d-5ecd-49df-b91f-6f3c136bfad3 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:26.072857 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbda00d-5ecd-49df-b91f-6f3c136bfad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:26.073291 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbda00d-5ecd-49df-b91f-6f3c136bfad3 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:26.074167 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbda00d-5ecd-49df-b91f-6f3c136bfad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:26.077554 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbda00d-5ecd-49df-b91f-6f3c136bfad3 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:26.197958 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 849/1703] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:25 2022] POST /identity/v3/users => generated 287 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:26.199314 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08d6bf-5d46-4356-b50e-6a60b5b5cb2d admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:26.218108 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08d6bf-5d46-4356-b50e-6a60b5b5cb2d admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:26.252157 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1384e3-773c-4c28-8c85-9a344c5ca16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:26.253451 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1384e3-773c-4c28-8c85-9a344c5ca16e admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:26.259542 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1384e3-773c-4c28-8c85-9a344c5ca16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:26.259742 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1384e3-773c-4c28-8c85-9a344c5ca16e admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:26.264906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1384e3-773c-4c28-8c85-9a344c5ca16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:26.266790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1384e3-773c-4c28-8c85-9a344c5ca16e admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:26.324212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbda00d-5ecd-49df-b91f-6f3c136bfad3 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:26.339246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbda00d-5ecd-49df-b91f-6f3c136bfad3 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:26.340167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 855/1704] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:26.356810 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974f4ab-e3b6-46ad-8141-69c86285900c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:26.358708 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974f4ab-e3b6-46ad-8141-69c86285900c admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:26.362238 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974f4ab-e3b6-46ad-8141-69c86285900c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:26.362238 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974f4ab-e3b6-46ad-8141-69c86285900c admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:26.362238 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974f4ab-e3b6-46ad-8141-69c86285900c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:26.374368 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974f4ab-e3b6-46ad-8141-69c86285900c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:26.414921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 850/1705] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:26.416025 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1384e3-773c-4c28-8c85-9a344c5ca16e admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:26.448369 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1384e3-773c-4c28-8c85-9a344c5ca16e admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:26.466341 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b02ba1-4338-408d-a705-3ed1f4868623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:26.466341 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b02ba1-4338-408d-a705-3ed1f4868623 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:26.466341 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b02ba1-4338-408d-a705-3ed1f4868623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:26.466341 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b02ba1-4338-408d-a705-3ed1f4868623 admin admin] PATH_INFO: `/v3/projects/94d710cd95234003a26a3256774dd7c3/users/9e18dd3c031b4d5f8335556d381934c4/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:26.525243 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b02ba1-4338-408d-a705-3ed1f4868623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d710cd95234003a26a3256774dd7c3, user_id=9e18dd3c031b4d5f8335556d381934c4, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:26.532016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b02ba1-4338-408d-a705-3ed1f4868623 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:26.629314 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 856/1706] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:26 2022] PUT /identity/v3/projects/94d710cd95234003a26a3256774dd7c3/users/9e18dd3c031b4d5f8335556d381934c4/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:26.646165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae857708-77fe-4459-9ad5-79f225e97e4c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:26.647312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae857708-77fe-4459-9ad5-79f225e97e4c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:26.649394 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae857708-77fe-4459-9ad5-79f225e97e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:26.734402 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-ae857708-77fe-4459-9ad5-79f225e97e4c None None] MFA Rules not processed for user `9e18dd3c031b4d5f8335556d381934c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:26.736879 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ae857708-77fe-4459-9ad5-79f225e97e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:26.972968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 851/1707] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:26.975867 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b02ba1-4338-408d-a705-3ed1f4868623 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:26.992608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1160524-67f8-426c-8b21-7b9f6ad77fa1 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:26.993271 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1160524-67f8-426c-8b21-7b9f6ad77fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:26.999045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1160524-67f8-426c-8b21-7b9f6ad77fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:27.056147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b1160524-67f8-426c-8b21-7b9f6ad77fa1 None None] MFA Rules not processed for user `2fa7da0ccf954be1a582411cdc617b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:27.063368 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b1160524-67f8-426c-8b21-7b9f6ad77fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:27.238201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 852/1708] 10.222.0.23 () {58 vars in 1015 bytes} [Tue May 10 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:20:27.357773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b02ba1-4338-408d-a705-3ed1f4868623 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:27.389285 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba82e41-8157-494d-9cf0-d97f84c2451a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:27.389979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba82e41-8157-494d-9cf0-d97f84c2451a admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:27.390271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba82e41-8157-494d-9cf0-d97f84c2451a admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:27.390556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba82e41-8157-494d-9cf0-d97f84c2451a admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:27.413838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba82e41-8157-494d-9cf0-d97f84c2451a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:27.420946 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba82e41-8157-494d-9cf0-d97f84c2451a admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:27.628625 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 857/1709] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:26 2022] POST /identity/v3/projects => generated 373 bytes in 654 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:27.634247 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1160524-67f8-426c-8b21-7b9f6ad77fa1 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:27.651545 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1160524-67f8-426c-8b21-7b9f6ad77fa1 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:27.888523 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe483406-2c4a-4a0d-903a-4fec54622e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:27.898199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe483406-2c4a-4a0d-903a-4fec54622e6d admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:27.898521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe483406-2c4a-4a0d-903a-4fec54622e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:27.898809 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe483406-2c4a-4a0d-903a-4fec54622e6d admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:27.899557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe483406-2c4a-4a0d-903a-4fec54622e6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:27.901661 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba82e41-8157-494d-9cf0-d97f84c2451a admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:27.903822 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-3ba82e41-8157-494d-9cf0-d97f84c2451a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:27.908520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe483406-2c4a-4a0d-903a-4fec54622e6d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:28.016650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 853/1710] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:27 2022] POST /identity/v3/users => generated 293 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:28.021193 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe483406-2c4a-4a0d-903a-4fec54622e6d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:28.071734 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe483406-2c4a-4a0d-903a-4fec54622e6d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:28.083031 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba82e41-8157-494d-9cf0-d97f84c2451a admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:28.090796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6c040-3201-4f78-8fcb-b27b5b09bd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:28.092175 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6c040-3201-4f78-8fcb-b27b5b09bd8a admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:28.093502 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6c040-3201-4f78-8fcb-b27b5b09bd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:28.094129 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc5fb6-6227-4114-9223-9b1c0a5f7a50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:28.094955 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc5fb6-6227-4114-9223-9b1c0a5f7a50 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:28.095250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6c040-3201-4f78-8fcb-b27b5b09bd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:28.095461 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc5fb6-6227-4114-9223-9b1c0a5f7a50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:28.095839 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc5fb6-6227-4114-9223-9b1c0a5f7a50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:28.097829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6c040-3201-4f78-8fcb-b27b5b09bd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:28.097953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-54bc5fb6-6227-4114-9223-9b1c0a5f7a50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:28.104211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6c040-3201-4f78-8fcb-b27b5b09bd8a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:28.159026 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 854/1711] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:28.162166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6c040-3201-4f78-8fcb-b27b5b09bd8a admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:28.210361 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6c040-3201-4f78-8fcb-b27b5b09bd8a admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:28.235235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d764db-ed36-4bfc-a2f0-7ec5f22dfeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:28.235235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d764db-ed36-4bfc-a2f0-7ec5f22dfeac admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:28.235235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d764db-ed36-4bfc-a2f0-7ec5f22dfeac admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:28.235235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d764db-ed36-4bfc-a2f0-7ec5f22dfeac admin admin] PATH_INFO: `/v3/projects/da17da253878456f92ebc41d364a1320/users/d5f72671892f4621aa488fdb6b3ae7c7/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:28.303476 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc5fb6-6227-4114-9223-9b1c0a5f7a50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:28.305277 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc5fb6-6227-4114-9223-9b1c0a5f7a50 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:28.306292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d764db-ed36-4bfc-a2f0-7ec5f22dfeac admin admin] RBAC: Authorizing `identity:create_grant(project_id=da17da253878456f92ebc41d364a1320, user_id=d5f72671892f4621aa488fdb6b3ae7c7, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:28.309041 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d764db-ed36-4bfc-a2f0-7ec5f22dfeac admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:28.330718 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 858/1712] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:20:28.331895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc5fb6-6227-4114-9223-9b1c0a5f7a50 service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:28.336244 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-54bc5fb6-6227-4114-9223-9b1c0a5f7a50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:28.385063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 855/1713] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:28 2022] PUT /identity/v3/projects/da17da253878456f92ebc41d364a1320/users/d5f72671892f4621aa488fdb6b3ae7c7/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:28.388739 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625f717-1c7b-4ecb-a622-85520245b0b5 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:28.389195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625f717-1c7b-4ecb-a622-85520245b0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:28.389639 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625f717-1c7b-4ecb-a622-85520245b0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:28.479414 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-1625f717-1c7b-4ecb-a622-85520245b0b5 None None] MFA Rules not processed for user `ca39678abe6e476283f94c675d4ea369`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:28.480665 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1625f717-1c7b-4ecb-a622-85520245b0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:28.539216 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc5fb6-6227-4114-9223-9b1c0a5f7a50 service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:28.744362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 856/1714] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:28.752672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625f717-1c7b-4ecb-a622-85520245b0b5 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:28.799076 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8b2af-1c7c-4e3c-a66e-063f7a851cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:28.803996 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8b2af-1c7c-4e3c-a66e-063f7a851cfc service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:28.804340 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8b2af-1c7c-4e3c-a66e-063f7a851cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:28.804628 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8b2af-1c7c-4e3c-a66e-063f7a851cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:28.854510 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8b2af-1c7c-4e3c-a66e-063f7a851cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:28.854510 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8b2af-1c7c-4e3c-a66e-063f7a851cfc service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:28.906553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 859/1715] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:28.907569 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8b2af-1c7c-4e3c-a66e-063f7a851cfc service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:28.914374 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-01d8b2af-1c7c-4e3c-a66e-063f7a851cfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:28.998957 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625f717-1c7b-4ecb-a622-85520245b0b5 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:29.018990 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07fafd-013d-483c-8047-ff78bafe10d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:29.019753 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07fafd-013d-483c-8047-ff78bafe10d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:29.020852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07fafd-013d-483c-8047-ff78bafe10d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:29.021148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07fafd-013d-483c-8047-ff78bafe10d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:29.030099 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07fafd-013d-483c-8047-ff78bafe10d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:29.032215 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07fafd-013d-483c-8047-ff78bafe10d9 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:29.081577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 857/1716] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:29.090169 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07fafd-013d-483c-8047-ff78bafe10d9 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:29.117498 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07fafd-013d-483c-8047-ff78bafe10d9 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:29.133887 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040e987-f612-4c5a-b46c-8ea55b2a3bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:29.136154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040e987-f612-4c5a-b46c-8ea55b2a3bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:29.137632 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040e987-f612-4c5a-b46c-8ea55b2a3bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:29.139155 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040e987-f612-4c5a-b46c-8ea55b2a3bcc admin admin] PATH_INFO: `/v3/projects/da17da253878456f92ebc41d364a1320/users/d5f72671892f4621aa488fdb6b3ae7c7/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:29.143575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040e987-f612-4c5a-b46c-8ea55b2a3bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=da17da253878456f92ebc41d364a1320, user_id=d5f72671892f4621aa488fdb6b3ae7c7, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:29.152622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040e987-f612-4c5a-b46c-8ea55b2a3bcc admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:29.188432 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8b2af-1c7c-4e3c-a66e-063f7a851cfc service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:29.192113 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 858/1717] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:29 2022] PUT /identity/v3/projects/da17da253878456f92ebc41d364a1320/users/d5f72671892f4621aa488fdb6b3ae7c7/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:29.205185 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd25819-8ab3-419c-beb0-278b827dd38f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:29.205456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd25819-8ab3-419c-beb0-278b827dd38f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:29.205735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd25819-8ab3-419c-beb0-278b827dd38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:29.318807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2dd25819-8ab3-419c-beb0-278b827dd38f None None] MFA Rules not processed for user `d5f72671892f4621aa488fdb6b3ae7c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:29.325194 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2dd25819-8ab3-419c-beb0-278b827dd38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:29.522808 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3ddfa-7cad-4343-b43b-7e07b55c29cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:29.526851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3ddfa-7cad-4343-b43b-7e07b55c29cd service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:29.527213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3ddfa-7cad-4343-b43b-7e07b55c29cd service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:29.527981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3ddfa-7cad-4343-b43b-7e07b55c29cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:29.663542 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 859/1718] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:29.674488 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd25819-8ab3-419c-beb0-278b827dd38f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:29.675928 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2dd25819-8ab3-419c-beb0-278b827dd38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:29.800750 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3ddfa-7cad-4343-b43b-7e07b55c29cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:29.807625 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3ddfa-7cad-4343-b43b-7e07b55c29cd service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:29.846930 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 860/1719] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 940 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:29.975621 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd25819-8ab3-419c-beb0-278b827dd38f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:30.002330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13571c99-19ff-4df5-b199-00830c00e457 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:30.005328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13571c99-19ff-4df5-b199-00830c00e457 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:30.006533 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13571c99-19ff-4df5-b199-00830c00e457 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:30.007189 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13571c99-19ff-4df5-b199-00830c00e457 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:30.031293 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13571c99-19ff-4df5-b199-00830c00e457 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:30.033882 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13571c99-19ff-4df5-b199-00830c00e457 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:30.092488 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 860/1720] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:30.357744 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3193c-e923-4fdc-b89e-2afe34d30121 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:30.358356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3193c-e923-4fdc-b89e-2afe34d30121 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:30.358923 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3193c-e923-4fdc-b89e-2afe34d30121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:30.427626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-66c3193c-e923-4fdc-b89e-2afe34d30121 None None] MFA Rules not processed for user `02af0eded57547f489be63cd6dc09399`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:30.430547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-66c3193c-e923-4fdc-b89e-2afe34d30121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:30.619739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 861/1721] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:30.633255 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c150b-0c50-41f0-9d82-fd670656ca13 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:30.633954 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c150b-0c50-41f0-9d82-fd670656ca13 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:30.634512 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c150b-0c50-41f0-9d82-fd670656ca13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:30.684272 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d90c150b-0c50-41f0-9d82-fd670656ca13 None None] MFA Rules not processed for user `02af0eded57547f489be63cd6dc09399`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:30.698825 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d90c150b-0c50-41f0-9d82-fd670656ca13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:30.754760 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 861/1722] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:30.782654 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3193c-e923-4fdc-b89e-2afe34d30121 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:30.807856 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3193c-e923-4fdc-b89e-2afe34d30121 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:30.838978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed88707-fb4b-4360-a6ed-fddfe56f2e6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:30.838978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed88707-fb4b-4360-a6ed-fddfe56f2e6b service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:30.838978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed88707-fb4b-4360-a6ed-fddfe56f2e6b service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:30.838978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed88707-fb4b-4360-a6ed-fddfe56f2e6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:30.892434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed88707-fb4b-4360-a6ed-fddfe56f2e6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:30.924567 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed88707-fb4b-4360-a6ed-fddfe56f2e6b service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:31.033946 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 862/1723] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:31.480938 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63850f-42ea-4111-b46a-f346c956ccdd None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:31.481898 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63850f-42ea-4111-b46a-f346c956ccdd None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:31.482399 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63850f-42ea-4111-b46a-f346c956ccdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:31.547246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-fe63850f-42ea-4111-b46a-f346c956ccdd None None] MFA Rules not processed for user `d2267b0c3311480eb8d1f54df5296c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:31.555966 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fe63850f-42ea-4111-b46a-f346c956ccdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:31.632664 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed88707-fb4b-4360-a6ed-fddfe56f2e6b service nova] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:31.828513 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed88707-fb4b-4360-a6ed-fddfe56f2e6b service nova] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:31.830049 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 862/1724] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:31.848661 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df347dc7-d57a-46dc-b2ab-95241bf4699c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:31.852312 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df347dc7-d57a-46dc-b2ab-95241bf4699c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:31.852823 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df347dc7-d57a-46dc-b2ab-95241bf4699c admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:31.853864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df347dc7-d57a-46dc-b2ab-95241bf4699c admin admin] PATH_INFO: `/v3/users/9e18dd3c031b4d5f8335556d381934c4` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:31.858418 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63850f-42ea-4111-b46a-f346c956ccdd None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:31.860151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df347dc7-d57a-46dc-b2ab-95241bf4699c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e18dd3c031b4d5f8335556d381934c4)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:31.860274 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fe63850f-42ea-4111-b46a-f346c956ccdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:31.864266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df347dc7-d57a-46dc-b2ab-95241bf4699c admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:31.907128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63850f-42ea-4111-b46a-f346c956ccdd None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:31.927478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9424c1-10d4-48d4-81b5-99c9b72e68da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:31.930002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9424c1-10d4-48d4-81b5-99c9b72e68da service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:31.930450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9424c1-10d4-48d4-81b5-99c9b72e68da service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:31.932070 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9424c1-10d4-48d4-81b5-99c9b72e68da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:31.955004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9424c1-10d4-48d4-81b5-99c9b72e68da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:31.957004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9424c1-10d4-48d4-81b5-99c9b72e68da service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:31.972487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 863/1725] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:20:32.223747 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-df347dc7-d57a-46dc-b2ab-95241bf4699c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e18dd3c031b4d5f8335556d381934c4'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:32.230708 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-df347dc7-d57a-46dc-b2ab-95241bf4699c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e18dd3c031b4d5f8335556d381934c4'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:32.304038 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-df347dc7-d57a-46dc-b2ab-95241bf4699c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e18dd3c031b4d5f8335556d381934c4'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:32.304038 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-df347dc7-d57a-46dc-b2ab-95241bf4699c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e18dd3c031b4d5f8335556d381934c4'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:32.327986 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-df347dc7-d57a-46dc-b2ab-95241bf4699c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e18dd3c031b4d5f8335556d381934c4'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:32.421755 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 863/1726] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:20:31 2022] DELETE /identity/v3/users/9e18dd3c031b4d5f8335556d381934c4 => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:32.426772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e66d8-23d9-4ae7-8751-b90af1a8968a None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:32.427290 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e66d8-23d9-4ae7-8751-b90af1a8968a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:32.428441 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e66d8-23d9-4ae7-8751-b90af1a8968a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:32.477209 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2c9e66d8-23d9-4ae7-8751-b90af1a8968a None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:32.482326 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2c9e66d8-23d9-4ae7-8751-b90af1a8968a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:32.691958 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 864/1727] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:32.755247 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df347dc7-d57a-46dc-b2ab-95241bf4699c admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:32.757782 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-df347dc7-d57a-46dc-b2ab-95241bf4699c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:32.961368 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df347dc7-d57a-46dc-b2ab-95241bf4699c admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:32.986723 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbf235-330d-4727-86b5-21a473ab753c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:32.987418 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbf235-330d-4727-86b5-21a473ab753c service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:32.987658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbf235-330d-4727-86b5-21a473ab753c service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:32.993374 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbf235-330d-4727-86b5-21a473ab753c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:33.031106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbf235-330d-4727-86b5-21a473ab753c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:33.038515 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbf235-330d-4727-86b5-21a473ab753c service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:33.094339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 864/1728] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:34.006748 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3257d-a31f-47ad-8935-7c4b1fb7721f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:34.007633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3257d-a31f-47ad-8935-7c4b1fb7721f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:34.008075 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3257d-a31f-47ad-8935-7c4b1fb7721f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:34.059349 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-55b3257d-a31f-47ad-8935-7c4b1fb7721f None None] MFA Rules not processed for user `02af0eded57547f489be63cd6dc09399`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:34.064347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-55b3257d-a31f-47ad-8935-7c4b1fb7721f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:34.278255 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 865/1729] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:34.734779 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1b6a4-4897-465b-8b77-47719d088d9f None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:34.735378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1b6a4-4897-465b-8b77-47719d088d9f None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:34.736029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1b6a4-4897-465b-8b77-47719d088d9f None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:34.743112 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 865/1730] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 10 21:20:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:20:34.959547 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5fe18-2c35-4874-a677-89c41178f7b2 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:34.959837 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5fe18-2c35-4874-a677-89c41178f7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:34.960207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5fe18-2c35-4874-a677-89c41178f7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:34.995395 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-bef5fe18-2c35-4874-a677-89c41178f7b2 None None] MFA Rules not processed for user `c4c16a3b07c64a22bfc3df2a5a90c3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:35.003709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-bef5fe18-2c35-4874-a677-89c41178f7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:35.147676 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 866/1731] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 10 21:20:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:20:35.521921 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1b6a4-4897-465b-8b77-47719d088d9f None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:35.525235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-73a1b6a4-4897-465b-8b77-47719d088d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:35.566967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1b6a4-4897-465b-8b77-47719d088d9f None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:35.581433 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c106f-87c4-4e1a-a2a2-68d8441bc1e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:35.582582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c106f-87c4-4e1a-a2a2-68d8441bc1e8 service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:35.583019 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c106f-87c4-4e1a-a2a2-68d8441bc1e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:35.583478 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c106f-87c4-4e1a-a2a2-68d8441bc1e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:35.607654 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c106f-87c4-4e1a-a2a2-68d8441bc1e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:35.608307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c106f-87c4-4e1a-a2a2-68d8441bc1e8 service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:35.652142 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 866/1732] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:36.052068 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf2dd9-697a-4d6c-8fc8-e5be4b17d1f5 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:36.052068 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf2dd9-697a-4d6c-8fc8-e5be4b17d1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:36.052068 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf2dd9-697a-4d6c-8fc8-e5be4b17d1f5 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:36.052068 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 867/1733] 10.222.0.25 () {54 vars in 912 bytes} [Tue May 10 21:20:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:20:36.090262 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc72ccf-694a-4b74-a869-2977bbb092dc None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:36.091466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc72ccf-694a-4b74-a869-2977bbb092dc None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:36.092262 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc72ccf-694a-4b74-a869-2977bbb092dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:36.110196 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf2dd9-697a-4d6c-8fc8-e5be4b17d1f5 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:36.112372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-dbbf2dd9-697a-4d6c-8fc8-e5be4b17d1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:36.174926 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf2dd9-697a-4d6c-8fc8-e5be4b17d1f5 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:36.181979 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043acb8-2f54-4aaf-8640-cdeb5379d9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:36.183121 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043acb8-2f54-4aaf-8640-cdeb5379d9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:36.183549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043acb8-2f54-4aaf-8640-cdeb5379d9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:36.184018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043acb8-2f54-4aaf-8640-cdeb5379d9d1 admin admin] PATH_INFO: `/v3/projects/94d710cd95234003a26a3256774dd7c3` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:36.186263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043acb8-2f54-4aaf-8640-cdeb5379d9d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d710cd95234003a26a3256774dd7c3)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:36.191067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043acb8-2f54-4aaf-8640-cdeb5379d9d1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:36.237217 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-0cc72ccf-694a-4b74-a869-2977bbb092dc None None] MFA Rules not processed for user `2fa7da0ccf954be1a582411cdc617b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:36.244612 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-0cc72ccf-694a-4b74-a869-2977bbb092dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:36.260128 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 867/1734] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 10 21:20:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:20:36.281290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc72ccf-694a-4b74-a869-2977bbb092dc None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:36.283380 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-0cc72ccf-694a-4b74-a869-2977bbb092dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:36.371705 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc72ccf-694a-4b74-a869-2977bbb092dc None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:36.383563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e48c8-1a6a-4422-a94b-726bcf812e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:36.384926 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e48c8-1a6a-4422-a94b-726bcf812e30 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:36.385347 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e48c8-1a6a-4422-a94b-726bcf812e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:36.385761 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e48c8-1a6a-4422-a94b-726bcf812e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:36.397720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e48c8-1a6a-4422-a94b-726bcf812e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:36.399423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e48c8-1a6a-4422-a94b-726bcf812e30 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:36.410727 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 868/1735] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:20:36.507013 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1043acb8-2f54-4aaf-8640-cdeb5379d9d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d710cd95234003a26a3256774dd7c3', 'request_id': 'req-1043acb8-2f54-4aaf-8640-cdeb5379d9d1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:36.603080 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1043acb8-2f54-4aaf-8640-cdeb5379d9d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d710cd95234003a26a3256774dd7c3', 'request_id': 'req-1043acb8-2f54-4aaf-8640-cdeb5379d9d1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:36.626520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1043acb8-2f54-4aaf-8640-cdeb5379d9d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d710cd95234003a26a3256774dd7c3', 'request_id': 'req-1043acb8-2f54-4aaf-8640-cdeb5379d9d1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:36.670482 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1043acb8-2f54-4aaf-8640-cdeb5379d9d1 admin admin] The token cache is being invalidate because project 94d710cd95234003a26a3256774dd7c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:20:36.670818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1043acb8-2f54-4aaf-8640-cdeb5379d9d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:36.676818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1043acb8-2f54-4aaf-8640-cdeb5379d9d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:36.684157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 868/1736] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:20:36 2022] DELETE /identity/v3/projects/94d710cd95234003a26a3256774dd7c3 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:20:36.690552 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e48c8-1a6a-4422-a94b-726bcf812e30 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:36.732865 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e48c8-1a6a-4422-a94b-726bcf812e30 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:36.959750 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2489a-6ecd-494a-bb7d-355773c9a827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:36.961505 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2489a-6ecd-494a-bb7d-355773c9a827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:36.963918 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2489a-6ecd-494a-bb7d-355773c9a827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:36.964145 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2489a-6ecd-494a-bb7d-355773c9a827 admin admin] PATH_INFO: `/v3/users/d5f72671892f4621aa488fdb6b3ae7c7` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:36.966129 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2489a-6ecd-494a-bb7d-355773c9a827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5f72671892f4621aa488fdb6b3ae7c7)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:36.969094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2489a-6ecd-494a-bb7d-355773c9a827 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:37.073580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2450b6f-f95d-4c3d-83d8-333a784e25c9 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:37.074227 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2450b6f-f95d-4c3d-83d8-333a784e25c9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:37.074734 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2450b6f-f95d-4c3d-83d8-333a784e25c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:37.137474 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f2450b6f-f95d-4c3d-83d8-333a784e25c9 None None] MFA Rules not processed for user `05eb9dfc751a4b44a8d4d7a03138f0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:37.142990 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f2450b6f-f95d-4c3d-83d8-333a784e25c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:37.273409 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c7e2489a-6ecd-494a-bb7d-355773c9a827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5f72671892f4621aa488fdb6b3ae7c7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:37.274979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c7e2489a-6ecd-494a-bb7d-355773c9a827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5f72671892f4621aa488fdb6b3ae7c7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:37.343134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 869/1737] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:20:37.392122 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c7e2489a-6ecd-494a-bb7d-355773c9a827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5f72671892f4621aa488fdb6b3ae7c7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:37.394942 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c7e2489a-6ecd-494a-bb7d-355773c9a827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5f72671892f4621aa488fdb6b3ae7c7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:37.428543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c7e2489a-6ecd-494a-bb7d-355773c9a827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5f72671892f4621aa488fdb6b3ae7c7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:37.530651 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 869/1738] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:20:36 2022] DELETE /identity/v3/users/d5f72671892f4621aa488fdb6b3ae7c7 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:38.285794 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2450b6f-f95d-4c3d-83d8-333a784e25c9 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:38.288331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f2450b6f-f95d-4c3d-83d8-333a784e25c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:38.319887 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2450b6f-f95d-4c3d-83d8-333a784e25c9 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:38.433090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55762cfe-f7f7-4627-a79b-385f58de0649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:38.434367 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55762cfe-f7f7-4627-a79b-385f58de0649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:38.434367 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55762cfe-f7f7-4627-a79b-385f58de0649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:38.434834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55762cfe-f7f7-4627-a79b-385f58de0649 admin admin] PATH_INFO: `/v3/projects/da17da253878456f92ebc41d364a1320` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:38.437882 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55762cfe-f7f7-4627-a79b-385f58de0649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da17da253878456f92ebc41d364a1320)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:38.439937 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55762cfe-f7f7-4627-a79b-385f58de0649 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:38.567351 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-55762cfe-f7f7-4627-a79b-385f58de0649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da17da253878456f92ebc41d364a1320', 'request_id': 'req-55762cfe-f7f7-4627-a79b-385f58de0649'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:38.665303 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-55762cfe-f7f7-4627-a79b-385f58de0649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da17da253878456f92ebc41d364a1320', 'request_id': 'req-55762cfe-f7f7-4627-a79b-385f58de0649'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:38.672743 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-55762cfe-f7f7-4627-a79b-385f58de0649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da17da253878456f92ebc41d364a1320', 'request_id': 'req-55762cfe-f7f7-4627-a79b-385f58de0649'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:38.700255 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-55762cfe-f7f7-4627-a79b-385f58de0649 admin admin] The token cache is being invalidate because project da17da253878456f92ebc41d364a1320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:20:38.700799 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-55762cfe-f7f7-4627-a79b-385f58de0649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:38.706945 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-55762cfe-f7f7-4627-a79b-385f58de0649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:38.712938 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 870/1739] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:20:38 2022] DELETE /identity/v3/projects/da17da253878456f92ebc41d364a1320 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:38.714930 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547fcb1-1495-4058-a00c-0f3802cdceeb None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:38.715430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547fcb1-1495-4058-a00c-0f3802cdceeb None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:38.715530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547fcb1-1495-4058-a00c-0f3802cdceeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:38.757828 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-0547fcb1-1495-4058-a00c-0f3802cdceeb None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:38.763426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-0547fcb1-1495-4058-a00c-0f3802cdceeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:38.913148 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 870/1740] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:38.914597 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0c51a-bad6-4072-8d47-e26350425dd2 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:38.915335 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0c51a-bad6-4072-8d47-e26350425dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:38.915807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0c51a-bad6-4072-8d47-e26350425dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:38.958131 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-75c0c51a-bad6-4072-8d47-e26350425dd2 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:38.959622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-75c0c51a-bad6-4072-8d47-e26350425dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:38.969568 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 871/1741] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:38.973434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547fcb1-1495-4058-a00c-0f3802cdceeb None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:38.991939 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547fcb1-1495-4058-a00c-0f3802cdceeb None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:38.998637 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb1672-03d8-49eb-af96-028db8874a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:38.999614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb1672-03d8-49eb-af96-028db8874a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:38.999997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb1672-03d8-49eb-af96-028db8874a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:39.000369 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb1672-03d8-49eb-af96-028db8874a43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:39.002007 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb1672-03d8-49eb-af96-028db8874a43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:20:39.002415 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb1672-03d8-49eb-af96-028db8874a43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:39.004173 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb1672-03d8-49eb-af96-028db8874a43 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:39.026484 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 871/1742] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:20:39.030710 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0c51a-bad6-4072-8d47-e26350425dd2 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:39.045243 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0c51a-bad6-4072-8d47-e26350425dd2 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:39.054189 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9882a2-e81f-405f-ba54-3618fec1cba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:39.055308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9882a2-e81f-405f-ba54-3618fec1cba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:39.060910 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9882a2-e81f-405f-ba54-3618fec1cba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:39.060910 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9882a2-e81f-405f-ba54-3618fec1cba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:39.060910 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9882a2-e81f-405f-ba54-3618fec1cba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:39.060910 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9882a2-e81f-405f-ba54-3618fec1cba8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:39.185955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 872/1743] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:39 2022] POST /identity/v3/projects => generated 365 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:39.190324 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb1672-03d8-49eb-af96-028db8874a43 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:39.206091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb1672-03d8-49eb-af96-028db8874a43 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:39.364385 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb7a46-d463-4cfb-81c7-3d0a8f9691db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:39.367584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb7a46-d463-4cfb-81c7-3d0a8f9691db admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:39.368057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb7a46-d463-4cfb-81c7-3d0a8f9691db admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:39.368508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb7a46-d463-4cfb-81c7-3d0a8f9691db admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:39.370649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb7a46-d463-4cfb-81c7-3d0a8f9691db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:39.372890 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb7a46-d463-4cfb-81c7-3d0a8f9691db admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:39.476755 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 872/1744] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:39 2022] POST /identity/v3/users => generated 283 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:39.477782 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9882a2-e81f-405f-ba54-3618fec1cba8 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:39.492845 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9882a2-e81f-405f-ba54-3618fec1cba8 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:39.502761 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba557854-b2ca-467d-85bc-c029339d832b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:39.503560 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba557854-b2ca-467d-85bc-c029339d832b admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:39.503941 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba557854-b2ca-467d-85bc-c029339d832b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:39.504306 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba557854-b2ca-467d-85bc-c029339d832b admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:39.506053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba557854-b2ca-467d-85bc-c029339d832b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:39.509354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba557854-b2ca-467d-85bc-c029339d832b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:39.526355 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 873/1745] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:39.532788 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb7a46-d463-4cfb-81c7-3d0a8f9691db admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:39.549733 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb7a46-d463-4cfb-81c7-3d0a8f9691db admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:39.556554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a827cb-bd08-4b21-8e12-eaabf5170767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:39.558639 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a827cb-bd08-4b21-8e12-eaabf5170767 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:39.559027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a827cb-bd08-4b21-8e12-eaabf5170767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:39.559383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a827cb-bd08-4b21-8e12-eaabf5170767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:39.560435 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a827cb-bd08-4b21-8e12-eaabf5170767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:39.563517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a827cb-bd08-4b21-8e12-eaabf5170767 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:39.580883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 873/1746] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:39.587826 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba557854-b2ca-467d-85bc-c029339d832b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:39.599398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba557854-b2ca-467d-85bc-c029339d832b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:39.605561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f2723-a337-43ba-968e-05ab8cd57768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:39.606654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f2723-a337-43ba-968e-05ab8cd57768 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:39.606937 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f2723-a337-43ba-968e-05ab8cd57768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:39.607375 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f2723-a337-43ba-968e-05ab8cd57768 admin admin] PATH_INFO: `/v3/projects/4f75f7e5518943eca961b79fb32a416a/users/7aa35b79637847f381e92516c9daaaf3/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:39.619851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff8d73-a040-4f16-8ab9-1bfa520c8583 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:39.620201 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff8d73-a040-4f16-8ab9-1bfa520c8583 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:39.620558 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff8d73-a040-4f16-8ab9-1bfa520c8583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:39.624883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f2723-a337-43ba-968e-05ab8cd57768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f75f7e5518943eca961b79fb32a416a, user_id=7aa35b79637847f381e92516c9daaaf3, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:39.627957 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f2723-a337-43ba-968e-05ab8cd57768 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:39.647585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-dcff8d73-a040-4f16-8ab9-1bfa520c8583 None None] MFA Rules not processed for user `ca39678abe6e476283f94c675d4ea369`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:39.648821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-dcff8d73-a040-4f16-8ab9-1bfa520c8583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:39.709184 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 874/1747] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:39 2022] PUT /identity/v3/projects/4f75f7e5518943eca961b79fb32a416a/users/7aa35b79637847f381e92516c9daaaf3/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:39.718964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b835f-342f-4819-a98a-d36651e01225 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:39.719715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b835f-342f-4819-a98a-d36651e01225 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:39.720180 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b835f-342f-4819-a98a-d36651e01225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:39.759148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a60b835f-342f-4819-a98a-d36651e01225 None None] MFA Rules not processed for user `7aa35b79637847f381e92516c9daaaf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:39.780527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 874/1748] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:20:39.797294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a60b835f-342f-4819-a98a-d36651e01225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:40.031679 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77f203-0d15-4690-92ca-8785628977e5 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:40.032242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77f203-0d15-4690-92ca-8785628977e5 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:40.032700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77f203-0d15-4690-92ca-8785628977e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:40.057612 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 875/1749] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:20:40.090784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b835f-342f-4819-a98a-d36651e01225 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:40.116735 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-5f77f203-0d15-4690-92ca-8785628977e5 None None] MFA Rules not processed for user `d2267b0c3311480eb8d1f54df5296c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:40.118827 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-5f77f203-0d15-4690-92ca-8785628977e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:40.241152 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 875/1750] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:40.271544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b835f-342f-4819-a98a-d36651e01225 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:40.286086 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361c902-6fa7-4095-89f8-d20669cf52c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:40.286965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361c902-6fa7-4095-89f8-d20669cf52c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:40.287542 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361c902-6fa7-4095-89f8-d20669cf52c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:40.287726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361c902-6fa7-4095-89f8-d20669cf52c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:40.288569 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361c902-6fa7-4095-89f8-d20669cf52c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:40.290648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361c902-6fa7-4095-89f8-d20669cf52c1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:40.400811 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 876/1751] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:40 2022] POST /identity/v3/projects => generated 365 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:40.404753 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77f203-0d15-4690-92ca-8785628977e5 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:40.427842 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77f203-0d15-4690-92ca-8785628977e5 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:40.620792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d0e1b-70a6-46ed-bda1-dab2b01d9c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:40.621540 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d0e1b-70a6-46ed-bda1-dab2b01d9c21 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:40.621826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d0e1b-70a6-46ed-bda1-dab2b01d9c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:40.622138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d0e1b-70a6-46ed-bda1-dab2b01d9c21 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:40.623220 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d0e1b-70a6-46ed-bda1-dab2b01d9c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:40.626732 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d0e1b-70a6-46ed-bda1-dab2b01d9c21 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:40.784095 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 876/1752] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:40 2022] POST /identity/v3/users => generated 289 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:40.788109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361c902-6fa7-4095-89f8-d20669cf52c1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:40.804187 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361c902-6fa7-4095-89f8-d20669cf52c1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:40.815135 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93740a-2b05-48c6-966a-cd44c87c99e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:40.817480 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93740a-2b05-48c6-966a-cd44c87c99e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:40.817480 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93740a-2b05-48c6-966a-cd44c87c99e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:40.817480 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93740a-2b05-48c6-966a-cd44c87c99e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:40.817480 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93740a-2b05-48c6-966a-cd44c87c99e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:40.821908 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93740a-2b05-48c6-966a-cd44c87c99e1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:40.956391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d0e1b-70a6-46ed-bda1-dab2b01d9c21 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:40.958124 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 877/1753] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:40.958453 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d0e1b-70a6-46ed-bda1-dab2b01d9c21 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:40.958453 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77defe72-00b4-4a8c-a8f6-5593a40bac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:40.958453 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77defe72-00b4-4a8c-a8f6-5593a40bac7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:40.958453 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77defe72-00b4-4a8c-a8f6-5593a40bac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:40.958971 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77defe72-00b4-4a8c-a8f6-5593a40bac7e admin admin] PATH_INFO: `/v3/projects/ff461cf3055847379b0e794118fb5a20/users/e6ee73304fa74315834c4bfda57a5371/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:40.997414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77defe72-00b4-4a8c-a8f6-5593a40bac7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff461cf3055847379b0e794118fb5a20, user_id=e6ee73304fa74315834c4bfda57a5371, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:41.002399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77defe72-00b4-4a8c-a8f6-5593a40bac7e admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:41.113519 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 877/1754] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:40 2022] PUT /identity/v3/projects/ff461cf3055847379b0e794118fb5a20/users/e6ee73304fa74315834c4bfda57a5371/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:20:41.118762 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93740a-2b05-48c6-966a-cd44c87c99e1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:41.129444 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93740a-2b05-48c6-966a-cd44c87c99e1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:41.312759 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecebb44-5476-4f93-91e2-1eb7c02a1bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:41.313444 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecebb44-5476-4f93-91e2-1eb7c02a1bfc admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:41.313909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecebb44-5476-4f93-91e2-1eb7c02a1bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:41.314352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecebb44-5476-4f93-91e2-1eb7c02a1bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:41.315404 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecebb44-5476-4f93-91e2-1eb7c02a1bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:41.317173 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecebb44-5476-4f93-91e2-1eb7c02a1bfc admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:41.368017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77defe72-00b4-4a8c-a8f6-5593a40bac7e admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:41.388061 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 878/1755] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:41.399483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77defe72-00b4-4a8c-a8f6-5593a40bac7e admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:41.440076 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292db14c-06ca-4138-84ab-7b805735891a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:41.456219 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292db14c-06ca-4138-84ab-7b805735891a admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:41.456530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292db14c-06ca-4138-84ab-7b805735891a admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:41.459399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292db14c-06ca-4138-84ab-7b805735891a admin admin] PATH_INFO: `/v3/projects/ff461cf3055847379b0e794118fb5a20/users/e6ee73304fa74315834c4bfda57a5371/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:41.480468 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292db14c-06ca-4138-84ab-7b805735891a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff461cf3055847379b0e794118fb5a20, user_id=e6ee73304fa74315834c4bfda57a5371, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:41.503568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292db14c-06ca-4138-84ab-7b805735891a admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:41.567238 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 878/1756] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:41 2022] PUT /identity/v3/projects/ff461cf3055847379b0e794118fb5a20/users/e6ee73304fa74315834c4bfda57a5371/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:41.570012 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad9d5a-7680-42f7-b0fd-9bb38c98d96f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:41.573575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad9d5a-7680-42f7-b0fd-9bb38c98d96f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:41.573575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad9d5a-7680-42f7-b0fd-9bb38c98d96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:41.626596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a2ad9d5a-7680-42f7-b0fd-9bb38c98d96f None None] MFA Rules not processed for user `e6ee73304fa74315834c4bfda57a5371`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:41.627862 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a2ad9d5a-7680-42f7-b0fd-9bb38c98d96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:41.839167 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 879/1757] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:41.858645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292db14c-06ca-4138-84ab-7b805735891a admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:41.864138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-292db14c-06ca-4138-84ab-7b805735891a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:41.977672 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292db14c-06ca-4138-84ab-7b805735891a admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:42.062705 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61b23d-1244-4840-a80a-fd8c7105406e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:42.062705 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b23d-1244-4840-a80a-fd8c7105406e service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:42.062705 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b23d-1244-4840-a80a-fd8c7105406e service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:42.062705 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b23d-1244-4840-a80a-fd8c7105406e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:42.064878 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61b23d-1244-4840-a80a-fd8c7105406e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:42.064878 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61b23d-1244-4840-a80a-fd8c7105406e service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:42.064878 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 879/1758] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:41 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:43.431029 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad9d5a-7680-42f7-b0fd-9bb38c98d96f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:43.432944 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a2ad9d5a-7680-42f7-b0fd-9bb38c98d96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:43.537066 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad9d5a-7680-42f7-b0fd-9bb38c98d96f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:43.542769 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62874dc6-ea4c-4092-a93b-cd33af02bc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:43.543654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62874dc6-ea4c-4092-a93b-cd33af02bc9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:43.544039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62874dc6-ea4c-4092-a93b-cd33af02bc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:43.544487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62874dc6-ea4c-4092-a93b-cd33af02bc9d admin admin] PATH_INFO: `/v3/users/46054e2bf1504b3ab8dfc53ef22f1761` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:43.545784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62874dc6-ea4c-4092-a93b-cd33af02bc9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=46054e2bf1504b3ab8dfc53ef22f1761)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:43.550724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62874dc6-ea4c-4092-a93b-cd33af02bc9d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:43.757831 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-62874dc6-ea4c-4092-a93b-cd33af02bc9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46054e2bf1504b3ab8dfc53ef22f1761'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:43.763803 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-62874dc6-ea4c-4092-a93b-cd33af02bc9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46054e2bf1504b3ab8dfc53ef22f1761'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:43.763803 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-62874dc6-ea4c-4092-a93b-cd33af02bc9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46054e2bf1504b3ab8dfc53ef22f1761'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:43.773732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-62874dc6-ea4c-4092-a93b-cd33af02bc9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46054e2bf1504b3ab8dfc53ef22f1761'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:43.781352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-62874dc6-ea4c-4092-a93b-cd33af02bc9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46054e2bf1504b3ab8dfc53ef22f1761'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:43.882008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 880/1759] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:20:43 2022] DELETE /identity/v3/users/46054e2bf1504b3ab8dfc53ef22f1761 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:43.883281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705a60d-520f-45d4-b7f5-f39ba105ff43 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:43.883281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705a60d-520f-45d4-b7f5-f39ba105ff43 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:43.883281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705a60d-520f-45d4-b7f5-f39ba105ff43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:43.902852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-4705a60d-520f-45d4-b7f5-f39ba105ff43 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:43.904165 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4705a60d-520f-45d4-b7f5-f39ba105ff43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:43.994536 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 880/1760] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:44.006206 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62874dc6-ea4c-4092-a93b-cd33af02bc9d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:44.007905 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-62874dc6-ea4c-4092-a93b-cd33af02bc9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:44.082136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62874dc6-ea4c-4092-a93b-cd33af02bc9d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:44.087005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd9b82-d22a-4e7b-9a39-598e1523e92c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:44.087920 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd9b82-d22a-4e7b-9a39-598e1523e92c service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:44.088205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd9b82-d22a-4e7b-9a39-598e1523e92c service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:44.088663 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd9b82-d22a-4e7b-9a39-598e1523e92c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:44.100058 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd9b82-d22a-4e7b-9a39-598e1523e92c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:44.101525 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd9b82-d22a-4e7b-9a39-598e1523e92c service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:44.112843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 881/1761] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:44.226817 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705a60d-520f-45d4-b7f5-f39ba105ff43 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:44.228308 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4705a60d-520f-45d4-b7f5-f39ba105ff43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:44.241622 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705a60d-520f-45d4-b7f5-f39ba105ff43 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:44.246746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396c4ec-f258-4d85-8278-0f38e141394b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:44.247631 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396c4ec-f258-4d85-8278-0f38e141394b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:44.247908 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396c4ec-f258-4d85-8278-0f38e141394b admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:44.248180 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396c4ec-f258-4d85-8278-0f38e141394b admin admin] PATH_INFO: `/v3/users/7aa35b79637847f381e92516c9daaaf3` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:44.249375 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396c4ec-f258-4d85-8278-0f38e141394b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa35b79637847f381e92516c9daaaf3)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:44.251331 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396c4ec-f258-4d85-8278-0f38e141394b admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:44.493138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9396c4ec-f258-4d85-8278-0f38e141394b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa35b79637847f381e92516c9daaaf3'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:44.493869 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9396c4ec-f258-4d85-8278-0f38e141394b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa35b79637847f381e92516c9daaaf3'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:44.507202 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9396c4ec-f258-4d85-8278-0f38e141394b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa35b79637847f381e92516c9daaaf3'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:44.509339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9396c4ec-f258-4d85-8278-0f38e141394b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa35b79637847f381e92516c9daaaf3'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:44.516331 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9396c4ec-f258-4d85-8278-0f38e141394b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa35b79637847f381e92516c9daaaf3'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:44.564122 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd9b82-d22a-4e7b-9a39-598e1523e92c service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:44.565460 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-09dd9b82-d22a-4e7b-9a39-598e1523e92c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:44.579100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd9b82-d22a-4e7b-9a39-598e1523e92c service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:44.584196 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bffae9-6d04-41f0-8e44-d7c20d84c150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:44.585065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bffae9-6d04-41f0-8e44-d7c20d84c150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:44.585354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bffae9-6d04-41f0-8e44-d7c20d84c150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:44.585636 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bffae9-6d04-41f0-8e44-d7c20d84c150 admin admin] PATH_INFO: `/v3/projects/8c42d3bca98549cea5c98989f41eca46` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:44.586912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bffae9-6d04-41f0-8e44-d7c20d84c150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c42d3bca98549cea5c98989f41eca46)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:44.588418 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 881/1762] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:20:44 2022] DELETE /identity/v3/users/7aa35b79637847f381e92516c9daaaf3 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:44.591867 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bffae9-6d04-41f0-8e44-d7c20d84c150 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:44.594120 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b18f3-50c9-4475-9651-d916e3f3e9a9 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:44.594757 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b18f3-50c9-4475-9651-d916e3f3e9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:44.595646 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b18f3-50c9-4475-9651-d916e3f3e9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:44.631823 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-7c1b18f3-50c9-4475-9651-d916e3f3e9a9 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:44.633053 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-7c1b18f3-50c9-4475-9651-d916e3f3e9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:44.697392 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 882/1763] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:44.707811 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-97bffae9-6d04-41f0-8e44-d7c20d84c150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c42d3bca98549cea5c98989f41eca46', 'request_id': 'req-97bffae9-6d04-41f0-8e44-d7c20d84c150'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:44.709412 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b18f3-50c9-4475-9651-d916e3f3e9a9 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:44.711343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-7c1b18f3-50c9-4475-9651-d916e3f3e9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:44.775666 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b18f3-50c9-4475-9651-d916e3f3e9a9 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:44.791428 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-97bffae9-6d04-41f0-8e44-d7c20d84c150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c42d3bca98549cea5c98989f41eca46', 'request_id': 'req-97bffae9-6d04-41f0-8e44-d7c20d84c150'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:44.800816 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-97bffae9-6d04-41f0-8e44-d7c20d84c150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c42d3bca98549cea5c98989f41eca46', 'request_id': 'req-97bffae9-6d04-41f0-8e44-d7c20d84c150'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:44.812863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-97bffae9-6d04-41f0-8e44-d7c20d84c150 admin admin] The token cache is being invalidate because project 8c42d3bca98549cea5c98989f41eca46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:20:44.813153 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-97bffae9-6d04-41f0-8e44-d7c20d84c150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:44.814094 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-97bffae9-6d04-41f0-8e44-d7c20d84c150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:44.816048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 882/1764] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:20:44 2022] DELETE /identity/v3/projects/8c42d3bca98549cea5c98989f41eca46 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:20:44.821430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bffae9-6d04-41f0-8e44-d7c20d84c150 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:44.823066 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-97bffae9-6d04-41f0-8e44-d7c20d84c150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:44.844296 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d28ded-28c7-48a4-adb6-15b68649f5a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:44.845123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d28ded-28c7-48a4-adb6-15b68649f5a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:44.845772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d28ded-28c7-48a4-adb6-15b68649f5a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:44.845861 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d28ded-28c7-48a4-adb6-15b68649f5a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:44.847837 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-71d28ded-28c7-48a4-adb6-15b68649f5a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:44.890565 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bffae9-6d04-41f0-8e44-d7c20d84c150 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:44.895196 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e389ca8-913c-4a87-81a1-02837a9a8f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:44.896840 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e389ca8-913c-4a87-81a1-02837a9a8f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:44.897122 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e389ca8-913c-4a87-81a1-02837a9a8f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:44.897514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e389ca8-913c-4a87-81a1-02837a9a8f23 admin admin] PATH_INFO: `/v3/users/5d15bbfb895c4bc9a060b0ef750219a1` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:44.898776 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e389ca8-913c-4a87-81a1-02837a9a8f23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d15bbfb895c4bc9a060b0ef750219a1)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:44.900686 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e389ca8-913c-4a87-81a1-02837a9a8f23 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:44.922777 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d28ded-28c7-48a4-adb6-15b68649f5a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:44.924208 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d28ded-28c7-48a4-adb6-15b68649f5a5 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:44.934224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 883/1765] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:20:45.089110 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3e389ca8-913c-4a87-81a1-02837a9a8f23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d15bbfb895c4bc9a060b0ef750219a1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:45.089718 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3e389ca8-913c-4a87-81a1-02837a9a8f23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d15bbfb895c4bc9a060b0ef750219a1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:45.090339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3e389ca8-913c-4a87-81a1-02837a9a8f23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d15bbfb895c4bc9a060b0ef750219a1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:45.102312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3e389ca8-913c-4a87-81a1-02837a9a8f23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d15bbfb895c4bc9a060b0ef750219a1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:45.108878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3e389ca8-913c-4a87-81a1-02837a9a8f23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d15bbfb895c4bc9a060b0ef750219a1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:45.195381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 883/1766] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:20:44 2022] DELETE /identity/v3/users/5d15bbfb895c4bc9a060b0ef750219a1 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:20:45.403603 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d28ded-28c7-48a4-adb6-15b68649f5a5 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:45.405451 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-71d28ded-28c7-48a4-adb6-15b68649f5a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:45.418608 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d28ded-28c7-48a4-adb6-15b68649f5a5 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:45.503521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc4d03-195f-434e-ba4e-54cd816f7eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:45.504436 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc4d03-195f-434e-ba4e-54cd816f7eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:45.509176 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc4d03-195f-434e-ba4e-54cd816f7eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:45.509176 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc4d03-195f-434e-ba4e-54cd816f7eb0 admin admin] PATH_INFO: `/v3/projects/4f75f7e5518943eca961b79fb32a416a` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:45.509176 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc4d03-195f-434e-ba4e-54cd816f7eb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f75f7e5518943eca961b79fb32a416a)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:45.509176 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc4d03-195f-434e-ba4e-54cd816f7eb0 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:45.625217 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-81dc4d03-195f-434e-ba4e-54cd816f7eb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f75f7e5518943eca961b79fb32a416a', 'request_id': 'req-81dc4d03-195f-434e-ba4e-54cd816f7eb0'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:45.655003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e389ca8-913c-4a87-81a1-02837a9a8f23 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:45.656458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3e389ca8-913c-4a87-81a1-02837a9a8f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:45.672348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e389ca8-913c-4a87-81a1-02837a9a8f23 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:45.727706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-81dc4d03-195f-434e-ba4e-54cd816f7eb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f75f7e5518943eca961b79fb32a416a', 'request_id': 'req-81dc4d03-195f-434e-ba4e-54cd816f7eb0'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:45.733666 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-81dc4d03-195f-434e-ba4e-54cd816f7eb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f75f7e5518943eca961b79fb32a416a', 'request_id': 'req-81dc4d03-195f-434e-ba4e-54cd816f7eb0'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:45.736056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfe12e-7fe9-4e04-b458-00ab9ffdcd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:45.736923 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfe12e-7fe9-4e04-b458-00ab9ffdcd04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:45.737212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfe12e-7fe9-4e04-b458-00ab9ffdcd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:45.737492 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfe12e-7fe9-4e04-b458-00ab9ffdcd04 admin admin] PATH_INFO: `/v3/projects/9df3e5acc40543d5a62bfb1013815d98` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:45.738744 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfe12e-7fe9-4e04-b458-00ab9ffdcd04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9df3e5acc40543d5a62bfb1013815d98)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:45.741440 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfe12e-7fe9-4e04-b458-00ab9ffdcd04 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:45.745760 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-81dc4d03-195f-434e-ba4e-54cd816f7eb0 admin admin] The token cache is being invalidate because project 4f75f7e5518943eca961b79fb32a416a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:20:45.746046 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-81dc4d03-195f-434e-ba4e-54cd816f7eb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:45.746720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-81dc4d03-195f-434e-ba4e-54cd816f7eb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:45.748267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 884/1767] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:20:45 2022] DELETE /identity/v3/projects/4f75f7e5518943eca961b79fb32a416a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:45.752137 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc4d03-195f-434e-ba4e-54cd816f7eb0 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:45.753421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-81dc4d03-195f-434e-ba4e-54cd816f7eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:45.765878 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc4d03-195f-434e-ba4e-54cd816f7eb0 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:45.771361 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3aa1a-5ee5-45b0-9bab-d3c4a731e003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:45.772227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3aa1a-5ee5-45b0-9bab-d3c4a731e003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:45.772506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3aa1a-5ee5-45b0-9bab-d3c4a731e003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:45.772779 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3aa1a-5ee5-45b0-9bab-d3c4a731e003 admin admin] PATH_INFO: `/v3/users/e6ee73304fa74315834c4bfda57a5371` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:45.773969 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3aa1a-5ee5-45b0-9bab-d3c4a731e003 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ee73304fa74315834c4bfda57a5371)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:45.775902 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3aa1a-5ee5-45b0-9bab-d3c4a731e003 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:45.870426 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-04dfe12e-7fe9-4e04-b458-00ab9ffdcd04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df3e5acc40543d5a62bfb1013815d98', 'request_id': 'req-04dfe12e-7fe9-4e04-b458-00ab9ffdcd04'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:45.921982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-04dfe12e-7fe9-4e04-b458-00ab9ffdcd04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df3e5acc40543d5a62bfb1013815d98', 'request_id': 'req-04dfe12e-7fe9-4e04-b458-00ab9ffdcd04'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:45.928791 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-04dfe12e-7fe9-4e04-b458-00ab9ffdcd04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df3e5acc40543d5a62bfb1013815d98', 'request_id': 'req-04dfe12e-7fe9-4e04-b458-00ab9ffdcd04'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:45.931520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-12c3aa1a-5ee5-45b0-9bab-d3c4a731e003 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ee73304fa74315834c4bfda57a5371'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:45.932500 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-12c3aa1a-5ee5-45b0-9bab-d3c4a731e003 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ee73304fa74315834c4bfda57a5371'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:45.941245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-04dfe12e-7fe9-4e04-b458-00ab9ffdcd04 admin admin] The token cache is being invalidate because project 9df3e5acc40543d5a62bfb1013815d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:20:45.941532 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-04dfe12e-7fe9-4e04-b458-00ab9ffdcd04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:45.942387 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-04dfe12e-7fe9-4e04-b458-00ab9ffdcd04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:45.947860 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 884/1768] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:20:45 2022] DELETE /identity/v3/projects/9df3e5acc40543d5a62bfb1013815d98 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:20:45.948009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-12c3aa1a-5ee5-45b0-9bab-d3c4a731e003 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ee73304fa74315834c4bfda57a5371'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:45.948816 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-12c3aa1a-5ee5-45b0-9bab-d3c4a731e003 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ee73304fa74315834c4bfda57a5371'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:45.949310 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2dc87-f542-49e2-abb8-69d37e2e3506 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:45.949609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2dc87-f542-49e2-abb8-69d37e2e3506 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:45.949889 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2dc87-f542-49e2-abb8-69d37e2e3506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:45.956430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-12c3aa1a-5ee5-45b0-9bab-d3c4a731e003 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ee73304fa74315834c4bfda57a5371'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:45.968533 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-c0c2dc87-f542-49e2-abb8-69d37e2e3506 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:45.969858 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c0c2dc87-f542-49e2-abb8-69d37e2e3506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:46.003868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 885/1769] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:20:45 2022] DELETE /identity/v3/users/e6ee73304fa74315834c4bfda57a5371 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:20:46.040414 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 885/1770] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:46.049026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b06695-85f8-4790-8fe5-9b96bb3f6ac4 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:46.049338 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b06695-85f8-4790-8fe5-9b96bb3f6ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:46.049616 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b06695-85f8-4790-8fe5-9b96bb3f6ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:46.067767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-84b06695-85f8-4790-8fe5-9b96bb3f6ac4 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:46.068970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-84b06695-85f8-4790-8fe5-9b96bb3f6ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:46.125604 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 886/1771] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:46.130577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2dc87-f542-49e2-abb8-69d37e2e3506 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:46.140351 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2dc87-f542-49e2-abb8-69d37e2e3506 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:46.145180 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684e325-7238-4c83-8329-7bc6b9c2d35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:46.146727 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684e325-7238-4c83-8329-7bc6b9c2d35e admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:46.150895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684e325-7238-4c83-8329-7bc6b9c2d35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:46.150895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684e325-7238-4c83-8329-7bc6b9c2d35e admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:46.150895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684e325-7238-4c83-8329-7bc6b9c2d35e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:20:46.150895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684e325-7238-4c83-8329-7bc6b9c2d35e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:46.150895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684e325-7238-4c83-8329-7bc6b9c2d35e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:46.161443 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 886/1772] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:20:46.165714 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b06695-85f8-4790-8fe5-9b96bb3f6ac4 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:46.174757 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b06695-85f8-4790-8fe5-9b96bb3f6ac4 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:46.179644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25179e7-0425-4d63-845d-492480332146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:46.180308 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25179e7-0425-4d63-845d-492480332146 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:46.180592 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25179e7-0425-4d63-845d-492480332146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:46.180871 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25179e7-0425-4d63-845d-492480332146 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:46.181566 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25179e7-0425-4d63-845d-492480332146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:46.183508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25179e7-0425-4d63-845d-492480332146 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:46.295082 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 887/1773] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:46 2022] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:46.299087 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684e325-7238-4c83-8329-7bc6b9c2d35e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:46.309041 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684e325-7238-4c83-8329-7bc6b9c2d35e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:46.364106 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096f073-98ea-4c08-b45a-b984e034b4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:46.364772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096f073-98ea-4c08-b45a-b984e034b4ab admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:46.365054 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096f073-98ea-4c08-b45a-b984e034b4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:46.365327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096f073-98ea-4c08-b45a-b984e034b4ab admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:46.366025 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096f073-98ea-4c08-b45a-b984e034b4ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:46.368090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096f073-98ea-4c08-b45a-b984e034b4ab admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:46.381212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25179e7-0425-4d63-845d-492480332146 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:46.383262 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-c25179e7-0425-4d63-845d-492480332146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:46.398321 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25179e7-0425-4d63-845d-492480332146 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:46.404904 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e041c7-5029-4ac9-82ad-c6263f7d49ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:46.405786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e041c7-5029-4ac9-82ad-c6263f7d49ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:46.406130 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e041c7-5029-4ac9-82ad-c6263f7d49ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:46.406404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e041c7-5029-4ac9-82ad-c6263f7d49ca admin admin] PATH_INFO: `/v3/projects/ff461cf3055847379b0e794118fb5a20` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:46.408527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e041c7-5029-4ac9-82ad-c6263f7d49ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff461cf3055847379b0e794118fb5a20)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:46.410489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e041c7-5029-4ac9-82ad-c6263f7d49ca admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:46.455483 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 887/1774] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:46 2022] POST /identity/v3/users => generated 284 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:46.460360 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096f073-98ea-4c08-b45a-b984e034b4ab admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:46.470293 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096f073-98ea-4c08-b45a-b984e034b4ab admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:46.475333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8ea89-62e7-48f6-98f8-b74634d09f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:46.475999 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8ea89-62e7-48f6-98f8-b74634d09f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:46.476286 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8ea89-62e7-48f6-98f8-b74634d09f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:46.476564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8ea89-62e7-48f6-98f8-b74634d09f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:46.477294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8ea89-62e7-48f6-98f8-b74634d09f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:46.478949 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8ea89-62e7-48f6-98f8-b74634d09f44 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:46.488754 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 888/1775] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:20:46.493237 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8ea89-62e7-48f6-98f8-b74634d09f44 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:46.502348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8ea89-62e7-48f6-98f8-b74634d09f44 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:46.507662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff149b-b330-4e5b-9555-e0428411c156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:46.511003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff149b-b330-4e5b-9555-e0428411c156 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:46.511003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff149b-b330-4e5b-9555-e0428411c156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:46.511003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff149b-b330-4e5b-9555-e0428411c156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:46.511003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff149b-b330-4e5b-9555-e0428411c156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:46.511361 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff149b-b330-4e5b-9555-e0428411c156 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:46.522497 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 889/1776] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:20:46.524032 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-b1e041c7-5029-4ac9-82ad-c6263f7d49ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff461cf3055847379b0e794118fb5a20', 'request_id': 'req-b1e041c7-5029-4ac9-82ad-c6263f7d49ca'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:46.526616 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff149b-b330-4e5b-9555-e0428411c156 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:46.536283 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff149b-b330-4e5b-9555-e0428411c156 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:46.592286 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e01385-aa25-4020-892c-6911b9b320ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:46.593201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e01385-aa25-4020-892c-6911b9b320ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:46.593478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e01385-aa25-4020-892c-6911b9b320ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:46.593750 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e01385-aa25-4020-892c-6911b9b320ab admin admin] PATH_INFO: `/v3/projects/b2fb61662f1f4759b66e089b045e0396/users/e52de011bb8e4e77a9b62b245e18f61b/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:46.608745 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e01385-aa25-4020-892c-6911b9b320ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2fb61662f1f4759b66e089b045e0396, user_id=e52de011bb8e4e77a9b62b245e18f61b, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:46.611427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e01385-aa25-4020-892c-6911b9b320ab admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:46.636729 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-b1e041c7-5029-4ac9-82ad-c6263f7d49ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff461cf3055847379b0e794118fb5a20', 'request_id': 'req-b1e041c7-5029-4ac9-82ad-c6263f7d49ca'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:46.646934 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-b1e041c7-5029-4ac9-82ad-c6263f7d49ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff461cf3055847379b0e794118fb5a20', 'request_id': 'req-b1e041c7-5029-4ac9-82ad-c6263f7d49ca'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:46.656102 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-b1e041c7-5029-4ac9-82ad-c6263f7d49ca admin admin] The token cache is being invalidate because project ff461cf3055847379b0e794118fb5a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:20:46.656550 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-b1e041c7-5029-4ac9-82ad-c6263f7d49ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:46.657220 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-b1e041c7-5029-4ac9-82ad-c6263f7d49ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:46.659050 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 888/1777] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:20:46 2022] DELETE /identity/v3/projects/ff461cf3055847379b0e794118fb5a20 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:20:46.663931 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f0c23-4b6e-492f-b731-de139185e8b9 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:46.664224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f0c23-4b6e-492f-b731-de139185e8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:46.664498 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f0c23-4b6e-492f-b731-de139185e8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:46.683683 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-598f0c23-4b6e-492f-b731-de139185e8b9 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:46.684955 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-598f0c23-4b6e-492f-b731-de139185e8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:46.693153 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 889/1778] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:20:46.702467 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c50b8-66c6-4e10-a040-d4561b7eac0c None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:46.702766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c50b8-66c6-4e10-a040-d4561b7eac0c None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:46.703070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c50b8-66c6-4e10-a040-d4561b7eac0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:46.711045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 890/1779] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:46 2022] PUT /identity/v3/projects/b2fb61662f1f4759b66e089b045e0396/users/e52de011bb8e4e77a9b62b245e18f61b/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:20:46.721032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1a6d1-a91c-4819-bd94-d511679fa2f6 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:46.725216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1a6d1-a91c-4819-bd94-d511679fa2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:46.725216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1a6d1-a91c-4819-bd94-d511679fa2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:46.725455 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-565c50b8-66c6-4e10-a040-d4561b7eac0c None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:46.725455 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-565c50b8-66c6-4e10-a040-d4561b7eac0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:46.749403 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-41a1a6d1-a91c-4819-bd94-d511679fa2f6 None None] MFA Rules not processed for user `e52de011bb8e4e77a9b62b245e18f61b`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:46.750513 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-41a1a6d1-a91c-4819-bd94-d511679fa2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:46.789560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 890/1780] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:20:46.794066 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c50b8-66c6-4e10-a040-d4561b7eac0c None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:46.803899 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c50b8-66c6-4e10-a040-d4561b7eac0c None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:46.808951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d4328-6e9c-4531-a5b3-e2c30e35e04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:46.809722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d4328-6e9c-4531-a5b3-e2c30e35e04a admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:46.814349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d4328-6e9c-4531-a5b3-e2c30e35e04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:46.814701 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d4328-6e9c-4531-a5b3-e2c30e35e04a admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:46.815473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d4328-6e9c-4531-a5b3-e2c30e35e04a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:20:46.815933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d4328-6e9c-4531-a5b3-e2c30e35e04a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:46.818191 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d4328-6e9c-4531-a5b3-e2c30e35e04a admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:46.821620 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 891/1781] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:20:46.825927 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1a6d1-a91c-4819-bd94-d511679fa2f6 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:46.827287 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-41a1a6d1-a91c-4819-bd94-d511679fa2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:46.846514 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 891/1782] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:20:46.849202 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d4328-6e9c-4531-a5b3-e2c30e35e04a admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:46.875453 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1a6d1-a91c-4819-bd94-d511679fa2f6 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:46.876986 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d4328-6e9c-4531-a5b3-e2c30e35e04a admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:46.882610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f8c91-a201-4794-8cea-f2f04510ee03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:46.883380 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f8c91-a201-4794-8cea-f2f04510ee03 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:46.883504 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10689ae4-8cb1-4399-a99d-7532f71d1bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:46.883677 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f8c91-a201-4794-8cea-f2f04510ee03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:46.883954 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f8c91-a201-4794-8cea-f2f04510ee03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:46.884324 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10689ae4-8cb1-4399-a99d-7532f71d1bae admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:46.884622 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f8c91-a201-4794-8cea-f2f04510ee03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:46.884713 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10689ae4-8cb1-4399-a99d-7532f71d1bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:46.885027 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10689ae4-8cb1-4399-a99d-7532f71d1bae admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:46.886064 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10689ae4-8cb1-4399-a99d-7532f71d1bae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:46.886831 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f8c91-a201-4794-8cea-f2f04510ee03 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:46.888476 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10689ae4-8cb1-4399-a99d-7532f71d1bae admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:47.021198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 892/1783] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:46 2022] POST /identity/v3/projects => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:20:47.023248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 892/1784] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:46 2022] POST /identity/v3/projects => generated 387 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:47.025229 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f8c91-a201-4794-8cea-f2f04510ee03 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:47.028514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10689ae4-8cb1-4399-a99d-7532f71d1bae admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:47.145999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f8c91-a201-4794-8cea-f2f04510ee03 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:47.152606 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10689ae4-8cb1-4399-a99d-7532f71d1bae admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:47.153547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70c443-3d9d-4545-8966-4658955941f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:47.154534 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70c443-3d9d-4545-8966-4658955941f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:47.155185 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70c443-3d9d-4545-8966-4658955941f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:47.161684 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70c443-3d9d-4545-8966-4658955941f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:47.161684 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70c443-3d9d-4545-8966-4658955941f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:47.161684 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70c443-3d9d-4545-8966-4658955941f1 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:47.165291 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13560f-ffbc-4470-b98a-4c72ccf8922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:47.165991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13560f-ffbc-4470-b98a-4c72ccf8922c admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:47.166275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13560f-ffbc-4470-b98a-4c72ccf8922c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:47.166631 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13560f-ffbc-4470-b98a-4c72ccf8922c admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:47.170237 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13560f-ffbc-4470-b98a-4c72ccf8922c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:47.172396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13560f-ffbc-4470-b98a-4c72ccf8922c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:47.366497 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 893/1785] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:47 2022] POST /identity/v3/users => generated 290 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:20:47.369607 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 893/1786] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:47 2022] POST /identity/v3/users => generated 294 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:20:47.369738 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70c443-3d9d-4545-8966-4658955941f1 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:47.370421 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13560f-ffbc-4470-b98a-4c72ccf8922c admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:47.378382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70c443-3d9d-4545-8966-4658955941f1 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:47.383482 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849776c0-5b64-44ef-be9a-b7472dbe553a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:47.384178 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849776c0-5b64-44ef-be9a-b7472dbe553a admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:47.384443 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849776c0-5b64-44ef-be9a-b7472dbe553a admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:47.384723 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849776c0-5b64-44ef-be9a-b7472dbe553a admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:47.385459 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849776c0-5b64-44ef-be9a-b7472dbe553a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:47.387368 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849776c0-5b64-44ef-be9a-b7472dbe553a admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:47.397257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13560f-ffbc-4470-b98a-4c72ccf8922c admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:47.398502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 894/1787] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:47.402547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849776c0-5b64-44ef-be9a-b7472dbe553a admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:47.403062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa3dde-2e65-4277-99a7-b046ff7fc112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:47.403841 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa3dde-2e65-4277-99a7-b046ff7fc112 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:47.404223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa3dde-2e65-4277-99a7-b046ff7fc112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:47.404596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa3dde-2e65-4277-99a7-b046ff7fc112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:47.405427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa3dde-2e65-4277-99a7-b046ff7fc112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:47.407172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa3dde-2e65-4277-99a7-b046ff7fc112 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:47.415003 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849776c0-5b64-44ef-be9a-b7472dbe553a admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:47.420252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246b54b-4270-4b25-9c6e-c44f1db9062c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:47.420982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 894/1788] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:47.421155 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246b54b-4270-4b25-9c6e-c44f1db9062c admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:47.421575 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246b54b-4270-4b25-9c6e-c44f1db9062c admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:47.421864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246b54b-4270-4b25-9c6e-c44f1db9062c admin admin] PATH_INFO: `/v3/projects/7fb276c2764940febf47b436f7dbcdd6/users/e07c42467b8c48959464d0d2a879fd51/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:47.423680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa3dde-2e65-4277-99a7-b046ff7fc112 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:47.433514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa3dde-2e65-4277-99a7-b046ff7fc112 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:47.443581 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246b54b-4270-4b25-9c6e-c44f1db9062c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb276c2764940febf47b436f7dbcdd6, user_id=e07c42467b8c48959464d0d2a879fd51, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:47.447441 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f24f9e-8d80-4be0-8ae6-b397ebe88363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:47.447780 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f24f9e-8d80-4be0-8ae6-b397ebe88363 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:47.448069 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f24f9e-8d80-4be0-8ae6-b397ebe88363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:47.450392 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f24f9e-8d80-4be0-8ae6-b397ebe88363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:47.451151 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f24f9e-8d80-4be0-8ae6-b397ebe88363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:47.452167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246b54b-4270-4b25-9c6e-c44f1db9062c admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:47.455611 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f24f9e-8d80-4be0-8ae6-b397ebe88363 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:47.473164 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 895/1789] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:20:47.478481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f24f9e-8d80-4be0-8ae6-b397ebe88363 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:47.491721 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f24f9e-8d80-4be0-8ae6-b397ebe88363 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:47.511577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3137b41-a588-40ec-8b6d-34eb9f594910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:47.511577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3137b41-a588-40ec-8b6d-34eb9f594910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:47.511577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3137b41-a588-40ec-8b6d-34eb9f594910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:47.511577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3137b41-a588-40ec-8b6d-34eb9f594910 admin admin] PATH_INFO: `/v3/projects/7d68b97987d34962b900dcfc598b676d/users/26f8401416ca40b8b5b708938d49b587/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:47.545731 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3137b41-a588-40ec-8b6d-34eb9f594910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d68b97987d34962b900dcfc598b676d, user_id=26f8401416ca40b8b5b708938d49b587, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:47.545731 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3137b41-a588-40ec-8b6d-34eb9f594910 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:47.566531 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 895/1790] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:47 2022] PUT /identity/v3/projects/7fb276c2764940febf47b436f7dbcdd6/users/e07c42467b8c48959464d0d2a879fd51/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:20:47.571482 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246b54b-4270-4b25-9c6e-c44f1db9062c admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:47.650489 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 896/1791] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:47 2022] PUT /identity/v3/projects/7d68b97987d34962b900dcfc598b676d/users/26f8401416ca40b8b5b708938d49b587/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:20:47.652032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a86c0a-8e23-4ece-8ba2-9e1fe5c035c1 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:47.652328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a86c0a-8e23-4ece-8ba2-9e1fe5c035c1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:47.652606 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a86c0a-8e23-4ece-8ba2-9e1fe5c035c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:47.679354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246b54b-4270-4b25-9c6e-c44f1db9062c admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:47.743881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-27a86c0a-8e23-4ece-8ba2-9e1fe5c035c1 None None] MFA Rules not processed for user `26f8401416ca40b8b5b708938d49b587`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:47.745136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-27a86c0a-8e23-4ece-8ba2-9e1fe5c035c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:47.782834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e919c6c-4b2a-4694-a22a-f2eaed7e3477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:47.783773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e919c6c-4b2a-4694-a22a-f2eaed7e3477 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:47.784205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e919c6c-4b2a-4694-a22a-f2eaed7e3477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:47.784695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e919c6c-4b2a-4694-a22a-f2eaed7e3477 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:47.785735 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e919c6c-4b2a-4694-a22a-f2eaed7e3477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:47.788273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e919c6c-4b2a-4694-a22a-f2eaed7e3477 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:47.803614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 896/1792] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:20:47.808329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e919c6c-4b2a-4694-a22a-f2eaed7e3477 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:47.833776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e919c6c-4b2a-4694-a22a-f2eaed7e3477 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:47.854394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946a6e5-abc7-4fd4-a8d4-f919b3462848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:47.855509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946a6e5-abc7-4fd4-a8d4-f919b3462848 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:47.855862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946a6e5-abc7-4fd4-a8d4-f919b3462848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:47.856244 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946a6e5-abc7-4fd4-a8d4-f919b3462848 admin admin] PATH_INFO: `/v3/projects/7fb276c2764940febf47b436f7dbcdd6/users/e07c42467b8c48959464d0d2a879fd51/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:47.863475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946a6e5-abc7-4fd4-a8d4-f919b3462848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb276c2764940febf47b436f7dbcdd6, user_id=e07c42467b8c48959464d0d2a879fd51, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:47.866397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946a6e5-abc7-4fd4-a8d4-f919b3462848 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:47.907035 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 897/1793] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:47 2022] PUT /identity/v3/projects/7fb276c2764940febf47b436f7dbcdd6/users/e07c42467b8c48959464d0d2a879fd51/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:47.918342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af758621-c18c-4d6b-bde7-0aa7184e29b7 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:47.918731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af758621-c18c-4d6b-bde7-0aa7184e29b7 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:47.919601 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af758621-c18c-4d6b-bde7-0aa7184e29b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:47.956944 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 897/1794] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:47.958748 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a86c0a-8e23-4ece-8ba2-9e1fe5c035c1 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:47.978354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a86c0a-8e23-4ece-8ba2-9e1fe5c035c1 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:48.001200 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-af758621-c18c-4d6b-bde7-0aa7184e29b7 None None] MFA Rules not processed for user `e07c42467b8c48959464d0d2a879fd51`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:48.003336 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-af758621-c18c-4d6b-bde7-0aa7184e29b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:48.092719 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b17ef-f22f-4fec-b86a-3864ee7402d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:48.093449 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b17ef-f22f-4fec-b86a-3864ee7402d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:48.093803 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b17ef-f22f-4fec-b86a-3864ee7402d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:48.094064 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b17ef-f22f-4fec-b86a-3864ee7402d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:48.095344 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b17ef-f22f-4fec-b86a-3864ee7402d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:48.097891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b17ef-f22f-4fec-b86a-3864ee7402d9 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:48.195212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 898/1795] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:48.203585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af758621-c18c-4d6b-bde7-0aa7184e29b7 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:48.206133 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-af758621-c18c-4d6b-bde7-0aa7184e29b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:48.222963 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 898/1796] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:47 2022] POST /identity/v3/projects => generated 385 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:48.228293 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b17ef-f22f-4fec-b86a-3864ee7402d9 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:48.337768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af758621-c18c-4d6b-bde7-0aa7184e29b7 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:48.409577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b17ef-f22f-4fec-b86a-3864ee7402d9 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:48.411692 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6c2ad-827a-4b8c-aa7d-7f27278cff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:48.412656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6c2ad-827a-4b8c-aa7d-7f27278cff8f admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:48.413142 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6c2ad-827a-4b8c-aa7d-7f27278cff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:48.414284 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6c2ad-827a-4b8c-aa7d-7f27278cff8f admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:48.414284 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6c2ad-827a-4b8c-aa7d-7f27278cff8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:48.418343 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6c2ad-827a-4b8c-aa7d-7f27278cff8f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:48.456725 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37687ed3-0965-48af-8a7a-6b9a55f8e4ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:48.457129 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37687ed3-0965-48af-8a7a-6b9a55f8e4ae service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:48.457427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37687ed3-0965-48af-8a7a-6b9a55f8e4ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:48.457703 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37687ed3-0965-48af-8a7a-6b9a55f8e4ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:48.524828 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 899/1797] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:48 2022] POST /identity/v3/users => generated 299 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:48.530011 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6c2ad-827a-4b8c-aa7d-7f27278cff8f admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:48.550892 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6c2ad-827a-4b8c-aa7d-7f27278cff8f admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:48.581429 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4d120-4090-46b8-a3c8-0798e75cf2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:48.581429 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4d120-4090-46b8-a3c8-0798e75cf2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:48.581429 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4d120-4090-46b8-a3c8-0798e75cf2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:48.581429 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4d120-4090-46b8-a3c8-0798e75cf2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:48.584875 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4d120-4090-46b8-a3c8-0798e75cf2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:48.586618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4d120-4090-46b8-a3c8-0798e75cf2b7 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:48.618362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 900/1798] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:48.622341 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4d120-4090-46b8-a3c8-0798e75cf2b7 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:48.626051 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37687ed3-0965-48af-8a7a-6b9a55f8e4ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:48.627557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37687ed3-0965-48af-8a7a-6b9a55f8e4ae service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:48.642940 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4d120-4090-46b8-a3c8-0798e75cf2b7 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:48.649734 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921be979-f4c9-4bf4-88cd-0b6994e04ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:48.650942 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921be979-f4c9-4bf4-88cd-0b6994e04ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:48.651302 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921be979-f4c9-4bf4-88cd-0b6994e04ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:48.651665 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921be979-f4c9-4bf4-88cd-0b6994e04ba3 admin admin] PATH_INFO: `/v3/projects/25f602926be34bfa83535e8e6f178cf1/users/9b17a9a508434e7aa10d412a878c0a97/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:48.656704 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 899/1799] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:48 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:20:48.710254 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921be979-f4c9-4bf4-88cd-0b6994e04ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f602926be34bfa83535e8e6f178cf1, user_id=9b17a9a508434e7aa10d412a878c0a97, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:48.712997 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921be979-f4c9-4bf4-88cd-0b6994e04ba3 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:48.780673 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37687ed3-0965-48af-8a7a-6b9a55f8e4ae service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:48.782526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-37687ed3-0965-48af-8a7a-6b9a55f8e4ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:48.795070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37687ed3-0965-48af-8a7a-6b9a55f8e4ae service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:48.799036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb13f7-232c-4809-a230-aa5b7eae0881 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:48.799702 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb13f7-232c-4809-a230-aa5b7eae0881 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:48.799990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb13f7-232c-4809-a230-aa5b7eae0881 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:48.800271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb13f7-232c-4809-a230-aa5b7eae0881 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:48.813358 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 901/1800] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:48 2022] PUT /identity/v3/projects/25f602926be34bfa83535e8e6f178cf1/users/9b17a9a508434e7aa10d412a878c0a97/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:48.815391 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921be979-f4c9-4bf4-88cd-0b6994e04ba3 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:48.928766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb13f7-232c-4809-a230-aa5b7eae0881 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:48.933147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb13f7-232c-4809-a230-aa5b7eae0881 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:48.962635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 900/1801] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:20:49.013277 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921be979-f4c9-4bf4-88cd-0b6994e04ba3 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:49.021767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79804289-0b45-45de-8f07-b34123e17f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:49.022576 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79804289-0b45-45de-8f07-b34123e17f96 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:49.023408 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79804289-0b45-45de-8f07-b34123e17f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:49.023850 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79804289-0b45-45de-8f07-b34123e17f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:49.024861 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79804289-0b45-45de-8f07-b34123e17f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:49.028385 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79804289-0b45-45de-8f07-b34123e17f96 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:49.048276 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 902/1802] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:49.052526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb13f7-232c-4809-a230-aa5b7eae0881 service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:49.064402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb13f7-232c-4809-a230-aa5b7eae0881 service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:49.072148 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4772157-1c50-4b9f-a866-f22c89db7558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:49.073290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4772157-1c50-4b9f-a866-f22c89db7558 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:49.073722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4772157-1c50-4b9f-a866-f22c89db7558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:49.074147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4772157-1c50-4b9f-a866-f22c89db7558 admin admin] PATH_INFO: `/v3/projects/25f602926be34bfa83535e8e6f178cf1/users/9b17a9a508434e7aa10d412a878c0a97/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:49.077111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4772157-1c50-4b9f-a866-f22c89db7558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f602926be34bfa83535e8e6f178cf1, user_id=9b17a9a508434e7aa10d412a878c0a97, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:49.084076 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4772157-1c50-4b9f-a866-f22c89db7558 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:49.097994 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 901/1803] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:49 2022] PUT /identity/v3/projects/25f602926be34bfa83535e8e6f178cf1/users/9b17a9a508434e7aa10d412a878c0a97/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:49.112279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149b219-5f95-412f-8c4b-a3d482d532ec None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:49.112676 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149b219-5f95-412f-8c4b-a3d482d532ec None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:49.113042 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149b219-5f95-412f-8c4b-a3d482d532ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:49.229895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-1149b219-5f95-412f-8c4b-a3d482d532ec None None] MFA Rules not processed for user `9b17a9a508434e7aa10d412a878c0a97`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:49.231183 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1149b219-5f95-412f-8c4b-a3d482d532ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:49.418862 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 903/1804] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:49.453233 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4772157-1c50-4b9f-a866-f22c89db7558 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:49.621110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4772157-1c50-4b9f-a866-f22c89db7558 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:49.630232 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30d9d3-b3d0-41ce-ad0c-cfc28dbe1ac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:49.631500 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30d9d3-b3d0-41ce-ad0c-cfc28dbe1ac1 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:49.631500 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30d9d3-b3d0-41ce-ad0c-cfc28dbe1ac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:49.631698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30d9d3-b3d0-41ce-ad0c-cfc28dbe1ac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:49.643425 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5c74d-ad18-47df-92ab-c5b14f60c950 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:49.643830 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5c74d-ad18-47df-92ab-c5b14f60c950 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:49.644187 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5c74d-ad18-47df-92ab-c5b14f60c950 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:49.648592 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 904/1805] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 10 21:20:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:20:49.661687 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30d9d3-b3d0-41ce-ad0c-cfc28dbe1ac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:49.663943 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30d9d3-b3d0-41ce-ad0c-cfc28dbe1ac1 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:49.696064 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 902/1806] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:49.698990 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858ba2c-7d60-476f-8a2f-21db4210e222 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:49.698990 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858ba2c-7d60-476f-8a2f-21db4210e222 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:49.703625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858ba2c-7d60-476f-8a2f-21db4210e222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:49.726787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-3858ba2c-7d60-476f-8a2f-21db4210e222 None None] MFA Rules not processed for user `c4c16a3b07c64a22bfc3df2a5a90c3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:49.730644 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3858ba2c-7d60-476f-8a2f-21db4210e222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:49.881536 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30d9d3-b3d0-41ce-ad0c-cfc28dbe1ac1 service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:50.016362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 905/1807] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 10 21:20:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:20:50.062837 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30d9d3-b3d0-41ce-ad0c-cfc28dbe1ac1 service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:50.070156 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3581c-5bdd-4504-bf79-b49652cced0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:50.071831 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3581c-5bdd-4504-bf79-b49652cced0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:50.072427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3581c-5bdd-4504-bf79-b49652cced0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:50.072792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3581c-5bdd-4504-bf79-b49652cced0a admin admin] PATH_INFO: `/v3/users/26f8401416ca40b8b5b708938d49b587` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:50.075475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3581c-5bdd-4504-bf79-b49652cced0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=26f8401416ca40b8b5b708938d49b587)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:50.078271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3581c-5bdd-4504-bf79-b49652cced0a admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:50.137305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858ba2c-7d60-476f-8a2f-21db4210e222 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:50.137305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3858ba2c-7d60-476f-8a2f-21db4210e222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:50.163030 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858ba2c-7d60-476f-8a2f-21db4210e222 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:50.172912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3451bf9-df5b-4b65-81bc-9722e2a63f7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:50.174411 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3451bf9-df5b-4b65-81bc-9722e2a63f7b service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:50.174924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3451bf9-df5b-4b65-81bc-9722e2a63f7b service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:50.175349 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3451bf9-df5b-4b65-81bc-9722e2a63f7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:50.190801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3451bf9-df5b-4b65-81bc-9722e2a63f7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:50.193745 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3451bf9-df5b-4b65-81bc-9722e2a63f7b service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:50.208827 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 906/1808] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:50.371697 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c9b3581c-5bdd-4504-bf79-b49652cced0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26f8401416ca40b8b5b708938d49b587'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:50.373016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c9b3581c-5bdd-4504-bf79-b49652cced0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26f8401416ca40b8b5b708938d49b587'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:50.392160 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c9b3581c-5bdd-4504-bf79-b49652cced0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26f8401416ca40b8b5b708938d49b587'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:50.393029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c9b3581c-5bdd-4504-bf79-b49652cced0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26f8401416ca40b8b5b708938d49b587'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:50.407998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c9b3581c-5bdd-4504-bf79-b49652cced0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26f8401416ca40b8b5b708938d49b587'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:50.475919 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 903/1809] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:20:49 2022] DELETE /identity/v3/users/26f8401416ca40b8b5b708938d49b587 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:20:50.476699 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e513439-0089-491e-8e40-e6961ec11f29 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:50.477073 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e513439-0089-491e-8e40-e6961ec11f29 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:50.477273 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e513439-0089-491e-8e40-e6961ec11f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:50.525770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-9e513439-0089-491e-8e40-e6961ec11f29 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:50.527027 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9e513439-0089-491e-8e40-e6961ec11f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:50.656935 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 907/1810] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:50.685480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3581c-5bdd-4504-bf79-b49652cced0a admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:50.687028 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-c9b3581c-5bdd-4504-bf79-b49652cced0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:50.802369 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3581c-5bdd-4504-bf79-b49652cced0a admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:50.810298 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61af727-4925-4a20-8bb2-8d7f41ffa4bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:50.812118 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61af727-4925-4a20-8bb2-8d7f41ffa4bf service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:50.812644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61af727-4925-4a20-8bb2-8d7f41ffa4bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:50.813248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61af727-4925-4a20-8bb2-8d7f41ffa4bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:50.828788 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61af727-4925-4a20-8bb2-8d7f41ffa4bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:50.835955 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61af727-4925-4a20-8bb2-8d7f41ffa4bf service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:50.860568 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 904/1811] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:52.520811 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e513439-0089-491e-8e40-e6961ec11f29 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:52.521839 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9e513439-0089-491e-8e40-e6961ec11f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:52.537234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e513439-0089-491e-8e40-e6961ec11f29 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:52.541622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c732f5-9036-4c37-a740-af5b7caa0e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:52.542665 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c732f5-9036-4c37-a740-af5b7caa0e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:52.543025 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c732f5-9036-4c37-a740-af5b7caa0e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:52.543501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c732f5-9036-4c37-a740-af5b7caa0e95 admin admin] PATH_INFO: `/v3/projects/7d68b97987d34962b900dcfc598b676d` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:52.544789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c732f5-9036-4c37-a740-af5b7caa0e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d68b97987d34962b900dcfc598b676d)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:52.546800 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c732f5-9036-4c37-a740-af5b7caa0e95 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:52.718135 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b3c732f5-9036-4c37-a740-af5b7caa0e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d68b97987d34962b900dcfc598b676d', 'request_id': 'req-b3c732f5-9036-4c37-a740-af5b7caa0e95'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:52.808151 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b3c732f5-9036-4c37-a740-af5b7caa0e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d68b97987d34962b900dcfc598b676d', 'request_id': 'req-b3c732f5-9036-4c37-a740-af5b7caa0e95'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:52.819448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b3c732f5-9036-4c37-a740-af5b7caa0e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d68b97987d34962b900dcfc598b676d', 'request_id': 'req-b3c732f5-9036-4c37-a740-af5b7caa0e95'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:52.856650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b3c732f5-9036-4c37-a740-af5b7caa0e95 admin admin] The token cache is being invalidate because project 7d68b97987d34962b900dcfc598b676d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:20:52.856968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b3c732f5-9036-4c37-a740-af5b7caa0e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:52.858813 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b3c732f5-9036-4c37-a740-af5b7caa0e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:52.866555 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 908/1812] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:20:52 2022] DELETE /identity/v3/projects/7d68b97987d34962b900dcfc598b676d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:52.867822 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61af727-4925-4a20-8bb2-8d7f41ffa4bf service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:52.881562 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61af727-4925-4a20-8bb2-8d7f41ffa4bf service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:52.953793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68773f60-b1a7-4bd0-828a-30781aa36d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:52.954680 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68773f60-b1a7-4bd0-828a-30781aa36d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:52.954956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68773f60-b1a7-4bd0-828a-30781aa36d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:52.955387 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68773f60-b1a7-4bd0-828a-30781aa36d3a admin admin] PATH_INFO: `/v3/users/9b17a9a508434e7aa10d412a878c0a97` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:52.956623 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68773f60-b1a7-4bd0-828a-30781aa36d3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b17a9a508434e7aa10d412a878c0a97)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:52.959024 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68773f60-b1a7-4bd0-828a-30781aa36d3a admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:53.235392 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-68773f60-b1a7-4bd0-828a-30781aa36d3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b17a9a508434e7aa10d412a878c0a97'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:53.236185 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-68773f60-b1a7-4bd0-828a-30781aa36d3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b17a9a508434e7aa10d412a878c0a97'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:53.250898 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a70bc-ec49-4d60-803c-2f8ca72d4dd7 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:53.251184 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a70bc-ec49-4d60-803c-2f8ca72d4dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:53.251489 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a70bc-ec49-4d60-803c-2f8ca72d4dd7 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:53.255916 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 909/1813] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 10 21:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:20:53.264306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-68773f60-b1a7-4bd0-828a-30781aa36d3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b17a9a508434e7aa10d412a878c0a97'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:53.265082 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-68773f60-b1a7-4bd0-828a-30781aa36d3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b17a9a508434e7aa10d412a878c0a97'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:53.273924 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-68773f60-b1a7-4bd0-828a-30781aa36d3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b17a9a508434e7aa10d412a878c0a97'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:53.276781 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdcc20-26e5-4177-94df-e7c0c5168f26 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:53.277081 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdcc20-26e5-4177-94df-e7c0c5168f26 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:53.277346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdcc20-26e5-4177-94df-e7c0c5168f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:53.306642 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-52bdcc20-26e5-4177-94df-e7c0c5168f26 None None] MFA Rules not processed for user `c4c16a3b07c64a22bfc3df2a5a90c3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:53.306642 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-52bdcc20-26e5-4177-94df-e7c0c5168f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:53.408611 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 910/1814] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 10 21:20:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:53.423598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdcc20-26e5-4177-94df-e7c0c5168f26 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:53.425008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-52bdcc20-26e5-4177-94df-e7c0c5168f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:53.426520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 905/1815] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:20:52 2022] DELETE /identity/v3/users/9b17a9a508434e7aa10d412a878c0a97 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:53.439760 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdcc20-26e5-4177-94df-e7c0c5168f26 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:53.516246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea33bf6-8d65-40b5-809c-47a734cfb0b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:53.517240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea33bf6-8d65-40b5-809c-47a734cfb0b5 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:53.518810 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea33bf6-8d65-40b5-809c-47a734cfb0b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:53.519708 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea33bf6-8d65-40b5-809c-47a734cfb0b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:53.537447 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea33bf6-8d65-40b5-809c-47a734cfb0b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:53.539761 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea33bf6-8d65-40b5-809c-47a734cfb0b5 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:53.550720 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 911/1816] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:20:54.314908 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68773f60-b1a7-4bd0-828a-30781aa36d3a admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:54.322369 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-68773f60-b1a7-4bd0-828a-30781aa36d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:54.409692 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68773f60-b1a7-4bd0-828a-30781aa36d3a admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:54.419133 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89000603-d241-4928-b9a5-5b530ecafebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:54.420526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89000603-d241-4928-b9a5-5b530ecafebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:54.420918 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89000603-d241-4928-b9a5-5b530ecafebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:54.421737 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89000603-d241-4928-b9a5-5b530ecafebb admin admin] PATH_INFO: `/v3/projects/25f602926be34bfa83535e8e6f178cf1` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:54.423365 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89000603-d241-4928-b9a5-5b530ecafebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f602926be34bfa83535e8e6f178cf1)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:54.426370 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89000603-d241-4928-b9a5-5b530ecafebb admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:54.565188 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-89000603-d241-4928-b9a5-5b530ecafebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f602926be34bfa83535e8e6f178cf1', 'request_id': 'req-89000603-d241-4928-b9a5-5b530ecafebb'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:54.647858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-89000603-d241-4928-b9a5-5b530ecafebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f602926be34bfa83535e8e6f178cf1', 'request_id': 'req-89000603-d241-4928-b9a5-5b530ecafebb'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:54.656051 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-89000603-d241-4928-b9a5-5b530ecafebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f602926be34bfa83535e8e6f178cf1', 'request_id': 'req-89000603-d241-4928-b9a5-5b530ecafebb'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:54.670298 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-89000603-d241-4928-b9a5-5b530ecafebb admin admin] The token cache is being invalidate because project 25f602926be34bfa83535e8e6f178cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:20:54.670979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-89000603-d241-4928-b9a5-5b530ecafebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:54.671875 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-89000603-d241-4928-b9a5-5b530ecafebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:54.674021 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 906/1817] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:20:54 2022] DELETE /identity/v3/projects/25f602926be34bfa83535e8e6f178cf1 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:54.682241 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d882d-a373-4986-85c4-f6ff873401a9 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:54.683141 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d882d-a373-4986-85c4-f6ff873401a9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:54.683823 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d882d-a373-4986-85c4-f6ff873401a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:54.710246 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89000603-d241-4928-b9a5-5b530ecafebb admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:54.713607 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-89000603-d241-4928-b9a5-5b530ecafebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:54.728969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d96d882d-a373-4986-85c4-f6ff873401a9 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:54.732609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d96d882d-a373-4986-85c4-f6ff873401a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:54.824362 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89000603-d241-4928-b9a5-5b530ecafebb admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:54.830571 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a67c4-1fe8-4fff-a0fc-7cdd9b0f0619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:54.832500 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a67c4-1fe8-4fff-a0fc-7cdd9b0f0619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:54.832899 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a67c4-1fe8-4fff-a0fc-7cdd9b0f0619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:54.833083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a67c4-1fe8-4fff-a0fc-7cdd9b0f0619 admin admin] PATH_INFO: `/v3/users/e52de011bb8e4e77a9b62b245e18f61b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:54.834465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a67c4-1fe8-4fff-a0fc-7cdd9b0f0619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e52de011bb8e4e77a9b62b245e18f61b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:54.836402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a67c4-1fe8-4fff-a0fc-7cdd9b0f0619 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:54.843395 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 912/1818] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:54.851726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a1119-f669-481c-ad15-e708c407b88e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:54.852926 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a1119-f669-481c-ad15-e708c407b88e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:54.853417 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a1119-f669-481c-ad15-e708c407b88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:54.904606 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-851a1119-f669-481c-ad15-e708c407b88e None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:54.906783 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-851a1119-f669-481c-ad15-e708c407b88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:54.917292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 913/1819] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:54.921729 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a1119-f669-481c-ad15-e708c407b88e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:54.935886 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a1119-f669-481c-ad15-e708c407b88e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:54.941124 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc39fe-0945-4979-8eae-dc52353f0c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:54.943101 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc39fe-0945-4979-8eae-dc52353f0c02 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:54.943723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc39fe-0945-4979-8eae-dc52353f0c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:54.944756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc39fe-0945-4979-8eae-dc52353f0c02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:54.945922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc39fe-0945-4979-8eae-dc52353f0c02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:20:54.946430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc39fe-0945-4979-8eae-dc52353f0c02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:54.948261 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc39fe-0945-4979-8eae-dc52353f0c02 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:54.961276 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 914/1820] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:20:54.965640 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc39fe-0945-4979-8eae-dc52353f0c02 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:54.977676 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc39fe-0945-4979-8eae-dc52353f0c02 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:54.982994 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b24bb-a6f6-4578-bb07-c2402865ac3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:54.983661 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b24bb-a6f6-4578-bb07-c2402865ac3e admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:54.984175 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b24bb-a6f6-4578-bb07-c2402865ac3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:54.984526 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b24bb-a6f6-4578-bb07-c2402865ac3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:54.985300 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b24bb-a6f6-4578-bb07-c2402865ac3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:54.987473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b24bb-a6f6-4578-bb07-c2402865ac3e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:55.125073 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 915/1821] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:54 2022] POST /identity/v3/projects => generated 391 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:20:55.136563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b24bb-a6f6-4578-bb07-c2402865ac3e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:55.147311 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-065a67c4-1fe8-4fff-a0fc-7cdd9b0f0619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e52de011bb8e4e77a9b62b245e18f61b'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:55.148065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-065a67c4-1fe8-4fff-a0fc-7cdd9b0f0619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e52de011bb8e4e77a9b62b245e18f61b'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:55.162104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-065a67c4-1fe8-4fff-a0fc-7cdd9b0f0619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e52de011bb8e4e77a9b62b245e18f61b'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:55.162848 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-065a67c4-1fe8-4fff-a0fc-7cdd9b0f0619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e52de011bb8e4e77a9b62b245e18f61b'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:55.170258 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-065a67c4-1fe8-4fff-a0fc-7cdd9b0f0619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e52de011bb8e4e77a9b62b245e18f61b'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:55.205136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b24bb-a6f6-4578-bb07-c2402865ac3e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:55.211115 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d095b19-303a-4216-a089-223206c97ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:55.211799 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d095b19-303a-4216-a089-223206c97ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:55.212087 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d095b19-303a-4216-a089-223206c97ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:55.212364 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d095b19-303a-4216-a089-223206c97ea0 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:55.213069 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d095b19-303a-4216-a089-223206c97ea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:55.215037 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d095b19-303a-4216-a089-223206c97ea0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:55.311958 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 916/1822] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:55 2022] POST /identity/v3/users => generated 296 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:55.316108 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d095b19-303a-4216-a089-223206c97ea0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:55.318736 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6d095b19-303a-4216-a089-223206c97ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:55.333584 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d095b19-303a-4216-a089-223206c97ea0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:55.338984 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44475c-6980-4957-b973-89bc2cbf6ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:55.339795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44475c-6980-4957-b973-89bc2cbf6ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:55.340083 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44475c-6980-4957-b973-89bc2cbf6ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:55.340654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44475c-6980-4957-b973-89bc2cbf6ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:55.341547 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44475c-6980-4957-b973-89bc2cbf6ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:55.343517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44475c-6980-4957-b973-89bc2cbf6ac0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:55.357781 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 917/1823] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:55.361459 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44475c-6980-4957-b973-89bc2cbf6ac0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:55.371755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44475c-6980-4957-b973-89bc2cbf6ac0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:55.376500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d1c35-22a0-4244-9b60-0bdf10442e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:55.377246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d1c35-22a0-4244-9b60-0bdf10442e64 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:55.377607 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d1c35-22a0-4244-9b60-0bdf10442e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:55.377965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d1c35-22a0-4244-9b60-0bdf10442e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:55.378808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d1c35-22a0-4244-9b60-0bdf10442e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:55.381144 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d1c35-22a0-4244-9b60-0bdf10442e64 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:55.392475 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 918/1824] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:20:55.404202 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d1c35-22a0-4244-9b60-0bdf10442e64 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:55.421132 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d1c35-22a0-4244-9b60-0bdf10442e64 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:55.431421 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d2a57-6050-4c56-bcf9-49e9e8b91dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:55.433614 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d2a57-6050-4c56-bcf9-49e9e8b91dab admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:55.434745 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d2a57-6050-4c56-bcf9-49e9e8b91dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:55.435478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d2a57-6050-4c56-bcf9-49e9e8b91dab admin admin] PATH_INFO: `/v3/projects/d9a6631661df4377a71d9826aec09c8b/users/0aa9c67fc049401ab8cb397b6771bf02/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:55.457357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d2a57-6050-4c56-bcf9-49e9e8b91dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a6631661df4377a71d9826aec09c8b, user_id=0aa9c67fc049401ab8cb397b6771bf02, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:55.462603 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d2a57-6050-4c56-bcf9-49e9e8b91dab admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:55.473926 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 907/1825] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:20:54 2022] DELETE /identity/v3/users/e52de011bb8e4e77a9b62b245e18f61b => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:55.478267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd00aa-f1b8-420e-b82c-67519409161d None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:55.478806 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd00aa-f1b8-420e-b82c-67519409161d None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:55.479445 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd00aa-f1b8-420e-b82c-67519409161d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:55.502018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-e3cd00aa-f1b8-420e-b82c-67519409161d None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:55.504000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e3cd00aa-f1b8-420e-b82c-67519409161d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:55.586647 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 919/1826] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:55 2022] PUT /identity/v3/projects/d9a6631661df4377a71d9826aec09c8b/users/0aa9c67fc049401ab8cb397b6771bf02/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:55.597121 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dabce-b107-4ced-b148-8bbea2fb2dd1 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:55.597675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dabce-b107-4ced-b148-8bbea2fb2dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:55.598316 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dabce-b107-4ced-b148-8bbea2fb2dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:55.615039 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 908/1827] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:20:55.641450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-384dabce-b107-4ced-b148-8bbea2fb2dd1 None None] MFA Rules not processed for user `0aa9c67fc049401ab8cb397b6771bf02`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:55.642776 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-384dabce-b107-4ced-b148-8bbea2fb2dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:55.700273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd00aa-f1b8-420e-b82c-67519409161d None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:55.702255 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e3cd00aa-f1b8-420e-b82c-67519409161d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:55.825066 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 920/1828] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:55.830732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dabce-b107-4ced-b148-8bbea2fb2dd1 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:55.862246 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd00aa-f1b8-420e-b82c-67519409161d None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:55.939972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dabce-b107-4ced-b148-8bbea2fb2dd1 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:55.955284 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce1fbb-46b7-4439-a2ac-b3d2a9017bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:55.955967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce1fbb-46b7-4439-a2ac-b3d2a9017bea admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:55.956257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce1fbb-46b7-4439-a2ac-b3d2a9017bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:55.956540 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce1fbb-46b7-4439-a2ac-b3d2a9017bea admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:55.957251 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce1fbb-46b7-4439-a2ac-b3d2a9017bea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:55.959764 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce1fbb-46b7-4439-a2ac-b3d2a9017bea admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:55.970479 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeeff5-0f81-4fc3-a2a9-658b620fa532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:55.971588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeeff5-0f81-4fc3-a2a9-658b620fa532 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:55.971588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeeff5-0f81-4fc3-a2a9-658b620fa532 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:55.971588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeeff5-0f81-4fc3-a2a9-658b620fa532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:55.990599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aeeff5-0f81-4fc3-a2a9-658b620fa532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:55.991776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aeeff5-0f81-4fc3-a2a9-658b620fa532 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:56.003424 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 909/1829] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:56.096840 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 921/1830] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:55 2022] POST /identity/v3/projects => generated 393 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:20:56.101186 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeeff5-0f81-4fc3-a2a9-658b620fa532 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:56.112884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeeff5-0f81-4fc3-a2a9-658b620fa532 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:56.200600 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d8c0c-3570-4017-a3c2-078c5d27dd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:56.201448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d8c0c-3570-4017-a3c2-078c5d27dd35 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:56.202076 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d8c0c-3570-4017-a3c2-078c5d27dd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:56.202202 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d8c0c-3570-4017-a3c2-078c5d27dd35 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:56.203179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d8c0c-3570-4017-a3c2-078c5d27dd35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:56.204913 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d8c0c-3570-4017-a3c2-078c5d27dd35 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:56.336192 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 910/1831] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:56 2022] POST /identity/v3/users => generated 303 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:20:56.337441 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce1fbb-46b7-4439-a2ac-b3d2a9017bea admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:56.351691 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce1fbb-46b7-4439-a2ac-b3d2a9017bea admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:56.358913 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f919855-64f9-4438-b994-c69d1a3aab04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:56.359700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f919855-64f9-4438-b994-c69d1a3aab04 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:56.360810 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f919855-64f9-4438-b994-c69d1a3aab04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:56.360810 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f919855-64f9-4438-b994-c69d1a3aab04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:56.361913 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f919855-64f9-4438-b994-c69d1a3aab04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:56.364304 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f919855-64f9-4438-b994-c69d1a3aab04 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:56.384886 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 922/1832] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:56.389222 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d8c0c-3570-4017-a3c2-078c5d27dd35 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:56.403034 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d8c0c-3570-4017-a3c2-078c5d27dd35 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:56.408889 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30e382-beef-4507-842d-9534e9896729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:56.411098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30e382-beef-4507-842d-9534e9896729 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:56.411548 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30e382-beef-4507-842d-9534e9896729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:56.411840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30e382-beef-4507-842d-9534e9896729 admin admin] PATH_INFO: `/v3/projects/9ba2b2f3226643ac904775596a772d8f/users/ed69393131d34bebabed41da40ad362c/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:56.438561 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30e382-beef-4507-842d-9534e9896729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba2b2f3226643ac904775596a772d8f, user_id=ed69393131d34bebabed41da40ad362c, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:56.443812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30e382-beef-4507-842d-9534e9896729 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:56.540167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 911/1833] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:56 2022] PUT /identity/v3/projects/9ba2b2f3226643ac904775596a772d8f/users/ed69393131d34bebabed41da40ad362c/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:56.544328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f919855-64f9-4438-b994-c69d1a3aab04 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:56.556958 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f919855-64f9-4438-b994-c69d1a3aab04 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:56.675884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9cd4de-321f-48f0-b1b8-fe33e29524e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:56.676786 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cd4de-321f-48f0-b1b8-fe33e29524e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:56.677201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cd4de-321f-48f0-b1b8-fe33e29524e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:56.677491 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cd4de-321f-48f0-b1b8-fe33e29524e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:56.678236 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9cd4de-321f-48f0-b1b8-fe33e29524e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:56.679865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9cd4de-321f-48f0-b1b8-fe33e29524e2 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:56.697555 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 923/1834] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:56.698121 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30e382-beef-4507-842d-9534e9896729 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:56.713316 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30e382-beef-4507-842d-9534e9896729 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:56.741035 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ab114-7579-4136-a659-0cc70d506f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:56.742086 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ab114-7579-4136-a659-0cc70d506f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:56.742462 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ab114-7579-4136-a659-0cc70d506f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:56.742814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ab114-7579-4136-a659-0cc70d506f70 admin admin] PATH_INFO: `/v3/projects/9ba2b2f3226643ac904775596a772d8f/users/ed69393131d34bebabed41da40ad362c/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:56.746142 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ab114-7579-4136-a659-0cc70d506f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba2b2f3226643ac904775596a772d8f, user_id=ed69393131d34bebabed41da40ad362c, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:56.752471 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ab114-7579-4136-a659-0cc70d506f70 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:56.767206 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 912/1835] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:56 2022] PUT /identity/v3/projects/9ba2b2f3226643ac904775596a772d8f/users/ed69393131d34bebabed41da40ad362c/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:56.778485 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6149b-ffcd-4c0d-bcba-7b98031b7308 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:56.778773 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6149b-ffcd-4c0d-bcba-7b98031b7308 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:56.779047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6149b-ffcd-4c0d-bcba-7b98031b7308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:56.835770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8fa6149b-ffcd-4c0d-bcba-7b98031b7308 None None] MFA Rules not processed for user `ed69393131d34bebabed41da40ad362c`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:56.838553 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8fa6149b-ffcd-4c0d-bcba-7b98031b7308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:56.893741 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ab114-7579-4136-a659-0cc70d506f70 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:56.899655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-962ab114-7579-4136-a659-0cc70d506f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:56.947488 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 924/1836] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:56.966141 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6149b-ffcd-4c0d-bcba-7b98031b7308 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:56.967065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8fa6149b-ffcd-4c0d-bcba-7b98031b7308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:57.017837 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ab114-7579-4136-a659-0cc70d506f70 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:57.025174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541f535-e1de-4c65-be42-9d297b96bea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:57.025399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541f535-e1de-4c65-be42-9d297b96bea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:57.025571 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541f535-e1de-4c65-be42-9d297b96bea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:57.025987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541f535-e1de-4c65-be42-9d297b96bea8 admin admin] PATH_INFO: `/v3/projects/b2fb61662f1f4759b66e089b045e0396` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:57.027367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541f535-e1de-4c65-be42-9d297b96bea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2fb61662f1f4759b66e089b045e0396)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:57.029457 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541f535-e1de-4c65-be42-9d297b96bea8 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:57.046581 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6149b-ffcd-4c0d-bcba-7b98031b7308 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:57.051813 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88309d97-fbc2-4a6a-860c-abd8a855312a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:57.052952 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88309d97-fbc2-4a6a-860c-abd8a855312a service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:57.053330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88309d97-fbc2-4a6a-860c-abd8a855312a service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:57.053792 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88309d97-fbc2-4a6a-860c-abd8a855312a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:57.065795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88309d97-fbc2-4a6a-860c-abd8a855312a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:57.068112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88309d97-fbc2-4a6a-860c-abd8a855312a service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:57.085095 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 925/1837] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:20:57.136025 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88309d97-fbc2-4a6a-860c-abd8a855312a service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:57.145911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88309d97-fbc2-4a6a-860c-abd8a855312a service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:57.158583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-1541f535-e1de-4c65-be42-9d297b96bea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2fb61662f1f4759b66e089b045e0396', 'request_id': 'req-1541f535-e1de-4c65-be42-9d297b96bea8'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:57.197626 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6e722-5314-464a-82a4-560743a53ea6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:57.198317 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6e722-5314-464a-82a4-560743a53ea6 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:57.198748 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6e722-5314-464a-82a4-560743a53ea6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:57.199033 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6e722-5314-464a-82a4-560743a53ea6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:57.224355 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-1541f535-e1de-4c65-be42-9d297b96bea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2fb61662f1f4759b66e089b045e0396', 'request_id': 'req-1541f535-e1de-4c65-be42-9d297b96bea8'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:57.232332 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-1541f535-e1de-4c65-be42-9d297b96bea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2fb61662f1f4759b66e089b045e0396', 'request_id': 'req-1541f535-e1de-4c65-be42-9d297b96bea8'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:57.246900 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-1541f535-e1de-4c65-be42-9d297b96bea8 admin admin] The token cache is being invalidate because project b2fb61662f1f4759b66e089b045e0396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:20:57.247189 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-1541f535-e1de-4c65-be42-9d297b96bea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:57.251995 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-1541f535-e1de-4c65-be42-9d297b96bea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:57.251995 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 913/1838] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:20:56 2022] DELETE /identity/v3/projects/b2fb61662f1f4759b66e089b045e0396 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:57.256645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541f535-e1de-4c65-be42-9d297b96bea8 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:57.258532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-1541f535-e1de-4c65-be42-9d297b96bea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:57.267525 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6e722-5314-464a-82a4-560743a53ea6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:57.269972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6e722-5314-464a-82a4-560743a53ea6 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:57.283193 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 926/1839] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:20:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:20:57.358180 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541f535-e1de-4c65-be42-9d297b96bea8 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:57.371932 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648326b-ee3d-4b4b-ab66-414d8b990b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:57.375907 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648326b-ee3d-4b4b-ab66-414d8b990b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:57.376317 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648326b-ee3d-4b4b-ab66-414d8b990b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:57.376702 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648326b-ee3d-4b4b-ab66-414d8b990b49 admin admin] PATH_INFO: `/v3/users/e07c42467b8c48959464d0d2a879fd51` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:57.378614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648326b-ee3d-4b4b-ab66-414d8b990b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e07c42467b8c48959464d0d2a879fd51)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:57.383685 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648326b-ee3d-4b4b-ab66-414d8b990b49 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:57.582177 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d648326b-ee3d-4b4b-ab66-414d8b990b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e07c42467b8c48959464d0d2a879fd51'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:57.583372 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d648326b-ee3d-4b4b-ab66-414d8b990b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e07c42467b8c48959464d0d2a879fd51'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:57.594954 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d648326b-ee3d-4b4b-ab66-414d8b990b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e07c42467b8c48959464d0d2a879fd51'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:57.595671 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d648326b-ee3d-4b4b-ab66-414d8b990b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e07c42467b8c48959464d0d2a879fd51'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:57.603265 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d648326b-ee3d-4b4b-ab66-414d8b990b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e07c42467b8c48959464d0d2a879fd51'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:57.684756 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 914/1840] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:20:57 2022] DELETE /identity/v3/users/e07c42467b8c48959464d0d2a879fd51 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:58.187892 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6e722-5314-464a-82a4-560743a53ea6 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:58.200826 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6e722-5314-464a-82a4-560743a53ea6 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:58.300325 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c881bb-4686-4e25-9655-290a6bfad871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:58.301808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c881bb-4686-4e25-9655-290a6bfad871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:58.302129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c881bb-4686-4e25-9655-290a6bfad871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:58.302530 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c881bb-4686-4e25-9655-290a6bfad871 admin admin] PATH_INFO: `/v3/projects/7fb276c2764940febf47b436f7dbcdd6` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:58.310739 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c881bb-4686-4e25-9655-290a6bfad871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb276c2764940febf47b436f7dbcdd6)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:58.312842 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c881bb-4686-4e25-9655-290a6bfad871 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:58.461678 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a1c881bb-4686-4e25-9655-290a6bfad871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb276c2764940febf47b436f7dbcdd6', 'request_id': 'req-a1c881bb-4686-4e25-9655-290a6bfad871'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:58.550290 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a1c881bb-4686-4e25-9655-290a6bfad871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb276c2764940febf47b436f7dbcdd6', 'request_id': 'req-a1c881bb-4686-4e25-9655-290a6bfad871'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:58.557953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a1c881bb-4686-4e25-9655-290a6bfad871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb276c2764940febf47b436f7dbcdd6', 'request_id': 'req-a1c881bb-4686-4e25-9655-290a6bfad871'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:58.570942 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a1c881bb-4686-4e25-9655-290a6bfad871 admin admin] The token cache is being invalidate because project 7fb276c2764940febf47b436f7dbcdd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:20:58.571651 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a1c881bb-4686-4e25-9655-290a6bfad871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:58.572433 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a1c881bb-4686-4e25-9655-290a6bfad871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:20:58.574087 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 927/1841] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:20:58 2022] DELETE /identity/v3/projects/7fb276c2764940febf47b436f7dbcdd6 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:20:58.578945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c76c2-8c6f-4ada-b9fe-f14c49a7953c None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:58.579244 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c76c2-8c6f-4ada-b9fe-f14c49a7953c None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:58.581011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c76c2-8c6f-4ada-b9fe-f14c49a7953c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:58.599238 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-e13c76c2-8c6f-4ada-b9fe-f14c49a7953c None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:58.600395 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e13c76c2-8c6f-4ada-b9fe-f14c49a7953c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:58.675259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 915/1842] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:58.684353 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ed7f4-15dc-4364-9f20-a2588beeab30 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:58.684646 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ed7f4-15dc-4364-9f20-a2588beeab30 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:58.684940 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ed7f4-15dc-4364-9f20-a2588beeab30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:58.704676 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7c3ed7f4-15dc-4364-9f20-a2588beeab30 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:58.705882 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7c3ed7f4-15dc-4364-9f20-a2588beeab30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:58.715815 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 928/1843] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:58.722304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c76c2-8c6f-4ada-b9fe-f14c49a7953c None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:58.733171 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c76c2-8c6f-4ada-b9fe-f14c49a7953c None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:58.738175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b15a0d-54cd-433c-abed-12cda29375cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:58.739864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b15a0d-54cd-433c-abed-12cda29375cf admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:58.740153 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b15a0d-54cd-433c-abed-12cda29375cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:58.740426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b15a0d-54cd-433c-abed-12cda29375cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:58.741169 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b15a0d-54cd-433c-abed-12cda29375cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:20:58.742566 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b15a0d-54cd-433c-abed-12cda29375cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:58.748098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b15a0d-54cd-433c-abed-12cda29375cf admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:58.758001 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 916/1844] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:20:58.763311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ed7f4-15dc-4364-9f20-a2588beeab30 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:58.773541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ed7f4-15dc-4364-9f20-a2588beeab30 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:58.780574 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e5c72-47f4-43b1-87aa-111063cd2a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:58.781240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e5c72-47f4-43b1-87aa-111063cd2a18 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:58.781530 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e5c72-47f4-43b1-87aa-111063cd2a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:58.781853 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e5c72-47f4-43b1-87aa-111063cd2a18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:58.782621 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e5c72-47f4-43b1-87aa-111063cd2a18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:58.784587 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e5c72-47f4-43b1-87aa-111063cd2a18 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:58.935111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 929/1845] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:58 2022] POST /identity/v3/projects => generated 399 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:20:58.940097 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b15a0d-54cd-433c-abed-12cda29375cf admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:58.956284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b15a0d-54cd-433c-abed-12cda29375cf admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:59.091317 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb6554-6f68-46d2-8ce5-846adf48afbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:59.092031 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb6554-6f68-46d2-8ce5-846adf48afbe admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:59.092315 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb6554-6f68-46d2-8ce5-846adf48afbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:59.092589 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb6554-6f68-46d2-8ce5-846adf48afbe admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:59.096960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb6554-6f68-46d2-8ce5-846adf48afbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:59.096960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb6554-6f68-46d2-8ce5-846adf48afbe admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:59.211611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 917/1846] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:58 2022] POST /identity/v3/users => generated 300 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:59.211923 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e5c72-47f4-43b1-87aa-111063cd2a18 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:59.225980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e5c72-47f4-43b1-87aa-111063cd2a18 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:59.232395 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1ca29-2541-4f12-b78b-a54d34191e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:59.233219 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1ca29-2541-4f12-b78b-a54d34191e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:59.233453 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1ca29-2541-4f12-b78b-a54d34191e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:59.234955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1ca29-2541-4f12-b78b-a54d34191e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:59.235985 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1ca29-2541-4f12-b78b-a54d34191e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:59.237946 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1ca29-2541-4f12-b78b-a54d34191e77 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:59.255408 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 930/1847] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:20:59.259444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb6554-6f68-46d2-8ce5-846adf48afbe admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:59.274693 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb6554-6f68-46d2-8ce5-846adf48afbe admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:59.279792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a7734-815e-45da-ae8a-1a4ad9f8560c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:59.280462 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a7734-815e-45da-ae8a-1a4ad9f8560c admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:59.280750 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a7734-815e-45da-ae8a-1a4ad9f8560c admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:59.281026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a7734-815e-45da-ae8a-1a4ad9f8560c admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:59.281764 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a7734-815e-45da-ae8a-1a4ad9f8560c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:59.283390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a7734-815e-45da-ae8a-1a4ad9f8560c admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:59.298232 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 918/1848] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:20:59.299460 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1ca29-2541-4f12-b78b-a54d34191e77 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:59.319542 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1ca29-2541-4f12-b78b-a54d34191e77 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:59.324236 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97575a7-62d0-446c-b291-b001898b0639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:59.325262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97575a7-62d0-446c-b291-b001898b0639 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:59.325633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97575a7-62d0-446c-b291-b001898b0639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:59.326021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97575a7-62d0-446c-b291-b001898b0639 admin admin] PATH_INFO: `/v3/projects/a10c5db586af475ab38bc2cd516e204a/users/cfa106b99cc84893a5151f44e15d6c00/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:59.347315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97575a7-62d0-446c-b291-b001898b0639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a10c5db586af475ab38bc2cd516e204a, user_id=cfa106b99cc84893a5151f44e15d6c00, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:59.350970 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97575a7-62d0-446c-b291-b001898b0639 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:59.431632 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 931/1849] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:20:59 2022] PUT /identity/v3/projects/a10c5db586af475ab38bc2cd516e204a/users/cfa106b99cc84893a5151f44e15d6c00/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:20:59.442989 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd16037-a20b-48a7-a1bc-2af78e1c892b None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:59.443286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd16037-a20b-48a7-a1bc-2af78e1c892b None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:59.443609 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd16037-a20b-48a7-a1bc-2af78e1c892b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:59.478847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-9bd16037-a20b-48a7-a1bc-2af78e1c892b None None] MFA Rules not processed for user `cfa106b99cc84893a5151f44e15d6c00`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:20:59.480089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-9bd16037-a20b-48a7-a1bc-2af78e1c892b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:59.558417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 919/1850] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:20:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:20:59.564113 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97575a7-62d0-446c-b291-b001898b0639 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:59.632075 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97575a7-62d0-446c-b291-b001898b0639 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:59.637021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be2ab8-7d2d-45ca-8ec1-dfcbef2dae0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:59.637677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be2ab8-7d2d-45ca-8ec1-dfcbef2dae0f admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:59.637963 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be2ab8-7d2d-45ca-8ec1-dfcbef2dae0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:59.638272 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be2ab8-7d2d-45ca-8ec1-dfcbef2dae0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:59.639053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be2ab8-7d2d-45ca-8ec1-dfcbef2dae0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:59.640913 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be2ab8-7d2d-45ca-8ec1-dfcbef2dae0f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:59.726137 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd16037-a20b-48a7-a1bc-2af78e1c892b None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:59.734050 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-9bd16037-a20b-48a7-a1bc-2af78e1c892b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:20:59.734181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 932/1851] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:20:59 2022] POST /identity/v3/projects => generated 399 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:20:59.735033 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be2ab8-7d2d-45ca-8ec1-dfcbef2dae0f admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:59.743631 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd16037-a20b-48a7-a1bc-2af78e1c892b None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:59.813037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b951b-6eed-4640-9c9d-03a1cf802a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:59.820943 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b951b-6eed-4640-9c9d-03a1cf802a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:59.820943 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b951b-6eed-4640-9c9d-03a1cf802a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:59.820943 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b951b-6eed-4640-9c9d-03a1cf802a73 admin admin] PATH_INFO: `/v3/users/5cbf8e77764a4416811cea46774f20c6` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:59.820943 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b951b-6eed-4640-9c9d-03a1cf802a73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cbf8e77764a4416811cea46774f20c6)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:59.821279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be2ab8-7d2d-45ca-8ec1-dfcbef2dae0f admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:59.821388 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b951b-6eed-4640-9c9d-03a1cf802a73 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:59.825047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd96fd7-ee44-409c-82e9-66dedcee1052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:59.826054 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd96fd7-ee44-409c-82e9-66dedcee1052 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:59.826054 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd96fd7-ee44-409c-82e9-66dedcee1052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:59.826502 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd96fd7-ee44-409c-82e9-66dedcee1052 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:59.827361 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd96fd7-ee44-409c-82e9-66dedcee1052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:59.829410 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd96fd7-ee44-409c-82e9-66dedcee1052 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:00.034498 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 933/1852] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:20:59 2022] POST /identity/v3/users => generated 306 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:21:00.041743 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd96fd7-ee44-409c-82e9-66dedcee1052 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:00.060357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd96fd7-ee44-409c-82e9-66dedcee1052 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:00.067971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f57b8-11a2-469f-b32b-a11261581db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:00.068746 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f57b8-11a2-469f-b32b-a11261581db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:00.069489 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f57b8-11a2-469f-b32b-a11261581db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:00.069489 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f57b8-11a2-469f-b32b-a11261581db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:00.070124 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f57b8-11a2-469f-b32b-a11261581db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:00.071788 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f57b8-11a2-469f-b32b-a11261581db1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:00.083618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 934/1853] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:21:00.088219 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f57b8-11a2-469f-b32b-a11261581db1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:00.101031 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f57b8-11a2-469f-b32b-a11261581db1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:00.106904 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e4204-1a93-4892-9053-25b350e3aeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:00.108590 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4204-1a93-4892-9053-25b350e3aeb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:00.108883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4204-1a93-4892-9053-25b350e3aeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:00.109166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4204-1a93-4892-9053-25b350e3aeb5 admin admin] PATH_INFO: `/v3/projects/736bab5598cb48748d703173ceb946b1/users/30cb4a1d23f94d1b8e1fc367aee8f2cf/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:00.109272 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-f75b951b-6eed-4640-9c9d-03a1cf802a73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cbf8e77764a4416811cea46774f20c6'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:00.109913 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-f75b951b-6eed-4640-9c9d-03a1cf802a73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cbf8e77764a4416811cea46774f20c6'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:00.125040 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-f75b951b-6eed-4640-9c9d-03a1cf802a73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cbf8e77764a4416811cea46774f20c6'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:00.125797 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-f75b951b-6eed-4640-9c9d-03a1cf802a73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cbf8e77764a4416811cea46774f20c6'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:00.134261 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e4204-1a93-4892-9053-25b350e3aeb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=736bab5598cb48748d703173ceb946b1, user_id=30cb4a1d23f94d1b8e1fc367aee8f2cf, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:00.137549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e4204-1a93-4892-9053-25b350e3aeb5 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:00.151717 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-f75b951b-6eed-4640-9c9d-03a1cf802a73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cbf8e77764a4416811cea46774f20c6'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:00.263265 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 920/1855] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:20:59 2022] DELETE /identity/v3/users/5cbf8e77764a4416811cea46774f20c6 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:21:00.265887 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 935/1854] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:00 2022] PUT /identity/v3/projects/736bab5598cb48748d703173ceb946b1/users/30cb4a1d23f94d1b8e1fc367aee8f2cf/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:00.266333 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b951b-6eed-4640-9c9d-03a1cf802a73 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:00.268679 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e440bb-442a-4ba9-a295-1c2ecf3f93b7 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:00.268960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e440bb-442a-4ba9-a295-1c2ecf3f93b7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:00.269242 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e440bb-442a-4ba9-a295-1c2ecf3f93b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:00.271804 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-f75b951b-6eed-4640-9c9d-03a1cf802a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:00.311835 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-c9e440bb-442a-4ba9-a295-1c2ecf3f93b7 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:00.313088 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c9e440bb-442a-4ba9-a295-1c2ecf3f93b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:00.373445 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b951b-6eed-4640-9c9d-03a1cf802a73 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:00.380258 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ef38b-b214-4f24-9db4-ff3085549f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:00.381133 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ef38b-b214-4f24-9db4-ff3085549f98 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:00.381525 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ef38b-b214-4f24-9db4-ff3085549f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:00.381909 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ef38b-b214-4f24-9db4-ff3085549f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:00.382992 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ef38b-b214-4f24-9db4-ff3085549f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:00.385511 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ef38b-b214-4f24-9db4-ff3085549f98 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:00.403534 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 921/1856] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:00.404491 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ef38b-b214-4f24-9db4-ff3085549f98 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:00.422139 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ef38b-b214-4f24-9db4-ff3085549f98 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:00.429078 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942ceea-bbe1-4a58-bc13-e86f4dfa0430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:00.430515 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942ceea-bbe1-4a58-bc13-e86f4dfa0430 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:00.431044 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942ceea-bbe1-4a58-bc13-e86f4dfa0430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:00.431694 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942ceea-bbe1-4a58-bc13-e86f4dfa0430 admin admin] PATH_INFO: `/v3/projects/736bab5598cb48748d703173ceb946b1/users/30cb4a1d23f94d1b8e1fc367aee8f2cf/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:00.434297 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942ceea-bbe1-4a58-bc13-e86f4dfa0430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=736bab5598cb48748d703173ceb946b1, user_id=30cb4a1d23f94d1b8e1fc367aee8f2cf, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:00.437511 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942ceea-bbe1-4a58-bc13-e86f4dfa0430 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:00.462030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 922/1857] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:00 2022] PUT /identity/v3/projects/736bab5598cb48748d703173ceb946b1/users/30cb4a1d23f94d1b8e1fc367aee8f2cf/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:00.463236 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 936/1858] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:00.475477 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ef054-3b40-44b2-b55a-975e6fbf67ea None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:00.476241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ef054-3b40-44b2-b55a-975e6fbf67ea None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:00.476727 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ef054-3b40-44b2-b55a-975e6fbf67ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:00.488192 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e440bb-442a-4ba9-a295-1c2ecf3f93b7 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:00.489650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c9e440bb-442a-4ba9-a295-1c2ecf3f93b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:00.552516 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-df0ef054-3b40-44b2-b55a-975e6fbf67ea None None] MFA Rules not processed for user `30cb4a1d23f94d1b8e1fc367aee8f2cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:00.554597 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-df0ef054-3b40-44b2-b55a-975e6fbf67ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:00.645252 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e440bb-442a-4ba9-a295-1c2ecf3f93b7 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:00.678612 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 923/1859] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:00 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:00.690527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ef054-3b40-44b2-b55a-975e6fbf67ea None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:00.692373 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-df0ef054-3b40-44b2-b55a-975e6fbf67ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:00.710008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01802b19-ff12-47f8-acd9-4b9136bb8566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:00.710696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01802b19-ff12-47f8-acd9-4b9136bb8566 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:00.710980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01802b19-ff12-47f8-acd9-4b9136bb8566 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:00.711634 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01802b19-ff12-47f8-acd9-4b9136bb8566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:00.772403 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ef054-3b40-44b2-b55a-975e6fbf67ea None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:00.777240 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb295f0-66f8-46f8-8fc2-51dac8b3b0af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:00.777857 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb295f0-66f8-46f8-8fc2-51dac8b3b0af service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:00.778132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb295f0-66f8-46f8-8fc2-51dac8b3b0af service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:00.779709 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb295f0-66f8-46f8-8fc2-51dac8b3b0af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:00.791538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb295f0-66f8-46f8-8fc2-51dac8b3b0af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:00.792979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb295f0-66f8-46f8-8fc2-51dac8b3b0af service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:00.800996 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01802b19-ff12-47f8-acd9-4b9136bb8566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:00.802747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01802b19-ff12-47f8-acd9-4b9136bb8566 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:00.803996 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 924/1860] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:00 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:21:00.813782 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 937/1861] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:21:01.059493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb295f0-66f8-46f8-8fc2-51dac8b3b0af service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:01.071729 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb295f0-66f8-46f8-8fc2-51dac8b3b0af service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:01.077614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47344633-1821-4d6d-9532-3c145b1d6325 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:01.077895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47344633-1821-4d6d-9532-3c145b1d6325 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:01.078484 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47344633-1821-4d6d-9532-3c145b1d6325 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:01.078662 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47344633-1821-4d6d-9532-3c145b1d6325 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:01.080594 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-47344633-1821-4d6d-9532-3c145b1d6325 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:01.154114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47344633-1821-4d6d-9532-3c145b1d6325 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:01.155744 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47344633-1821-4d6d-9532-3c145b1d6325 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:01.173340 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 925/1862] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:01.355293 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01802b19-ff12-47f8-acd9-4b9136bb8566 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:01.356741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-01802b19-ff12-47f8-acd9-4b9136bb8566 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:01.369511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01802b19-ff12-47f8-acd9-4b9136bb8566 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:01.380476 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692b04a-fe0b-4dc0-8ccd-b9637cae0129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:01.381359 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692b04a-fe0b-4dc0-8ccd-b9637cae0129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:01.381647 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692b04a-fe0b-4dc0-8ccd-b9637cae0129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:01.381926 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692b04a-fe0b-4dc0-8ccd-b9637cae0129 admin admin] PATH_INFO: `/v3/projects/b6928169fe5a4e14b286ec35fe91785c` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:01.383206 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692b04a-fe0b-4dc0-8ccd-b9637cae0129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6928169fe5a4e14b286ec35fe91785c)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:01.389129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692b04a-fe0b-4dc0-8ccd-b9637cae0129 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:01.516941 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3692b04a-fe0b-4dc0-8ccd-b9637cae0129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6928169fe5a4e14b286ec35fe91785c', 'request_id': 'req-3692b04a-fe0b-4dc0-8ccd-b9637cae0129'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:01.595845 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3692b04a-fe0b-4dc0-8ccd-b9637cae0129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6928169fe5a4e14b286ec35fe91785c', 'request_id': 'req-3692b04a-fe0b-4dc0-8ccd-b9637cae0129'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:01.602386 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3692b04a-fe0b-4dc0-8ccd-b9637cae0129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6928169fe5a4e14b286ec35fe91785c', 'request_id': 'req-3692b04a-fe0b-4dc0-8ccd-b9637cae0129'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:01.614315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3692b04a-fe0b-4dc0-8ccd-b9637cae0129 admin admin] The token cache is being invalidate because project b6928169fe5a4e14b286ec35fe91785c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:01.614633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3692b04a-fe0b-4dc0-8ccd-b9637cae0129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:01.615288 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3692b04a-fe0b-4dc0-8ccd-b9637cae0129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:01.616842 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 938/1863] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:01 2022] DELETE /identity/v3/projects/b6928169fe5a4e14b286ec35fe91785c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:01.620843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47344633-1821-4d6d-9532-3c145b1d6325 service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:01.632143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47344633-1821-4d6d-9532-3c145b1d6325 service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:01.690684 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de4cf2-96fc-41e7-8804-8fe2e9606200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:01.692213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de4cf2-96fc-41e7-8804-8fe2e9606200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:01.692507 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de4cf2-96fc-41e7-8804-8fe2e9606200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:01.692765 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de4cf2-96fc-41e7-8804-8fe2e9606200 admin admin] PATH_INFO: `/v3/users/ed78cbbfeb424022bfdd3758594572ee` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:01.694109 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de4cf2-96fc-41e7-8804-8fe2e9606200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed78cbbfeb424022bfdd3758594572ee)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:01.696023 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de4cf2-96fc-41e7-8804-8fe2e9606200 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:01.888834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e9de4cf2-96fc-41e7-8804-8fe2e9606200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed78cbbfeb424022bfdd3758594572ee'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:01.891818 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e9de4cf2-96fc-41e7-8804-8fe2e9606200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed78cbbfeb424022bfdd3758594572ee'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:01.934570 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e9de4cf2-96fc-41e7-8804-8fe2e9606200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed78cbbfeb424022bfdd3758594572ee'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:01.936419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e9de4cf2-96fc-41e7-8804-8fe2e9606200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed78cbbfeb424022bfdd3758594572ee'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:01.962276 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e9de4cf2-96fc-41e7-8804-8fe2e9606200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed78cbbfeb424022bfdd3758594572ee'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:02.073041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 926/1864] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:01 2022] DELETE /identity/v3/users/ed78cbbfeb424022bfdd3758594572ee => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:02.603590 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692b04a-fe0b-4dc0-8ccd-b9637cae0129 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:02.605818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3692b04a-fe0b-4dc0-8ccd-b9637cae0129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:02.631232 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692b04a-fe0b-4dc0-8ccd-b9637cae0129 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:02.704172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b069578-a908-46a8-ba7d-88cb60660824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:02.705200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b069578-a908-46a8-ba7d-88cb60660824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:02.705721 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b069578-a908-46a8-ba7d-88cb60660824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:02.706004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b069578-a908-46a8-ba7d-88cb60660824 admin admin] PATH_INFO: `/v3/users/0aa9c67fc049401ab8cb397b6771bf02` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:02.707902 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b069578-a908-46a8-ba7d-88cb60660824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa9c67fc049401ab8cb397b6771bf02)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:02.709959 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b069578-a908-46a8-ba7d-88cb60660824 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:02.791804 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de4cf2-96fc-41e7-8804-8fe2e9606200 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:02.793863 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e9de4cf2-96fc-41e7-8804-8fe2e9606200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:02.812029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de4cf2-96fc-41e7-8804-8fe2e9606200 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:02.818466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d860da6-7442-4c43-bddd-953e5090ad4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:02.819784 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d860da6-7442-4c43-bddd-953e5090ad4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:02.820383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d860da6-7442-4c43-bddd-953e5090ad4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:02.820809 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d860da6-7442-4c43-bddd-953e5090ad4c admin admin] PATH_INFO: `/v3/projects/8dc719e052654e7187c85e8eda18137d` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:02.822153 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d860da6-7442-4c43-bddd-953e5090ad4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc719e052654e7187c85e8eda18137d)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:02.824418 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d860da6-7442-4c43-bddd-953e5090ad4c admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:02.867259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9b069578-a908-46a8-ba7d-88cb60660824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa9c67fc049401ab8cb397b6771bf02'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:02.868240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9b069578-a908-46a8-ba7d-88cb60660824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa9c67fc049401ab8cb397b6771bf02'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:02.869429 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9b069578-a908-46a8-ba7d-88cb60660824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa9c67fc049401ab8cb397b6771bf02'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:02.885611 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9b069578-a908-46a8-ba7d-88cb60660824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa9c67fc049401ab8cb397b6771bf02'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:02.893010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9b069578-a908-46a8-ba7d-88cb60660824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa9c67fc049401ab8cb397b6771bf02'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:02.935976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-8d860da6-7442-4c43-bddd-953e5090ad4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc719e052654e7187c85e8eda18137d', 'request_id': 'req-8d860da6-7442-4c43-bddd-953e5090ad4c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:02.990492 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 939/1865] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:02 2022] DELETE /identity/v3/users/0aa9c67fc049401ab8cb397b6771bf02 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:21:02.995254 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d84ce-8f22-4142-88fc-5018058664fe None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:02.995254 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d84ce-8f22-4142-88fc-5018058664fe None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:02.995525 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d84ce-8f22-4142-88fc-5018058664fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:03.016686 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-ce0d84ce-8f22-4142-88fc-5018058664fe None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:03.017904 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ce0d84ce-8f22-4142-88fc-5018058664fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:03.058148 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-8d860da6-7442-4c43-bddd-953e5090ad4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc719e052654e7187c85e8eda18137d', 'request_id': 'req-8d860da6-7442-4c43-bddd-953e5090ad4c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:03.064993 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-8d860da6-7442-4c43-bddd-953e5090ad4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc719e052654e7187c85e8eda18137d', 'request_id': 'req-8d860da6-7442-4c43-bddd-953e5090ad4c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:03.081171 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-8d860da6-7442-4c43-bddd-953e5090ad4c admin admin] The token cache is being invalidate because project 8dc719e052654e7187c85e8eda18137d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:03.081510 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-8d860da6-7442-4c43-bddd-953e5090ad4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:03.083116 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-8d860da6-7442-4c43-bddd-953e5090ad4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:03.084643 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 940/1866] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:03.085385 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 927/1867] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:02 2022] DELETE /identity/v3/projects/8dc719e052654e7187c85e8eda18137d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:21:03.090385 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6421d-2243-4cdf-8e57-1ab5469e3d0b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:03.090808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6421d-2243-4cdf-8e57-1ab5469e3d0b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:03.093230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6421d-2243-4cdf-8e57-1ab5469e3d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:03.096350 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d860da6-7442-4c43-bddd-953e5090ad4c admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:03.099025 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-8d860da6-7442-4c43-bddd-953e5090ad4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:03.125620 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-41e6421d-2243-4cdf-8e57-1ab5469e3d0b None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:03.126858 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-41e6421d-2243-4cdf-8e57-1ab5469e3d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:03.135495 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 941/1868] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:03.150708 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64b0fb-59cf-4b8c-8d21-afc491a2cb13 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:03.151002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64b0fb-59cf-4b8c-8d21-afc491a2cb13 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:03.151281 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64b0fb-59cf-4b8c-8d21-afc491a2cb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:03.172688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-5d64b0fb-59cf-4b8c-8d21-afc491a2cb13 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:03.173871 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5d64b0fb-59cf-4b8c-8d21-afc491a2cb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:03.186615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 942/1869] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:03.186804 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d860da6-7442-4c43-bddd-953e5090ad4c admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:03.187100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64b0fb-59cf-4b8c-8d21-afc491a2cb13 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:03.197154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64b0fb-59cf-4b8c-8d21-afc491a2cb13 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:03.202257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27d831-da1d-4959-a50a-824b3cb6db06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:03.203125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27d831-da1d-4959-a50a-824b3cb6db06 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:03.203411 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27d831-da1d-4959-a50a-824b3cb6db06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:03.203685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27d831-da1d-4959-a50a-824b3cb6db06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:03.204438 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27d831-da1d-4959-a50a-824b3cb6db06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:21:03.204744 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27d831-da1d-4959-a50a-824b3cb6db06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:03.206484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27d831-da1d-4959-a50a-824b3cb6db06 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:03.220511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 943/1870] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:21:03.226352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27d831-da1d-4959-a50a-824b3cb6db06 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:03.237138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27d831-da1d-4959-a50a-824b3cb6db06 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:03.244762 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3531dae-8b2f-4d49-928b-6d29be26b4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:03.246361 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3531dae-8b2f-4d49-928b-6d29be26b4fa admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:03.246655 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3531dae-8b2f-4d49-928b-6d29be26b4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:03.246933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3531dae-8b2f-4d49-928b-6d29be26b4fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:03.248456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3531dae-8b2f-4d49-928b-6d29be26b4fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:03.250474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957534ba-dd9d-4a4e-8b8e-d0d60483e52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:03.251005 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957534ba-dd9d-4a4e-8b8e-d0d60483e52e service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:03.251284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957534ba-dd9d-4a4e-8b8e-d0d60483e52e service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:03.251563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957534ba-dd9d-4a4e-8b8e-d0d60483e52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:03.253234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3531dae-8b2f-4d49-928b-6d29be26b4fa admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:03.254128 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-957534ba-dd9d-4a4e-8b8e-d0d60483e52e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:03.267593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957534ba-dd9d-4a4e-8b8e-d0d60483e52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:03.278961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957534ba-dd9d-4a4e-8b8e-d0d60483e52e service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:03.290652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 928/1871] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:21:03.375196 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 944/1872] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:21:03 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:21:03.380206 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957534ba-dd9d-4a4e-8b8e-d0d60483e52e service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:03.390162 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957534ba-dd9d-4a4e-8b8e-d0d60483e52e service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:03.456917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98132d40-3fac-48fb-b586-3d9fa0e0bb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:03.458125 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98132d40-3fac-48fb-b586-3d9fa0e0bb6f admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:03.458733 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98132d40-3fac-48fb-b586-3d9fa0e0bb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:03.458830 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98132d40-3fac-48fb-b586-3d9fa0e0bb6f admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:03.459494 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98132d40-3fac-48fb-b586-3d9fa0e0bb6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:03.461399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98132d40-3fac-48fb-b586-3d9fa0e0bb6f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:03.547161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 929/1873] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:21:03 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:03.548589 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3531dae-8b2f-4d49-928b-6d29be26b4fa admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:03.559717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3531dae-8b2f-4d49-928b-6d29be26b4fa admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:03.565784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78e1d2-7f7b-4202-8638-417d3c1f37fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:03.567047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78e1d2-7f7b-4202-8638-417d3c1f37fb admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:03.567318 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78e1d2-7f7b-4202-8638-417d3c1f37fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:03.567765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78e1d2-7f7b-4202-8638-417d3c1f37fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:03.568509 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78e1d2-7f7b-4202-8638-417d3c1f37fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:03.570109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78e1d2-7f7b-4202-8638-417d3c1f37fb admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:03.581630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 945/1874] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:21:03.586045 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98132d40-3fac-48fb-b586-3d9fa0e0bb6f admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:03.597084 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98132d40-3fac-48fb-b586-3d9fa0e0bb6f admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:03.602870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef7fa9-b17a-4095-85cc-f5e5632aae9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:03.603714 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef7fa9-b17a-4095-85cc-f5e5632aae9f admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:03.604090 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef7fa9-b17a-4095-85cc-f5e5632aae9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:03.604266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef7fa9-b17a-4095-85cc-f5e5632aae9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:03.605140 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef7fa9-b17a-4095-85cc-f5e5632aae9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:03.606666 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef7fa9-b17a-4095-85cc-f5e5632aae9f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:03.625327 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 930/1875] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:03.626475 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78e1d2-7f7b-4202-8638-417d3c1f37fb admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:03.642795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78e1d2-7f7b-4202-8638-417d3c1f37fb admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:03.652412 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43de6d-3414-4356-b34b-55900e85730f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:03.660360 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43de6d-3414-4356-b34b-55900e85730f admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:03.660360 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43de6d-3414-4356-b34b-55900e85730f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:03.660360 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43de6d-3414-4356-b34b-55900e85730f admin admin] PATH_INFO: `/v3/projects/2511b668e041436b9a6dcd4a4fe6c9e8/users/03a44252946a49049268cbaf1af66342/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:03.681852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43de6d-3414-4356-b34b-55900e85730f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2511b668e041436b9a6dcd4a4fe6c9e8, user_id=03a44252946a49049268cbaf1af66342, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:03.684601 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43de6d-3414-4356-b34b-55900e85730f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:03.732931 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef7fa9-b17a-4095-85cc-f5e5632aae9f admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:03.732931 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-61ef7fa9-b17a-4095-85cc-f5e5632aae9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:03.768163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef7fa9-b17a-4095-85cc-f5e5632aae9f admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:03.768849 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 946/1876] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:03 2022] PUT /identity/v3/projects/2511b668e041436b9a6dcd4a4fe6c9e8/users/03a44252946a49049268cbaf1af66342/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:03.771435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded29f6-ac78-4af3-8b2e-b61e39db50a7 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:03.771843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded29f6-ac78-4af3-8b2e-b61e39db50a7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:03.772022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded29f6-ac78-4af3-8b2e-b61e39db50a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:03.810756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7ded29f6-ac78-4af3-8b2e-b61e39db50a7 None None] MFA Rules not processed for user `03a44252946a49049268cbaf1af66342`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:03.811981 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7ded29f6-ac78-4af3-8b2e-b61e39db50a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:03.909055 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b7822-e9e1-403d-b12a-71537ba3778d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:03.910557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b7822-e9e1-403d-b12a-71537ba3778d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:03.911244 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b7822-e9e1-403d-b12a-71537ba3778d admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:03.911453 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 947/1877] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:03.911938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b7822-e9e1-403d-b12a-71537ba3778d admin admin] PATH_INFO: `/v3/projects/d9a6631661df4377a71d9826aec09c8b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:03.913476 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b7822-e9e1-403d-b12a-71537ba3778d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a6631661df4377a71d9826aec09c8b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:03.916490 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b7822-e9e1-403d-b12a-71537ba3778d admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:03.919699 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded29f6-ac78-4af3-8b2e-b61e39db50a7 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:03.939473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded29f6-ac78-4af3-8b2e-b61e39db50a7 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:03.969788 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abbb91-7951-4069-a52b-c7910c5ca67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:03.970707 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abbb91-7951-4069-a52b-c7910c5ca67e admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:03.970937 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abbb91-7951-4069-a52b-c7910c5ca67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:03.971069 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abbb91-7951-4069-a52b-c7910c5ca67e admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:03.972223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abbb91-7951-4069-a52b-c7910c5ca67e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:03.974080 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abbb91-7951-4069-a52b-c7910c5ca67e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:04.008676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4c5b7822-e9e1-403d-b12a-71537ba3778d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a6631661df4377a71d9826aec09c8b', 'request_id': 'req-4c5b7822-e9e1-403d-b12a-71537ba3778d'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:04.043351 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 948/1878] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:21:03 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:21:04.045614 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abbb91-7951-4069-a52b-c7910c5ca67e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:04.047824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4c5b7822-e9e1-403d-b12a-71537ba3778d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a6631661df4377a71d9826aec09c8b', 'request_id': 'req-4c5b7822-e9e1-403d-b12a-71537ba3778d'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:04.057101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4c5b7822-e9e1-403d-b12a-71537ba3778d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a6631661df4377a71d9826aec09c8b', 'request_id': 'req-4c5b7822-e9e1-403d-b12a-71537ba3778d'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:04.075198 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4c5b7822-e9e1-403d-b12a-71537ba3778d admin admin] The token cache is being invalidate because project d9a6631661df4377a71d9826aec09c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:04.075762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4c5b7822-e9e1-403d-b12a-71537ba3778d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:04.076633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4c5b7822-e9e1-403d-b12a-71537ba3778d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:04.078647 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 931/1879] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:03 2022] DELETE /identity/v3/projects/d9a6631661df4377a71d9826aec09c8b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:21:04.088890 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b7822-e9e1-403d-b12a-71537ba3778d admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:04.093278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4c5b7822-e9e1-403d-b12a-71537ba3778d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:04.149562 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abbb91-7951-4069-a52b-c7910c5ca67e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:04.161397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee54e6-9ed1-4e37-a6bc-c89e8f7aa8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:04.161397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee54e6-9ed1-4e37-a6bc-c89e8f7aa8eb admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:04.161397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee54e6-9ed1-4e37-a6bc-c89e8f7aa8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:04.161397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee54e6-9ed1-4e37-a6bc-c89e8f7aa8eb admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:04.162487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee54e6-9ed1-4e37-a6bc-c89e8f7aa8eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:04.166161 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee54e6-9ed1-4e37-a6bc-c89e8f7aa8eb admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:04.173596 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b7822-e9e1-403d-b12a-71537ba3778d admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:04.178914 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f594c-3362-47c1-a7eb-9d4868bb0c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:04.179927 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f594c-3362-47c1-a7eb-9d4868bb0c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:04.180955 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f594c-3362-47c1-a7eb-9d4868bb0c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:04.180955 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f594c-3362-47c1-a7eb-9d4868bb0c8b admin admin] PATH_INFO: `/v3/users/ed69393131d34bebabed41da40ad362c` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:04.182092 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f594c-3362-47c1-a7eb-9d4868bb0c8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed69393131d34bebabed41da40ad362c)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:04.184602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f594c-3362-47c1-a7eb-9d4868bb0c8b admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:04.248523 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 949/1880] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:21:04 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:21:04.251843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee54e6-9ed1-4e37-a6bc-c89e8f7aa8eb admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:04.260456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7aee54e6-9ed1-4e37-a6bc-c89e8f7aa8eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:04.272890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee54e6-9ed1-4e37-a6bc-c89e8f7aa8eb admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:04.277766 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186c43a-427b-49ab-9f82-1838f6b0a468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:04.281864 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186c43a-427b-49ab-9f82-1838f6b0a468 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:04.281864 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186c43a-427b-49ab-9f82-1838f6b0a468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:04.281864 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186c43a-427b-49ab-9f82-1838f6b0a468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:04.281864 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186c43a-427b-49ab-9f82-1838f6b0a468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:04.281864 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186c43a-427b-49ab-9f82-1838f6b0a468 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:04.293489 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 950/1881] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:21:04.297351 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186c43a-427b-49ab-9f82-1838f6b0a468 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:04.307296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186c43a-427b-49ab-9f82-1838f6b0a468 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:04.312069 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382a886-c051-4658-ac9f-01f9921aeb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:04.315352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382a886-c051-4658-ac9f-01f9921aeb12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:04.315352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382a886-c051-4658-ac9f-01f9921aeb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:04.315352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382a886-c051-4658-ac9f-01f9921aeb12 admin admin] PATH_INFO: `/v3/projects/59d52b81ac0b47cca775cb03941026f3/users/7f9d4676f3b148a59099c08e01cc66d0/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:04.330204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382a886-c051-4658-ac9f-01f9921aeb12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d52b81ac0b47cca775cb03941026f3, user_id=7f9d4676f3b148a59099c08e01cc66d0, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:04.333733 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382a886-c051-4658-ac9f-01f9921aeb12 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:04.425673 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 951/1882] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:04 2022] PUT /identity/v3/projects/59d52b81ac0b47cca775cb03941026f3/users/7f9d4676f3b148a59099c08e01cc66d0/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:04.429315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382a886-c051-4658-ac9f-01f9921aeb12 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:04.435075 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2b5f594c-3362-47c1-a7eb-9d4868bb0c8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed69393131d34bebabed41da40ad362c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:04.435738 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2b5f594c-3362-47c1-a7eb-9d4868bb0c8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed69393131d34bebabed41da40ad362c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:04.449040 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2b5f594c-3362-47c1-a7eb-9d4868bb0c8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed69393131d34bebabed41da40ad362c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:04.449763 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2b5f594c-3362-47c1-a7eb-9d4868bb0c8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed69393131d34bebabed41da40ad362c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:04.457560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2b5f594c-3362-47c1-a7eb-9d4868bb0c8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed69393131d34bebabed41da40ad362c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:04.509995 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382a886-c051-4658-ac9f-01f9921aeb12 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:04.515343 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6d7a9-5d7a-4e9a-89a5-2d971a095028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:04.516110 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6d7a9-5d7a-4e9a-89a5-2d971a095028 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:04.516501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6d7a9-5d7a-4e9a-89a5-2d971a095028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:04.516868 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6d7a9-5d7a-4e9a-89a5-2d971a095028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:04.517777 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6d7a9-5d7a-4e9a-89a5-2d971a095028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:04.519968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6d7a9-5d7a-4e9a-89a5-2d971a095028 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:04.525237 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 932/1883] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:04 2022] DELETE /identity/v3/users/ed69393131d34bebabed41da40ad362c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:04.546430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 952/1884] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:21:04.551145 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f594c-3362-47c1-a7eb-9d4868bb0c8b admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:04.552742 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-2b5f594c-3362-47c1-a7eb-9d4868bb0c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:04.633350 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f594c-3362-47c1-a7eb-9d4868bb0c8b admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:04.638340 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490440ca-95e3-4060-b840-b08b73a6e9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:04.639278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490440ca-95e3-4060-b840-b08b73a6e9ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:04.639564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490440ca-95e3-4060-b840-b08b73a6e9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:04.639858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490440ca-95e3-4060-b840-b08b73a6e9ad admin admin] PATH_INFO: `/v3/projects/59d52b81ac0b47cca775cb03941026f3/users/7f9d4676f3b148a59099c08e01cc66d0/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:04.642112 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490440ca-95e3-4060-b840-b08b73a6e9ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d52b81ac0b47cca775cb03941026f3, user_id=7f9d4676f3b148a59099c08e01cc66d0, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:04.646712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490440ca-95e3-4060-b840-b08b73a6e9ad admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:04.656755 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 933/1885] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:04 2022] PUT /identity/v3/projects/59d52b81ac0b47cca775cb03941026f3/users/7f9d4676f3b148a59099c08e01cc66d0/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:04.667419 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc51da-43fe-45c0-b021-9304aec36cfc None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:04.670281 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc51da-43fe-45c0-b021-9304aec36cfc None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:04.670610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc51da-43fe-45c0-b021-9304aec36cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:04.696231 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-42bc51da-43fe-45c0-b021-9304aec36cfc None None] MFA Rules not processed for user `7f9d4676f3b148a59099c08e01cc66d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:04.697424 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-42bc51da-43fe-45c0-b021-9304aec36cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:04.771530 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 953/1886] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:04.781712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490440ca-95e3-4060-b840-b08b73a6e9ad admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:04.784829 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-490440ca-95e3-4060-b840-b08b73a6e9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:04.848226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490440ca-95e3-4060-b840-b08b73a6e9ad admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:04.852460 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b390ed-5e07-417e-847d-319b04dd73a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:04.853120 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b390ed-5e07-417e-847d-319b04dd73a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:04.853406 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b390ed-5e07-417e-847d-319b04dd73a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:04.853670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b390ed-5e07-417e-847d-319b04dd73a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:04.863791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b390ed-5e07-417e-847d-319b04dd73a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:04.865211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b390ed-5e07-417e-847d-319b04dd73a8 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:04.876085 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 934/1887] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:21:05.010571 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc51da-43fe-45c0-b021-9304aec36cfc None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:05.023565 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc51da-43fe-45c0-b021-9304aec36cfc None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:05.027522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a539297-ab3a-4053-a176-aae00c9f10f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:05.028236 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a539297-ab3a-4053-a176-aae00c9f10f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:05.028593 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a539297-ab3a-4053-a176-aae00c9f10f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:05.028946 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a539297-ab3a-4053-a176-aae00c9f10f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:05.030962 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0a539297-ab3a-4053-a176-aae00c9f10f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:05.055585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b390ed-5e07-417e-847d-319b04dd73a8 service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:05.058042 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-05b390ed-5e07-417e-847d-319b04dd73a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:05.125930 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a539297-ab3a-4053-a176-aae00c9f10f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:05.127805 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a539297-ab3a-4053-a176-aae00c9f10f8 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:05.142631 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b390ed-5e07-417e-847d-319b04dd73a8 service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:05.154463 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 954/1888] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:21:05.159286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bdb4a-7092-4f30-b8e7-3c758d53d2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:05.163538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bdb4a-7092-4f30-b8e7-3c758d53d2f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:05.163829 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bdb4a-7092-4f30-b8e7-3c758d53d2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:05.164461 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bdb4a-7092-4f30-b8e7-3c758d53d2f0 admin admin] PATH_INFO: `/v3/projects/9ba2b2f3226643ac904775596a772d8f` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:05.166060 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bdb4a-7092-4f30-b8e7-3c758d53d2f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba2b2f3226643ac904775596a772d8f)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:05.169527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bdb4a-7092-4f30-b8e7-3c758d53d2f0 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:05.304754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3c9bdb4a-7092-4f30-b8e7-3c758d53d2f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba2b2f3226643ac904775596a772d8f', 'request_id': 'req-3c9bdb4a-7092-4f30-b8e7-3c758d53d2f0'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:05.378512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3c9bdb4a-7092-4f30-b8e7-3c758d53d2f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba2b2f3226643ac904775596a772d8f', 'request_id': 'req-3c9bdb4a-7092-4f30-b8e7-3c758d53d2f0'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:05.385019 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3c9bdb4a-7092-4f30-b8e7-3c758d53d2f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba2b2f3226643ac904775596a772d8f', 'request_id': 'req-3c9bdb4a-7092-4f30-b8e7-3c758d53d2f0'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:05.397704 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3c9bdb4a-7092-4f30-b8e7-3c758d53d2f0 admin admin] The token cache is being invalidate because project 9ba2b2f3226643ac904775596a772d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:05.397994 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3c9bdb4a-7092-4f30-b8e7-3c758d53d2f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:05.398668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3c9bdb4a-7092-4f30-b8e7-3c758d53d2f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:05.400264 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 935/1889] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:05 2022] DELETE /identity/v3/projects/9ba2b2f3226643ac904775596a772d8f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:05.405074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ec01d-d91e-4884-b16f-829d173cb3a5 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:05.405373 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ec01d-d91e-4884-b16f-829d173cb3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:05.405652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ec01d-d91e-4884-b16f-829d173cb3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:05.427346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-3d9ec01d-d91e-4884-b16f-829d173cb3a5 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:05.428581 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3d9ec01d-d91e-4884-b16f-829d173cb3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:05.513085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 955/1890] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:05.526353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c1b16-ec54-4778-a076-3433650351c7 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:05.526836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c1b16-ec54-4778-a076-3433650351c7 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:05.527225 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c1b16-ec54-4778-a076-3433650351c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:05.559545 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-6c7c1b16-ec54-4778-a076-3433650351c7 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:05.560899 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-6c7c1b16-ec54-4778-a076-3433650351c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:05.570218 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 936/1891] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:05.574151 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ec01d-d91e-4884-b16f-829d173cb3a5 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:05.584526 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ec01d-d91e-4884-b16f-829d173cb3a5 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:05.590785 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44221719-704b-41bf-87ad-5ca6d381b7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:05.591705 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44221719-704b-41bf-87ad-5ca6d381b7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:05.591826 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44221719-704b-41bf-87ad-5ca6d381b7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:05.592433 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44221719-704b-41bf-87ad-5ca6d381b7f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:05.592821 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44221719-704b-41bf-87ad-5ca6d381b7f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:21:05.593176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44221719-704b-41bf-87ad-5ca6d381b7f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:05.594957 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44221719-704b-41bf-87ad-5ca6d381b7f7 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:05.613502 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 956/1892] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:21:05.615207 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c1b16-ec54-4778-a076-3433650351c7 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:05.624536 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c1b16-ec54-4778-a076-3433650351c7 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:05.630716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1283bdf-0634-44f9-a174-c3fb0a8d8c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:05.631525 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1283bdf-0634-44f9-a174-c3fb0a8d8c96 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:05.631886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1283bdf-0634-44f9-a174-c3fb0a8d8c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:05.632237 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1283bdf-0634-44f9-a174-c3fb0a8d8c96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:05.633009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1283bdf-0634-44f9-a174-c3fb0a8d8c96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:05.635431 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1283bdf-0634-44f9-a174-c3fb0a8d8c96 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:05.714835 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 937/1893] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:21:05 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:21:05.715933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44221719-704b-41bf-87ad-5ca6d381b7f7 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:05.726330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44221719-704b-41bf-87ad-5ca6d381b7f7 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:05.792922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27a5c5-2a72-4047-8070-faaef814ddc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:05.793625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27a5c5-2a72-4047-8070-faaef814ddc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:05.793910 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27a5c5-2a72-4047-8070-faaef814ddc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:05.794187 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27a5c5-2a72-4047-8070-faaef814ddc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:05.794927 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27a5c5-2a72-4047-8070-faaef814ddc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:05.796827 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27a5c5-2a72-4047-8070-faaef814ddc3 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:05.884386 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 957/1894] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:21:05 2022] POST /identity/v3/users => generated 290 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:21:05.888886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1283bdf-0634-44f9-a174-c3fb0a8d8c96 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:05.904685 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1283bdf-0634-44f9-a174-c3fb0a8d8c96 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:05.912408 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be2a75-05bc-4c9e-a35c-6f15da6cdfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:05.913365 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be2a75-05bc-4c9e-a35c-6f15da6cdfda admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:05.913796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be2a75-05bc-4c9e-a35c-6f15da6cdfda admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:05.914303 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be2a75-05bc-4c9e-a35c-6f15da6cdfda admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:05.915330 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be2a75-05bc-4c9e-a35c-6f15da6cdfda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:05.917310 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be2a75-05bc-4c9e-a35c-6f15da6cdfda admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:05.930607 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 938/1895] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:05.934084 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27a5c5-2a72-4047-8070-faaef814ddc3 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:05.950554 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27a5c5-2a72-4047-8070-faaef814ddc3 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:05.957083 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e662a-ceea-4669-942b-92d6b5763600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:05.959167 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e662a-ceea-4669-942b-92d6b5763600 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:05.959661 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e662a-ceea-4669-942b-92d6b5763600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:05.960084 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e662a-ceea-4669-942b-92d6b5763600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:05.961085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e662a-ceea-4669-942b-92d6b5763600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:05.963406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e662a-ceea-4669-942b-92d6b5763600 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:05.984304 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 958/1896] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:05.997880 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be2a75-05bc-4c9e-a35c-6f15da6cdfda admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:06.009392 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be2a75-05bc-4c9e-a35c-6f15da6cdfda admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:06.022820 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae18f7-93db-4559-97ef-c42b932b3a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:06.023799 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae18f7-93db-4559-97ef-c42b932b3a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:06.024086 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae18f7-93db-4559-97ef-c42b932b3a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:06.024423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae18f7-93db-4559-97ef-c42b932b3a37 admin admin] PATH_INFO: `/v3/projects/c876fbf9b3654532955a2076d627d053/users/5563088a57044b0e81f23c0f24a221f0/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:06.048101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae18f7-93db-4559-97ef-c42b932b3a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c876fbf9b3654532955a2076d627d053, user_id=5563088a57044b0e81f23c0f24a221f0, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:06.052327 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae18f7-93db-4559-97ef-c42b932b3a37 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:06.145973 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49245ee4-7c4b-458f-bf23-d601fae521df None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:06.146677 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 939/1897] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:05 2022] PUT /identity/v3/projects/c876fbf9b3654532955a2076d627d053/users/5563088a57044b0e81f23c0f24a221f0/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:06.147163 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49245ee4-7c4b-458f-bf23-d601fae521df None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:06.147163 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49245ee4-7c4b-458f-bf23-d601fae521df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:06.188138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-49245ee4-7c4b-458f-bf23-d601fae521df None None] MFA Rules not processed for user `5563088a57044b0e81f23c0f24a221f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:06.189364 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-49245ee4-7c4b-458f-bf23-d601fae521df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:06.262646 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 959/1898] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:06.265337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae18f7-93db-4559-97ef-c42b932b3a37 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:06.314023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49245ee4-7c4b-458f-bf23-d601fae521df None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:06.315553 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-49245ee4-7c4b-458f-bf23-d601fae521df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:06.342089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae18f7-93db-4559-97ef-c42b932b3a37 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:06.347025 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999cd56-7b18-4047-9352-46c2fa6727f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:06.348954 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999cd56-7b18-4047-9352-46c2fa6727f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:06.349341 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999cd56-7b18-4047-9352-46c2fa6727f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:06.349624 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999cd56-7b18-4047-9352-46c2fa6727f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:06.350325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999cd56-7b18-4047-9352-46c2fa6727f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:06.352269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999cd56-7b18-4047-9352-46c2fa6727f9 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:06.392045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49245ee4-7c4b-458f-bf23-d601fae521df None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:06.397526 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b4713-c0a6-403c-accc-617f22e25e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:06.398420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b4713-c0a6-403c-accc-617f22e25e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:06.398730 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b4713-c0a6-403c-accc-617f22e25e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:06.399006 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b4713-c0a6-403c-accc-617f22e25e20 admin admin] PATH_INFO: `/v3/users/cfa106b99cc84893a5151f44e15d6c00` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:06.400332 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b4713-c0a6-403c-accc-617f22e25e20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfa106b99cc84893a5151f44e15d6c00)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:06.402272 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b4713-c0a6-403c-accc-617f22e25e20 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:06.426302 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 940/1899] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:21:06 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:06.429282 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999cd56-7b18-4047-9352-46c2fa6727f9 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:06.498610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999cd56-7b18-4047-9352-46c2fa6727f9 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:06.503433 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3a184-b4de-4fef-9df2-6ad45c333ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:06.504818 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3a184-b4de-4fef-9df2-6ad45c333ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:06.505978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3a184-b4de-4fef-9df2-6ad45c333ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:06.505978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3a184-b4de-4fef-9df2-6ad45c333ee7 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:06.506147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3a184-b4de-4fef-9df2-6ad45c333ee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:06.508066 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3a184-b4de-4fef-9df2-6ad45c333ee7 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:06.594316 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-fd5b4713-c0a6-403c-accc-617f22e25e20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfa106b99cc84893a5151f44e15d6c00'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:06.595688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-fd5b4713-c0a6-403c-accc-617f22e25e20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfa106b99cc84893a5151f44e15d6c00'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:06.595809 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-fd5b4713-c0a6-403c-accc-617f22e25e20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfa106b99cc84893a5151f44e15d6c00'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:06.609874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-fd5b4713-c0a6-403c-accc-617f22e25e20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfa106b99cc84893a5151f44e15d6c00'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:06.612703 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 941/1900] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:21:06 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:21:06.617437 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3a184-b4de-4fef-9df2-6ad45c333ee7 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:06.620091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-8fb3a184-b4de-4fef-9df2-6ad45c333ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:06.622120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-fd5b4713-c0a6-403c-accc-617f22e25e20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfa106b99cc84893a5151f44e15d6c00'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:06.634883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3a184-b4de-4fef-9df2-6ad45c333ee7 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:06.640204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429ee02-951b-4961-99b9-18ce0f3c79f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:06.641027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429ee02-951b-4961-99b9-18ce0f3c79f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:06.641413 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429ee02-951b-4961-99b9-18ce0f3c79f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:06.641800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429ee02-951b-4961-99b9-18ce0f3c79f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:06.642672 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429ee02-951b-4961-99b9-18ce0f3c79f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:06.645516 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429ee02-951b-4961-99b9-18ce0f3c79f5 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:06.658796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 942/1901] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:06.661790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429ee02-951b-4961-99b9-18ce0f3c79f5 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:06.682105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429ee02-951b-4961-99b9-18ce0f3c79f5 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:06.686341 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9edcd-a316-474c-8ebb-306ce4dbd118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:06.687481 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9edcd-a316-474c-8ebb-306ce4dbd118 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:06.687914 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9edcd-a316-474c-8ebb-306ce4dbd118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:06.688470 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9edcd-a316-474c-8ebb-306ce4dbd118 admin admin] PATH_INFO: `/v3/projects/4f20b6af22c14296a1758a8ba00cc0e5/users/d50dc6c3d68d46bbae3f36336a2dc964/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:06.722052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 960/1902] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:06 2022] DELETE /identity/v3/users/cfa106b99cc84893a5151f44e15d6c00 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:21:06.728345 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccdeec-5b41-4c64-bce5-23dc23908c13 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:06.728950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccdeec-5b41-4c64-bce5-23dc23908c13 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:06.729406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccdeec-5b41-4c64-bce5-23dc23908c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:06.730399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9edcd-a316-474c-8ebb-306ce4dbd118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f20b6af22c14296a1758a8ba00cc0e5, user_id=d50dc6c3d68d46bbae3f36336a2dc964, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:06.733674 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9edcd-a316-474c-8ebb-306ce4dbd118 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:06.762054 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d6ccdeec-5b41-4c64-bce5-23dc23908c13 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:06.763467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d6ccdeec-5b41-4c64-bce5-23dc23908c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:06.795694 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 943/1903] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:06 2022] PUT /identity/v3/projects/4f20b6af22c14296a1758a8ba00cc0e5/users/d50dc6c3d68d46bbae3f36336a2dc964/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:21:06.800053 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9edcd-a316-474c-8ebb-306ce4dbd118 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:06.845364 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 961/1904] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:06.855259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccdeec-5b41-4c64-bce5-23dc23908c13 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:06.856946 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d6ccdeec-5b41-4c64-bce5-23dc23908c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:06.895184 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9edcd-a316-474c-8ebb-306ce4dbd118 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:06.902203 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ca97e-bda2-4c07-ac3d-aef60f7f7378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:06.903003 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ca97e-bda2-4c07-ac3d-aef60f7f7378 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:06.903355 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ca97e-bda2-4c07-ac3d-aef60f7f7378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:06.903701 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ca97e-bda2-4c07-ac3d-aef60f7f7378 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:06.904503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ca97e-bda2-4c07-ac3d-aef60f7f7378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:06.906892 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ca97e-bda2-4c07-ac3d-aef60f7f7378 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:06.919169 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccdeec-5b41-4c64-bce5-23dc23908c13 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:06.922944 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 944/1905] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:21:06.927712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ca97e-bda2-4c07-ac3d-aef60f7f7378 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:06.939807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ca97e-bda2-4c07-ac3d-aef60f7f7378 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:06.945518 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12cf5f-aeb7-4da5-a8af-4dcaf424320b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:06.946403 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12cf5f-aeb7-4da5-a8af-4dcaf424320b admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:06.946717 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12cf5f-aeb7-4da5-a8af-4dcaf424320b admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:06.947429 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12cf5f-aeb7-4da5-a8af-4dcaf424320b admin admin] PATH_INFO: `/v3/projects/4f20b6af22c14296a1758a8ba00cc0e5/users/d50dc6c3d68d46bbae3f36336a2dc964/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:06.976722 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7200f-4cc0-4971-87dd-b7e90d451f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:06.977116 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7200f-4cc0-4971-87dd-b7e90d451f8b service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:06.977407 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7200f-4cc0-4971-87dd-b7e90d451f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:06.977749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7200f-4cc0-4971-87dd-b7e90d451f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:06.978200 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12cf5f-aeb7-4da5-a8af-4dcaf424320b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f20b6af22c14296a1758a8ba00cc0e5, user_id=d50dc6c3d68d46bbae3f36336a2dc964, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:06.984821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12cf5f-aeb7-4da5-a8af-4dcaf424320b admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:06.989528 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7200f-4cc0-4971-87dd-b7e90d451f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:06.991134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7200f-4cc0-4971-87dd-b7e90d451f8b service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:07.002398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 962/1906] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:21:07.025010 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 945/1907] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:06 2022] PUT /identity/v3/projects/4f20b6af22c14296a1758a8ba00cc0e5/users/d50dc6c3d68d46bbae3f36336a2dc964/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:07.028598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74534a93-573b-4515-97c8-e5998be3bcb1 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:07.029032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74534a93-573b-4515-97c8-e5998be3bcb1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:07.029379 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74534a93-573b-4515-97c8-e5998be3bcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:07.087281 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-74534a93-573b-4515-97c8-e5998be3bcb1 None None] MFA Rules not processed for user `d50dc6c3d68d46bbae3f36336a2dc964`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:07.096001 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-74534a93-573b-4515-97c8-e5998be3bcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:07.220597 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 963/1908] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:07.229577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12cf5f-aeb7-4da5-a8af-4dcaf424320b admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:07.231242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-2d12cf5f-aeb7-4da5-a8af-4dcaf424320b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:07.339044 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12cf5f-aeb7-4da5-a8af-4dcaf424320b admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:07.343250 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5b1c4-aa1e-43e5-8295-8d5473bedd83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:07.346746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5b1c4-aa1e-43e5-8295-8d5473bedd83 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:07.346746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5b1c4-aa1e-43e5-8295-8d5473bedd83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:07.346746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5b1c4-aa1e-43e5-8295-8d5473bedd83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:07.355195 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5b1c4-aa1e-43e5-8295-8d5473bedd83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:07.356645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5b1c4-aa1e-43e5-8295-8d5473bedd83 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:07.379179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 946/1909] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:07.669563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74534a93-573b-4515-97c8-e5998be3bcb1 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:07.673808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-74534a93-573b-4515-97c8-e5998be3bcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:07.751699 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74534a93-573b-4515-97c8-e5998be3bcb1 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:07.757623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f756cb-ab48-4e54-83f2-937db38c9aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:07.758608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f756cb-ab48-4e54-83f2-937db38c9aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:07.758991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f756cb-ab48-4e54-83f2-937db38c9aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:07.759420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f756cb-ab48-4e54-83f2-937db38c9aa1 admin admin] PATH_INFO: `/v3/projects/a10c5db586af475ab38bc2cd516e204a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:07.761329 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f756cb-ab48-4e54-83f2-937db38c9aa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a10c5db586af475ab38bc2cd516e204a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:07.764243 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f756cb-ab48-4e54-83f2-937db38c9aa1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:07.939170 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e4f756cb-ab48-4e54-83f2-937db38c9aa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a10c5db586af475ab38bc2cd516e204a', 'request_id': 'req-e4f756cb-ab48-4e54-83f2-937db38c9aa1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:07.996618 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5b1c4-aa1e-43e5-8295-8d5473bedd83 service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:08.007483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5b1c4-aa1e-43e5-8295-8d5473bedd83 service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:08.052761 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e4f756cb-ab48-4e54-83f2-937db38c9aa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a10c5db586af475ab38bc2cd516e204a', 'request_id': 'req-e4f756cb-ab48-4e54-83f2-937db38c9aa1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:08.062033 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e4f756cb-ab48-4e54-83f2-937db38c9aa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a10c5db586af475ab38bc2cd516e204a', 'request_id': 'req-e4f756cb-ab48-4e54-83f2-937db38c9aa1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:08.083903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e4f756cb-ab48-4e54-83f2-937db38c9aa1 admin admin] The token cache is being invalidate because project a10c5db586af475ab38bc2cd516e204a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:08.084861 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e4f756cb-ab48-4e54-83f2-937db38c9aa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:08.085673 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e4f756cb-ab48-4e54-83f2-937db38c9aa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:08.091207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 964/1910] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:07 2022] DELETE /identity/v3/projects/a10c5db586af475ab38bc2cd516e204a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:08.095896 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f756cb-ab48-4e54-83f2-937db38c9aa1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:08.095896 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e4f756cb-ab48-4e54-83f2-937db38c9aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:08.111718 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f96dc-3069-4dcf-8d95-4433607d6353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:08.112806 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f96dc-3069-4dcf-8d95-4433607d6353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:08.113774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f96dc-3069-4dcf-8d95-4433607d6353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:08.114061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f96dc-3069-4dcf-8d95-4433607d6353 admin admin] PATH_INFO: `/v3/users/5563088a57044b0e81f23c0f24a221f0` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:08.117808 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f96dc-3069-4dcf-8d95-4433607d6353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5563088a57044b0e81f23c0f24a221f0)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:08.126458 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f96dc-3069-4dcf-8d95-4433607d6353 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:08.216149 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f756cb-ab48-4e54-83f2-937db38c9aa1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:08.222027 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5d2be-58f6-48d5-adb4-8d77d563199c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:08.224061 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5d2be-58f6-48d5-adb4-8d77d563199c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:08.224508 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5d2be-58f6-48d5-adb4-8d77d563199c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:08.224932 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5d2be-58f6-48d5-adb4-8d77d563199c admin admin] PATH_INFO: `/v3/users/30cb4a1d23f94d1b8e1fc367aee8f2cf` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:08.226430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5d2be-58f6-48d5-adb4-8d77d563199c admin admin] RBAC: Authorizing `identity:delete_user(user_id=30cb4a1d23f94d1b8e1fc367aee8f2cf)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:08.228767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5d2be-58f6-48d5-adb4-8d77d563199c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:08.375950 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-a42f96dc-3069-4dcf-8d95-4433607d6353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5563088a57044b0e81f23c0f24a221f0'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:08.376613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-a42f96dc-3069-4dcf-8d95-4433607d6353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5563088a57044b0e81f23c0f24a221f0'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:08.389746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-a42f96dc-3069-4dcf-8d95-4433607d6353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5563088a57044b0e81f23c0f24a221f0'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:08.390477 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-a42f96dc-3069-4dcf-8d95-4433607d6353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5563088a57044b0e81f23c0f24a221f0'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:08.398266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-a42f96dc-3069-4dcf-8d95-4433607d6353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5563088a57044b0e81f23c0f24a221f0'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:08.443336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-82f5d2be-58f6-48d5-adb4-8d77d563199c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30cb4a1d23f94d1b8e1fc367aee8f2cf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:08.444012 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-82f5d2be-58f6-48d5-adb4-8d77d563199c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30cb4a1d23f94d1b8e1fc367aee8f2cf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:08.444620 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-82f5d2be-58f6-48d5-adb4-8d77d563199c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30cb4a1d23f94d1b8e1fc367aee8f2cf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:08.452661 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 947/1911] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:07 2022] DELETE /identity/v3/users/5563088a57044b0e81f23c0f24a221f0 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:08.458063 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fae99-d48f-4377-befc-1b98bd383594 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:08.458362 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fae99-d48f-4377-befc-1b98bd383594 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:08.458666 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fae99-d48f-4377-befc-1b98bd383594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:08.459319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-82f5d2be-58f6-48d5-adb4-8d77d563199c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30cb4a1d23f94d1b8e1fc367aee8f2cf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:08.471322 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-82f5d2be-58f6-48d5-adb4-8d77d563199c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30cb4a1d23f94d1b8e1fc367aee8f2cf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:08.479254 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-a94fae99-d48f-4377-befc-1b98bd383594 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:08.480415 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a94fae99-d48f-4377-befc-1b98bd383594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:08.539899 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 965/1912] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:08 2022] DELETE /identity/v3/users/30cb4a1d23f94d1b8e1fc367aee8f2cf => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:08.571910 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5d2be-58f6-48d5-adb4-8d77d563199c admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:08.575192 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-82f5d2be-58f6-48d5-adb4-8d77d563199c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:08.580478 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 948/1913] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:08.596096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fae99-d48f-4377-befc-1b98bd383594 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:08.599222 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a94fae99-d48f-4377-befc-1b98bd383594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:08.697522 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fae99-d48f-4377-befc-1b98bd383594 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:08.702024 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5d2be-58f6-48d5-adb4-8d77d563199c admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:08.709738 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905c4b5-7b55-4d86-ba60-eb22821424ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:08.711301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905c4b5-7b55-4d86-ba60-eb22821424ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:08.711763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905c4b5-7b55-4d86-ba60-eb22821424ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:08.712209 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905c4b5-7b55-4d86-ba60-eb22821424ed admin admin] PATH_INFO: `/v3/users/03a44252946a49049268cbaf1af66342` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:08.713664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905c4b5-7b55-4d86-ba60-eb22821424ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=03a44252946a49049268cbaf1af66342)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:08.715757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905c4b5-7b55-4d86-ba60-eb22821424ed admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:08.762338 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b16710-88c8-4706-9a91-08471f1f6d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:08.763071 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b16710-88c8-4706-9a91-08471f1f6d23 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:08.763357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b16710-88c8-4706-9a91-08471f1f6d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:08.764023 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b16710-88c8-4706-9a91-08471f1f6d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:08.773659 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b16710-88c8-4706-9a91-08471f1f6d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:08.775163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b16710-88c8-4706-9a91-08471f1f6d23 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:08.786052 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 949/1914] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:08.935087 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2905c4b5-7b55-4d86-ba60-eb22821424ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03a44252946a49049268cbaf1af66342'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:08.935762 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2905c4b5-7b55-4d86-ba60-eb22821424ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03a44252946a49049268cbaf1af66342'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:08.936449 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2905c4b5-7b55-4d86-ba60-eb22821424ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03a44252946a49049268cbaf1af66342'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:08.948039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2905c4b5-7b55-4d86-ba60-eb22821424ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03a44252946a49049268cbaf1af66342'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:08.954796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2905c4b5-7b55-4d86-ba60-eb22821424ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03a44252946a49049268cbaf1af66342'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:09.065686 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 966/1915] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:08 2022] DELETE /identity/v3/users/03a44252946a49049268cbaf1af66342 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:09.065843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf87dd-29ab-462e-bb69-d22d8a88235f None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:09.065843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf87dd-29ab-462e-bb69-d22d8a88235f None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:09.065843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf87dd-29ab-462e-bb69-d22d8a88235f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:09.083636 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-a9cf87dd-29ab-462e-bb69-d22d8a88235f None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:09.084951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a9cf87dd-29ab-462e-bb69-d22d8a88235f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:09.130046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905c4b5-7b55-4d86-ba60-eb22821424ed admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:09.131573 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2905c4b5-7b55-4d86-ba60-eb22821424ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:09.152900 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 950/1916] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:09.180237 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf87dd-29ab-462e-bb69-d22d8a88235f None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:09.181745 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a9cf87dd-29ab-462e-bb69-d22d8a88235f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:09.213980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905c4b5-7b55-4d86-ba60-eb22821424ed admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:09.219050 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2652ec4-3637-4a88-a0ba-9875f9d5e270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:09.220057 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2652ec4-3637-4a88-a0ba-9875f9d5e270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:09.220442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2652ec4-3637-4a88-a0ba-9875f9d5e270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:09.220811 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2652ec4-3637-4a88-a0ba-9875f9d5e270 admin admin] PATH_INFO: `/v3/projects/736bab5598cb48748d703173ceb946b1` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:09.222150 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2652ec4-3637-4a88-a0ba-9875f9d5e270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=736bab5598cb48748d703173ceb946b1)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:09.224276 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2652ec4-3637-4a88-a0ba-9875f9d5e270 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:09.313928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf87dd-29ab-462e-bb69-d22d8a88235f None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:09.314631 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784336a-26fb-4ad3-b556-4dc4d2568110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:09.315302 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784336a-26fb-4ad3-b556-4dc4d2568110 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:09.315921 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784336a-26fb-4ad3-b556-4dc4d2568110 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:09.315921 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784336a-26fb-4ad3-b556-4dc4d2568110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:09.326937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784336a-26fb-4ad3-b556-4dc4d2568110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:09.328200 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784336a-26fb-4ad3-b556-4dc4d2568110 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:09.340339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 951/1917] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:09.346631 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a2652ec4-3637-4a88-a0ba-9875f9d5e270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '736bab5598cb48748d703173ceb946b1', 'request_id': 'req-a2652ec4-3637-4a88-a0ba-9875f9d5e270'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:09.408309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784336a-26fb-4ad3-b556-4dc4d2568110 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:09.410903 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-5784336a-26fb-4ad3-b556-4dc4d2568110 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:09.425071 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a2652ec4-3637-4a88-a0ba-9875f9d5e270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '736bab5598cb48748d703173ceb946b1', 'request_id': 'req-a2652ec4-3637-4a88-a0ba-9875f9d5e270'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:09.429367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784336a-26fb-4ad3-b556-4dc4d2568110 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:09.436468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a2652ec4-3637-4a88-a0ba-9875f9d5e270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '736bab5598cb48748d703173ceb946b1', 'request_id': 'req-a2652ec4-3637-4a88-a0ba-9875f9d5e270'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:09.476445 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a2652ec4-3637-4a88-a0ba-9875f9d5e270 admin admin] The token cache is being invalidate because project 736bab5598cb48748d703173ceb946b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:09.476835 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a2652ec4-3637-4a88-a0ba-9875f9d5e270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:09.478244 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a2652ec4-3637-4a88-a0ba-9875f9d5e270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:09.480635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 967/1918] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:09 2022] DELETE /identity/v3/projects/736bab5598cb48748d703173ceb946b1 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:09.488454 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217c2a1-04f0-4b42-8590-a50f715ccba9 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:09.489210 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217c2a1-04f0-4b42-8590-a50f715ccba9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:09.489595 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217c2a1-04f0-4b42-8590-a50f715ccba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:09.537953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-1217c2a1-04f0-4b42-8590-a50f715ccba9 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:09.539412 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1217c2a1-04f0-4b42-8590-a50f715ccba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:09.539995 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e40075-11e1-43fb-affe-29f9b838062c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:09.541226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e40075-11e1-43fb-affe-29f9b838062c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:09.541703 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e40075-11e1-43fb-affe-29f9b838062c admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:09.542177 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e40075-11e1-43fb-affe-29f9b838062c admin admin] PATH_INFO: `/v3/projects/c876fbf9b3654532955a2076d627d053` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:09.543718 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e40075-11e1-43fb-affe-29f9b838062c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c876fbf9b3654532955a2076d627d053)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:09.545831 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e40075-11e1-43fb-affe-29f9b838062c admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:09.555850 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 968/1919] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:09.566804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65c350-80d5-4274-af72-b725a4f53955 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:09.567591 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65c350-80d5-4274-af72-b725a4f53955 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:09.568021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65c350-80d5-4274-af72-b725a4f53955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:09.595521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8e65c350-80d5-4274-af72-b725a4f53955 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:09.596821 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8e65c350-80d5-4274-af72-b725a4f53955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:09.607340 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 969/1920] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:09.611552 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65c350-80d5-4274-af72-b725a4f53955 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:09.621420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65c350-80d5-4274-af72-b725a4f53955 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:09.626418 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb648dd-9c46-4cf5-a82b-0436d4e7578a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:09.627633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb648dd-9c46-4cf5-a82b-0436d4e7578a admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:09.627633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb648dd-9c46-4cf5-a82b-0436d4e7578a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:09.628000 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb648dd-9c46-4cf5-a82b-0436d4e7578a admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:09.629525 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb648dd-9c46-4cf5-a82b-0436d4e7578a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:21:09.629835 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb648dd-9c46-4cf5-a82b-0436d4e7578a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:09.631558 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb648dd-9c46-4cf5-a82b-0436d4e7578a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:09.645482 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 970/1921] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:21:09.649833 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb648dd-9c46-4cf5-a82b-0436d4e7578a admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:09.660270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb648dd-9c46-4cf5-a82b-0436d4e7578a admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:09.666676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-83e40075-11e1-43fb-affe-29f9b838062c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c876fbf9b3654532955a2076d627d053', 'request_id': 'req-83e40075-11e1-43fb-affe-29f9b838062c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:09.729654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046cb65-a489-4617-bf95-701a855b65b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:09.730806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046cb65-a489-4617-bf95-701a855b65b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:09.731199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046cb65-a489-4617-bf95-701a855b65b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:09.731578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046cb65-a489-4617-bf95-701a855b65b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:09.732417 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046cb65-a489-4617-bf95-701a855b65b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:09.735009 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046cb65-a489-4617-bf95-701a855b65b3 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:09.774236 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-83e40075-11e1-43fb-affe-29f9b838062c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c876fbf9b3654532955a2076d627d053', 'request_id': 'req-83e40075-11e1-43fb-affe-29f9b838062c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:09.781344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-83e40075-11e1-43fb-affe-29f9b838062c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c876fbf9b3654532955a2076d627d053', 'request_id': 'req-83e40075-11e1-43fb-affe-29f9b838062c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:09.796032 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-83e40075-11e1-43fb-affe-29f9b838062c admin admin] The token cache is being invalidate because project c876fbf9b3654532955a2076d627d053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:09.796402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-83e40075-11e1-43fb-affe-29f9b838062c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:09.797144 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-83e40075-11e1-43fb-affe-29f9b838062c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:09.798930 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 952/1922] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:09 2022] DELETE /identity/v3/projects/c876fbf9b3654532955a2076d627d053 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:21:09.803283 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e40075-11e1-43fb-affe-29f9b838062c admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:09.805574 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-83e40075-11e1-43fb-affe-29f9b838062c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:09.820709 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e40075-11e1-43fb-affe-29f9b838062c admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:09.825868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060d436-ccea-4bd4-a2ec-beaef2daa55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:09.826902 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060d436-ccea-4bd4-a2ec-beaef2daa55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:09.827466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060d436-ccea-4bd4-a2ec-beaef2daa55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:09.827903 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060d436-ccea-4bd4-a2ec-beaef2daa55b admin admin] PATH_INFO: `/v3/users/d50dc6c3d68d46bbae3f36336a2dc964` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:09.829232 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060d436-ccea-4bd4-a2ec-beaef2daa55b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50dc6c3d68d46bbae3f36336a2dc964)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:09.831408 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060d436-ccea-4bd4-a2ec-beaef2daa55b admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:09.872245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 971/1923] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:21:09 2022] POST /identity/v3/projects => generated 373 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:09.877101 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046cb65-a489-4617-bf95-701a855b65b3 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:09.880480 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5046cb65-a489-4617-bf95-701a855b65b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:09.963151 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046cb65-a489-4617-bf95-701a855b65b3 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:09.970923 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1a3aa-cd00-41d2-864e-1bab341226e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:09.974067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1a3aa-cd00-41d2-864e-1bab341226e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:09.974568 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1a3aa-cd00-41d2-864e-1bab341226e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:09.975309 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1a3aa-cd00-41d2-864e-1bab341226e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:09.976853 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1a3aa-cd00-41d2-864e-1bab341226e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:09.980043 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1a3aa-cd00-41d2-864e-1bab341226e0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:10.052308 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-8060d436-ccea-4bd4-a2ec-beaef2daa55b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50dc6c3d68d46bbae3f36336a2dc964'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:10.052978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-8060d436-ccea-4bd4-a2ec-beaef2daa55b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50dc6c3d68d46bbae3f36336a2dc964'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:10.070533 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 972/1924] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:21:09 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:10.074351 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1a3aa-cd00-41d2-864e-1bab341226e0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:10.079013 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1bb1a3aa-cd00-41d2-864e-1bab341226e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:10.089285 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-8060d436-ccea-4bd4-a2ec-beaef2daa55b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50dc6c3d68d46bbae3f36336a2dc964'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:10.091361 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-8060d436-ccea-4bd4-a2ec-beaef2daa55b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50dc6c3d68d46bbae3f36336a2dc964'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:10.093681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1a3aa-cd00-41d2-864e-1bab341226e0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:10.100216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c167cf1-1736-42c4-b274-7f21354635e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:10.101137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c167cf1-1736-42c4-b274-7f21354635e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:10.101425 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c167cf1-1736-42c4-b274-7f21354635e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:10.101709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c167cf1-1736-42c4-b274-7f21354635e2 admin admin] PATH_INFO: `/v3/projects/2511b668e041436b9a6dcd4a4fe6c9e8` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:10.103128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c167cf1-1736-42c4-b274-7f21354635e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2511b668e041436b9a6dcd4a4fe6c9e8)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:10.107164 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-8060d436-ccea-4bd4-a2ec-beaef2daa55b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50dc6c3d68d46bbae3f36336a2dc964'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:10.107495 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c167cf1-1736-42c4-b274-7f21354635e2 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:10.268442 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 953/1925] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:09 2022] DELETE /identity/v3/users/d50dc6c3d68d46bbae3f36336a2dc964 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:21:10.268442 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060d436-ccea-4bd4-a2ec-beaef2daa55b admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:10.270832 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-8060d436-ccea-4bd4-a2ec-beaef2daa55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:10.298663 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2c167cf1-1736-42c4-b274-7f21354635e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2511b668e041436b9a6dcd4a4fe6c9e8', 'request_id': 'req-2c167cf1-1736-42c4-b274-7f21354635e2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:10.363622 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060d436-ccea-4bd4-a2ec-beaef2daa55b admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:10.366547 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2c167cf1-1736-42c4-b274-7f21354635e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2511b668e041436b9a6dcd4a4fe6c9e8', 'request_id': 'req-2c167cf1-1736-42c4-b274-7f21354635e2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:10.373000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409f0d8-b5a0-415b-b746-7d9f87f22ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:10.381676 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2c167cf1-1736-42c4-b274-7f21354635e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2511b668e041436b9a6dcd4a4fe6c9e8', 'request_id': 'req-2c167cf1-1736-42c4-b274-7f21354635e2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:10.382349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409f0d8-b5a0-415b-b746-7d9f87f22ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:10.382349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409f0d8-b5a0-415b-b746-7d9f87f22ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:10.382349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409f0d8-b5a0-415b-b746-7d9f87f22ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:10.382349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409f0d8-b5a0-415b-b746-7d9f87f22ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:10.382349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409f0d8-b5a0-415b-b746-7d9f87f22ef4 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:10.391645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 954/1926] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:10.397674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2c167cf1-1736-42c4-b274-7f21354635e2 admin admin] The token cache is being invalidate because project 2511b668e041436b9a6dcd4a4fe6c9e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:10.397674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2c167cf1-1736-42c4-b274-7f21354635e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:10.397674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2c167cf1-1736-42c4-b274-7f21354635e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:10.397674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 973/1927] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:10 2022] DELETE /identity/v3/projects/2511b668e041436b9a6dcd4a4fe6c9e8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:10.401429 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409f0d8-b5a0-415b-b746-7d9f87f22ef4 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:10.401429 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e409f0d8-b5a0-415b-b746-7d9f87f22ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:10.403926 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c167cf1-1736-42c4-b274-7f21354635e2 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:10.406939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2c167cf1-1736-42c4-b274-7f21354635e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:10.418998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409f0d8-b5a0-415b-b746-7d9f87f22ef4 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:10.423976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a8f68-a292-4255-b358-2e9ad7960de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:10.426624 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a8f68-a292-4255-b358-2e9ad7960de6 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:10.426624 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a8f68-a292-4255-b358-2e9ad7960de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:10.426624 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a8f68-a292-4255-b358-2e9ad7960de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:10.427726 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a8f68-a292-4255-b358-2e9ad7960de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:10.429412 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a8f68-a292-4255-b358-2e9ad7960de6 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:10.443788 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 955/1928] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:10.445466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a8f68-a292-4255-b358-2e9ad7960de6 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:10.455850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a8f68-a292-4255-b358-2e9ad7960de6 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:10.462198 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ccf78-5876-4229-97bd-b331daf106fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:10.463227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ccf78-5876-4229-97bd-b331daf106fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:10.463592 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ccf78-5876-4229-97bd-b331daf106fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:10.463977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ccf78-5876-4229-97bd-b331daf106fb admin admin] PATH_INFO: `/v3/projects/ba5dc3f951924bd88b2c320ae5bd86a7/users/7a8a16be6aaa410b9eaacc86fd5a39fb/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:10.480790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c167cf1-1736-42c4-b274-7f21354635e2 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:10.485718 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9197d-9b4e-486b-bb70-f98194945e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:10.487179 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9197d-9b4e-486b-bb70-f98194945e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:10.487179 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9197d-9b4e-486b-bb70-f98194945e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:10.487179 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9197d-9b4e-486b-bb70-f98194945e5b admin admin] PATH_INFO: `/v3/users/7f9d4676f3b148a59099c08e01cc66d0` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:10.489120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9197d-9b4e-486b-bb70-f98194945e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f9d4676f3b148a59099c08e01cc66d0)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:10.491228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9197d-9b4e-486b-bb70-f98194945e5b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:10.493655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ccf78-5876-4229-97bd-b331daf106fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5dc3f951924bd88b2c320ae5bd86a7, user_id=7a8a16be6aaa410b9eaacc86fd5a39fb, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:10.504523 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ccf78-5876-4229-97bd-b331daf106fb admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:10.599414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 956/1929] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:10 2022] PUT /identity/v3/projects/ba5dc3f951924bd88b2c320ae5bd86a7/users/7a8a16be6aaa410b9eaacc86fd5a39fb/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:21:10.601028 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c9aaa-23c8-4d1d-8b0c-9544881757cd None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:10.601675 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c9aaa-23c8-4d1d-8b0c-9544881757cd None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:10.601675 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c9aaa-23c8-4d1d-8b0c-9544881757cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:10.654497 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-a65c9aaa-23c8-4d1d-8b0c-9544881757cd None None] MFA Rules not processed for user `7a8a16be6aaa410b9eaacc86fd5a39fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:10.655786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a65c9aaa-23c8-4d1d-8b0c-9544881757cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:10.718551 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d1f9197d-9b4e-486b-bb70-f98194945e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f9d4676f3b148a59099c08e01cc66d0'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:10.719198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d1f9197d-9b4e-486b-bb70-f98194945e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f9d4676f3b148a59099c08e01cc66d0'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:10.719945 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d1f9197d-9b4e-486b-bb70-f98194945e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f9d4676f3b148a59099c08e01cc66d0'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:10.725373 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 957/1930] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:10.734305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d1f9197d-9b4e-486b-bb70-f98194945e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f9d4676f3b148a59099c08e01cc66d0'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:10.739551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c9aaa-23c8-4d1d-8b0c-9544881757cd None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:10.741464 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a65c9aaa-23c8-4d1d-8b0c-9544881757cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:10.742281 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d1f9197d-9b4e-486b-bb70-f98194945e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f9d4676f3b148a59099c08e01cc66d0'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:10.823843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 974/1931] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:10 2022] DELETE /identity/v3/users/7f9d4676f3b148a59099c08e01cc66d0 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:21:10.824680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9197d-9b4e-486b-bb70-f98194945e5b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:10.826426 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d1f9197d-9b4e-486b-bb70-f98194945e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:10.851517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c9aaa-23c8-4d1d-8b0c-9544881757cd None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:10.918090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9197d-9b4e-486b-bb70-f98194945e5b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:10.923402 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a2e9b-16f4-4d28-a5de-4d1d4f8255ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:10.924282 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a2e9b-16f4-4d28-a5de-4d1d4f8255ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:10.924579 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a2e9b-16f4-4d28-a5de-4d1d4f8255ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:10.924862 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a2e9b-16f4-4d28-a5de-4d1d4f8255ef admin admin] PATH_INFO: `/v3/projects/4f20b6af22c14296a1758a8ba00cc0e5` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:10.926690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a2e9b-16f4-4d28-a5de-4d1d4f8255ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f20b6af22c14296a1758a8ba00cc0e5)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:10.928543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a2e9b-16f4-4d28-a5de-4d1d4f8255ef admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:10.956136 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c7b95-7558-45ff-b938-bed5c6f3f4ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:10.957542 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c7b95-7558-45ff-b938-bed5c6f3f4ca service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:10.957989 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c7b95-7558-45ff-b938-bed5c6f3f4ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:10.958785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c7b95-7558-45ff-b938-bed5c6f3f4ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:10.961201 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-397c7b95-7558-45ff-b938-bed5c6f3f4ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:11.023310 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c7b95-7558-45ff-b938-bed5c6f3f4ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:11.025060 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c7b95-7558-45ff-b938-bed5c6f3f4ca service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:11.035793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 958/1932] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:11.068321 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c7b95-7558-45ff-b938-bed5c6f3f4ca service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:11.069875 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-397c7b95-7558-45ff-b938-bed5c6f3f4ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:11.074057 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e64a2e9b-16f4-4d28-a5de-4d1d4f8255ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f20b6af22c14296a1758a8ba00cc0e5', 'request_id': 'req-e64a2e9b-16f4-4d28-a5de-4d1d4f8255ef'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:11.085473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c7b95-7558-45ff-b938-bed5c6f3f4ca service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:11.155336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e64a2e9b-16f4-4d28-a5de-4d1d4f8255ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f20b6af22c14296a1758a8ba00cc0e5', 'request_id': 'req-e64a2e9b-16f4-4d28-a5de-4d1d4f8255ef'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:11.157854 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93456ade-6574-4ca8-a7df-04f4f3529b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:11.158901 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93456ade-6574-4ca8-a7df-04f4f3529b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:11.159281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93456ade-6574-4ca8-a7df-04f4f3529b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:11.160054 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93456ade-6574-4ca8-a7df-04f4f3529b0c admin admin] PATH_INFO: `/v3/users/7a8a16be6aaa410b9eaacc86fd5a39fb` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:11.161549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93456ade-6574-4ca8-a7df-04f4f3529b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a8a16be6aaa410b9eaacc86fd5a39fb)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:11.163589 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93456ade-6574-4ca8-a7df-04f4f3529b0c admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:11.164403 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e64a2e9b-16f4-4d28-a5de-4d1d4f8255ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f20b6af22c14296a1758a8ba00cc0e5', 'request_id': 'req-e64a2e9b-16f4-4d28-a5de-4d1d4f8255ef'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:11.185073 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e64a2e9b-16f4-4d28-a5de-4d1d4f8255ef admin admin] The token cache is being invalidate because project 4f20b6af22c14296a1758a8ba00cc0e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:11.185362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e64a2e9b-16f4-4d28-a5de-4d1d4f8255ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:11.186090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e64a2e9b-16f4-4d28-a5de-4d1d4f8255ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:11.188045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 975/1933] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:10 2022] DELETE /identity/v3/projects/4f20b6af22c14296a1758a8ba00cc0e5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:11.193281 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b9b84-8962-4520-bb54-175fe9c652ba None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:11.193579 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b9b84-8962-4520-bb54-175fe9c652ba None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:11.193860 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b9b84-8962-4520-bb54-175fe9c652ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:11.219418 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-583b9b84-8962-4520-bb54-175fe9c652ba None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:11.221059 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-583b9b84-8962-4520-bb54-175fe9c652ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:11.229888 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 976/1934] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:11.237449 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b5926-b0ba-4f74-b519-effe318de8d8 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:11.238307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b5926-b0ba-4f74-b519-effe318de8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:11.238629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b5926-b0ba-4f74-b519-effe318de8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:11.263423 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2c8b5926-b0ba-4f74-b519-effe318de8d8 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:11.271335 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2c8b5926-b0ba-4f74-b519-effe318de8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:11.277447 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 977/1935] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:11.280493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b5926-b0ba-4f74-b519-effe318de8d8 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:11.290517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b5926-b0ba-4f74-b519-effe318de8d8 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:11.296532 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165d28c-c2eb-43ad-bbb5-966f58d60c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:11.297561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165d28c-c2eb-43ad-bbb5-966f58d60c6d admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:11.298079 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165d28c-c2eb-43ad-bbb5-966f58d60c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:11.298692 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165d28c-c2eb-43ad-bbb5-966f58d60c6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:11.299760 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165d28c-c2eb-43ad-bbb5-966f58d60c6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:21:11.300762 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165d28c-c2eb-43ad-bbb5-966f58d60c6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:11.302799 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165d28c-c2eb-43ad-bbb5-966f58d60c6d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:11.322304 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 978/1936] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:21:11.323495 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165d28c-c2eb-43ad-bbb5-966f58d60c6d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:11.334650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165d28c-c2eb-43ad-bbb5-966f58d60c6d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:11.339338 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-93456ade-6574-4ca8-a7df-04f4f3529b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a8a16be6aaa410b9eaacc86fd5a39fb'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:11.339338 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-93456ade-6574-4ca8-a7df-04f4f3529b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a8a16be6aaa410b9eaacc86fd5a39fb'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:11.340040 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a68ba-23b9-45df-8774-5ee2272a7fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:11.340813 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a68ba-23b9-45df-8774-5ee2272a7fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:11.341196 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a68ba-23b9-45df-8774-5ee2272a7fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:11.341708 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a68ba-23b9-45df-8774-5ee2272a7fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:11.343139 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a68ba-23b9-45df-8774-5ee2272a7fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:11.345209 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a68ba-23b9-45df-8774-5ee2272a7fb9 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:11.354212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-93456ade-6574-4ca8-a7df-04f4f3529b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a8a16be6aaa410b9eaacc86fd5a39fb'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:11.355417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-93456ade-6574-4ca8-a7df-04f4f3529b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a8a16be6aaa410b9eaacc86fd5a39fb'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:11.363646 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-93456ade-6574-4ca8-a7df-04f4f3529b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a8a16be6aaa410b9eaacc86fd5a39fb'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:11.424863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 979/1937] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:21:11 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:11.430046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a68ba-23b9-45df-8774-5ee2272a7fb9 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:11.435891 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 959/1938] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:11 2022] DELETE /identity/v3/users/7a8a16be6aaa410b9eaacc86fd5a39fb => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:21:11.437976 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-695a68ba-23b9-45df-8774-5ee2272a7fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:11.441640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e5265-fd2e-4f87-8ede-39416adcfc8a None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:11.442014 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e5265-fd2e-4f87-8ede-39416adcfc8a None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:11.442372 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e5265-fd2e-4f87-8ede-39416adcfc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:11.477682 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-879e5265-fd2e-4f87-8ede-39416adcfc8a None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:11.478951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-879e5265-fd2e-4f87-8ede-39416adcfc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:11.570508 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a68ba-23b9-45df-8774-5ee2272a7fb9 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:11.589930 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 960/1939] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:11.591273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e5265-fd2e-4f87-8ede-39416adcfc8a None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:11.599304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-879e5265-fd2e-4f87-8ede-39416adcfc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:11.615028 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e5265-fd2e-4f87-8ede-39416adcfc8a None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:11.619170 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf8c90-18d8-4b37-9b81-f6eacd4fc1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:11.620169 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf8c90-18d8-4b37-9b81-f6eacd4fc1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:11.620980 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf8c90-18d8-4b37-9b81-f6eacd4fc1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:11.621352 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf8c90-18d8-4b37-9b81-f6eacd4fc1a7 admin admin] PATH_INFO: `/v3/projects/59d52b81ac0b47cca775cb03941026f3` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:11.622793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf8c90-18d8-4b37-9b81-f6eacd4fc1a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59d52b81ac0b47cca775cb03941026f3)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:11.624816 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf8c90-18d8-4b37-9b81-f6eacd4fc1a7 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:11.675293 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2b663-a6a3-4d0f-9b14-40657133dd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:11.676299 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2b663-a6a3-4d0f-9b14-40657133dd7e admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:11.676648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2b663-a6a3-4d0f-9b14-40657133dd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:11.676996 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2b663-a6a3-4d0f-9b14-40657133dd7e admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:11.679108 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2b663-a6a3-4d0f-9b14-40657133dd7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:11.681432 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2b663-a6a3-4d0f-9b14-40657133dd7e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:11.745826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-38cf8c90-18d8-4b37-9b81-f6eacd4fc1a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59d52b81ac0b47cca775cb03941026f3', 'request_id': 'req-38cf8c90-18d8-4b37-9b81-f6eacd4fc1a7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:11.785777 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 980/1940] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:21:11 2022] POST /identity/v3/users => generated 291 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:11.786826 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2b663-a6a3-4d0f-9b14-40657133dd7e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:11.789339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e9c2b663-a6a3-4d0f-9b14-40657133dd7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:11.825113 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-38cf8c90-18d8-4b37-9b81-f6eacd4fc1a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59d52b81ac0b47cca775cb03941026f3', 'request_id': 'req-38cf8c90-18d8-4b37-9b81-f6eacd4fc1a7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:11.833961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-38cf8c90-18d8-4b37-9b81-f6eacd4fc1a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59d52b81ac0b47cca775cb03941026f3', 'request_id': 'req-38cf8c90-18d8-4b37-9b81-f6eacd4fc1a7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:11.851231 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-38cf8c90-18d8-4b37-9b81-f6eacd4fc1a7 admin admin] The token cache is being invalidate because project 59d52b81ac0b47cca775cb03941026f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:11.851743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-38cf8c90-18d8-4b37-9b81-f6eacd4fc1a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:11.852650 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-38cf8c90-18d8-4b37-9b81-f6eacd4fc1a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:11.859034 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 961/1941] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:11 2022] DELETE /identity/v3/projects/59d52b81ac0b47cca775cb03941026f3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:11.859593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf8c90-18d8-4b37-9b81-f6eacd4fc1a7 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:11.860993 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-38cf8c90-18d8-4b37-9b81-f6eacd4fc1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:11.871117 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2b663-a6a3-4d0f-9b14-40657133dd7e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:11.922160 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063b227-1482-4e21-a3ff-de9e6b563fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:11.922863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063b227-1482-4e21-a3ff-de9e6b563fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:11.923154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063b227-1482-4e21-a3ff-de9e6b563fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:11.923437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063b227-1482-4e21-a3ff-de9e6b563fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:11.925928 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e063b227-1482-4e21-a3ff-de9e6b563fb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:11.937662 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf8c90-18d8-4b37-9b81-f6eacd4fc1a7 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:11.946487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063b227-1482-4e21-a3ff-de9e6b563fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:11.947849 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219b448-6f47-4bd0-940e-a7dd60dcba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:11.948253 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063b227-1482-4e21-a3ff-de9e6b563fb6 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:11.948861 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219b448-6f47-4bd0-940e-a7dd60dcba88 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:11.949290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219b448-6f47-4bd0-940e-a7dd60dcba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:11.949883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219b448-6f47-4bd0-940e-a7dd60dcba88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:11.950825 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219b448-6f47-4bd0-940e-a7dd60dcba88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:11.952611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219b448-6f47-4bd0-940e-a7dd60dcba88 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:11.961403 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 981/1942] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:11.963216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f3c6a-6fc0-4f65-bcc2-7576816fd54d None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:11.963512 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f3c6a-6fc0-4f65-bcc2-7576816fd54d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:11.963791 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f3c6a-6fc0-4f65-bcc2-7576816fd54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:11.966105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 962/1943] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:11.970049 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219b448-6f47-4bd0-940e-a7dd60dcba88 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:11.983315 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219b448-6f47-4bd0-940e-a7dd60dcba88 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:11.986934 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-539f3c6a-6fc0-4f65-bcc2-7576816fd54d None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:11.989541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-539f3c6a-6fc0-4f65-bcc2-7576816fd54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:11.990386 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071b757-ae23-43cf-9af1-7177b7f39cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:11.991430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071b757-ae23-43cf-9af1-7177b7f39cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:11.992062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071b757-ae23-43cf-9af1-7177b7f39cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:11.992481 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071b757-ae23-43cf-9af1-7177b7f39cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:11.993392 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071b757-ae23-43cf-9af1-7177b7f39cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:11.995398 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071b757-ae23-43cf-9af1-7177b7f39cb5 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:12.002584 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 982/1944] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:12.012558 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d1cda-92d5-4db5-91ba-f828b709d111 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:12.012949 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d1cda-92d5-4db5-91ba-f828b709d111 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:12.013308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d1cda-92d5-4db5-91ba-f828b709d111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:12.019415 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 963/1945] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:21:12.023675 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071b757-ae23-43cf-9af1-7177b7f39cb5 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:12.040492 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-4c2d1cda-92d5-4db5-91ba-f828b709d111 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:12.042111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4c2d1cda-92d5-4db5-91ba-f828b709d111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:12.045471 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071b757-ae23-43cf-9af1-7177b7f39cb5 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:12.055497 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 983/1946] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:12.061568 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d1cda-92d5-4db5-91ba-f828b709d111 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:12.064743 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0427e9d-3257-4dfa-aada-d2574ff4c96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:12.065658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0427e9d-3257-4dfa-aada-d2574ff4c96e admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:12.065943 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0427e9d-3257-4dfa-aada-d2574ff4c96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:12.067160 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0427e9d-3257-4dfa-aada-d2574ff4c96e admin admin] PATH_INFO: `/v3/projects/26ad41aafd7f402dafb95eff1442a109/users/bc2457eef9e54661b34ec9da331b1646/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:12.080773 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d1cda-92d5-4db5-91ba-f828b709d111 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:12.087006 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87811394-0e0a-4f2b-9e26-51f213034913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:12.087687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87811394-0e0a-4f2b-9e26-51f213034913 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:12.087977 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87811394-0e0a-4f2b-9e26-51f213034913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:12.088311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87811394-0e0a-4f2b-9e26-51f213034913 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:12.089613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87811394-0e0a-4f2b-9e26-51f213034913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:21:12.089933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87811394-0e0a-4f2b-9e26-51f213034913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:12.092289 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87811394-0e0a-4f2b-9e26-51f213034913 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:12.104561 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0427e9d-3257-4dfa-aada-d2574ff4c96e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ad41aafd7f402dafb95eff1442a109, user_id=bc2457eef9e54661b34ec9da331b1646, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:12.107154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0427e9d-3257-4dfa-aada-d2574ff4c96e admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:12.111409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 984/1947] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:21:12.112882 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87811394-0e0a-4f2b-9e26-51f213034913 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:12.123246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87811394-0e0a-4f2b-9e26-51f213034913 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:12.128961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b54c4-60d1-453f-acca-d272251142c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:12.130605 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b54c4-60d1-453f-acca-d272251142c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:12.130605 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b54c4-60d1-453f-acca-d272251142c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:12.130605 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b54c4-60d1-453f-acca-d272251142c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:12.131417 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b54c4-60d1-453f-acca-d272251142c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:12.133494 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b54c4-60d1-453f-acca-d272251142c4 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:12.198248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 964/1948] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:12 2022] PUT /identity/v3/projects/26ad41aafd7f402dafb95eff1442a109/users/bc2457eef9e54661b34ec9da331b1646/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:12.210750 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077b492-beb4-4f0c-9b13-a884ef0a5f6a None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:12.211139 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077b492-beb4-4f0c-9b13-a884ef0a5f6a None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:12.211367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077b492-beb4-4f0c-9b13-a884ef0a5f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:12.240674 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-3077b492-beb4-4f0c-9b13-a884ef0a5f6a None None] MFA Rules not processed for user `bc2457eef9e54661b34ec9da331b1646`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:12.241961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-3077b492-beb4-4f0c-9b13-a884ef0a5f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:12.248927 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 985/1949] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:21:12 2022] POST /identity/v3/projects => generated 365 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:21:12.252978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b54c4-60d1-453f-acca-d272251142c4 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:12.352697 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 965/1950] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:12.356475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077b492-beb4-4f0c-9b13-a884ef0a5f6a None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:12.360897 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b54c4-60d1-453f-acca-d272251142c4 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:12.367047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf509349-5cd8-46bc-beea-9de082b3a498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:12.367778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf509349-5cd8-46bc-beea-9de082b3a498 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:12.368065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf509349-5cd8-46bc-beea-9de082b3a498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:12.368373 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf509349-5cd8-46bc-beea-9de082b3a498 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:12.369204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf509349-5cd8-46bc-beea-9de082b3a498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:12.371560 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf509349-5cd8-46bc-beea-9de082b3a498 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:12.441579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077b492-beb4-4f0c-9b13-a884ef0a5f6a None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:12.449365 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b4dd7-da7c-44cb-a9a2-a8e1130a473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:12.449660 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b4dd7-da7c-44cb-a9a2-a8e1130a473f admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:12.452310 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b4dd7-da7c-44cb-a9a2-a8e1130a473f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:12.452888 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b4dd7-da7c-44cb-a9a2-a8e1130a473f admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:12.453816 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b4dd7-da7c-44cb-a9a2-a8e1130a473f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:12.457337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b4dd7-da7c-44cb-a9a2-a8e1130a473f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:12.466266 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 986/1951] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:21:12 2022] POST /identity/v3/users => generated 283 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:12.475341 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf509349-5cd8-46bc-beea-9de082b3a498 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:12.507500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf509349-5cd8-46bc-beea-9de082b3a498 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:12.511346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89589593-b8e2-4129-8295-65e218ddf566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:12.512161 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89589593-b8e2-4129-8295-65e218ddf566 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:12.512515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89589593-b8e2-4129-8295-65e218ddf566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:12.512864 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89589593-b8e2-4129-8295-65e218ddf566 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:12.513738 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89589593-b8e2-4129-8295-65e218ddf566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:12.516132 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89589593-b8e2-4129-8295-65e218ddf566 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:12.530853 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 987/1952] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:12.532463 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89589593-b8e2-4129-8295-65e218ddf566 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:12.543870 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89589593-b8e2-4129-8295-65e218ddf566 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:12.549137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be6d6b-d870-4891-891b-ab514be7d7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:12.549954 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be6d6b-d870-4891-891b-ab514be7d7da admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:12.551122 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be6d6b-d870-4891-891b-ab514be7d7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:12.551472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be6d6b-d870-4891-891b-ab514be7d7da admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:12.552276 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be6d6b-d870-4891-891b-ab514be7d7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:12.554253 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be6d6b-d870-4891-891b-ab514be7d7da admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:12.569033 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 988/1953] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:12.573784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be6d6b-d870-4891-891b-ab514be7d7da admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:12.595925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be6d6b-d870-4891-891b-ab514be7d7da admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:12.600030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 966/1954] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:21:12 2022] POST /identity/v3/projects => generated 381 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:12.603928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b4dd7-da7c-44cb-a9a2-a8e1130a473f admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:12.701739 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec7b4c-66bb-4488-b928-9a8763f03afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:12.703109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec7b4c-66bb-4488-b928-9a8763f03afb admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:12.703109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec7b4c-66bb-4488-b928-9a8763f03afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:12.703294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec7b4c-66bb-4488-b928-9a8763f03afb admin admin] PATH_INFO: `/v3/projects/e2fefdfef8c04c6eba40c0b43696de7a/users/390402db55b34c8aa30da0e3b87395a8/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:12.708794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b4dd7-da7c-44cb-a9a2-a8e1130a473f admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:12.714655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fed96a-e626-4957-a0fe-cb4eea4ec114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:12.715358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fed96a-e626-4957-a0fe-cb4eea4ec114 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:12.715644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fed96a-e626-4957-a0fe-cb4eea4ec114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:12.715922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fed96a-e626-4957-a0fe-cb4eea4ec114 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:12.716631 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fed96a-e626-4957-a0fe-cb4eea4ec114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:12.718867 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fed96a-e626-4957-a0fe-cb4eea4ec114 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:12.726774 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec7b4c-66bb-4488-b928-9a8763f03afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2fefdfef8c04c6eba40c0b43696de7a, user_id=390402db55b34c8aa30da0e3b87395a8, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:12.730342 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec7b4c-66bb-4488-b928-9a8763f03afb admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:12.862492 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 967/1955] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:21:12 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:21:12.862492 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fed96a-e626-4957-a0fe-cb4eea4ec114 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:12.868103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-c4fed96a-e626-4957-a0fe-cb4eea4ec114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:12.881268 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fed96a-e626-4957-a0fe-cb4eea4ec114 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:12.886641 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 989/1956] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:12 2022] PUT /identity/v3/projects/e2fefdfef8c04c6eba40c0b43696de7a/users/390402db55b34c8aa30da0e3b87395a8/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:12.892704 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec7b4c-66bb-4488-b928-9a8763f03afb admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:13.010934 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec7b4c-66bb-4488-b928-9a8763f03afb admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:13.019169 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2262d8-97b2-4fb9-808f-4e9584a5fd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:13.020050 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2262d8-97b2-4fb9-808f-4e9584a5fd03 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:13.020916 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2262d8-97b2-4fb9-808f-4e9584a5fd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:13.020916 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2262d8-97b2-4fb9-808f-4e9584a5fd03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:13.021352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2262d8-97b2-4fb9-808f-4e9584a5fd03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:13.031268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2262d8-97b2-4fb9-808f-4e9584a5fd03 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:13.033656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 990/1957] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:13.035397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774277c2-dd0a-4d1d-9c7b-6c5a5749028e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:13.035609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774277c2-dd0a-4d1d-9c7b-6c5a5749028e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:13.035878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774277c2-dd0a-4d1d-9c7b-6c5a5749028e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:13.068021 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edab73b-51ec-4277-b86a-a0d1b29ccc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:13.068945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edab73b-51ec-4277-b86a-a0d1b29ccc61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:13.069237 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edab73b-51ec-4277-b86a-a0d1b29ccc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:13.069520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edab73b-51ec-4277-b86a-a0d1b29ccc61 admin admin] PATH_INFO: `/v3/projects/ba5dc3f951924bd88b2c320ae5bd86a7` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:13.071608 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edab73b-51ec-4277-b86a-a0d1b29ccc61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba5dc3f951924bd88b2c320ae5bd86a7)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:13.073077 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edab73b-51ec-4277-b86a-a0d1b29ccc61 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:13.087859 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-774277c2-dd0a-4d1d-9c7b-6c5a5749028e None None] MFA Rules not processed for user `390402db55b34c8aa30da0e3b87395a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:13.089099 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-774277c2-dd0a-4d1d-9c7b-6c5a5749028e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:13.191306 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 991/1958] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:13.191306 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774277c2-dd0a-4d1d-9c7b-6c5a5749028e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:13.206272 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774277c2-dd0a-4d1d-9c7b-6c5a5749028e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:13.212002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb985cf1-d97e-41fb-95c0-a4f32ee52493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:13.213963 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb985cf1-d97e-41fb-95c0-a4f32ee52493 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:13.214360 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb985cf1-d97e-41fb-95c0-a4f32ee52493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:13.214791 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb985cf1-d97e-41fb-95c0-a4f32ee52493 admin admin] PATH_INFO: `/v3/projects/176ac011ca0c4fc696aa3212194e65cb/users/cbec270cf84a4f018f877e40d4bf6db1/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:13.236424 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb985cf1-d97e-41fb-95c0-a4f32ee52493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=176ac011ca0c4fc696aa3212194e65cb, user_id=cbec270cf84a4f018f877e40d4bf6db1, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:13.241132 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb985cf1-d97e-41fb-95c0-a4f32ee52493 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:13.365897 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 992/1959] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:13 2022] PUT /identity/v3/projects/176ac011ca0c4fc696aa3212194e65cb/users/cbec270cf84a4f018f877e40d4bf6db1/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:13.366842 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb985cf1-d97e-41fb-95c0-a4f32ee52493 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:13.377931 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6edab73b-51ec-4277-b86a-a0d1b29ccc61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba5dc3f951924bd88b2c320ae5bd86a7', 'request_id': 'req-6edab73b-51ec-4277-b86a-a0d1b29ccc61'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:13.469120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb985cf1-d97e-41fb-95c0-a4f32ee52493 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:13.469120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04409521-cd28-483a-93b6-a132dc18b027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:13.469120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04409521-cd28-483a-93b6-a132dc18b027 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:13.469120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04409521-cd28-483a-93b6-a132dc18b027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:13.469749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04409521-cd28-483a-93b6-a132dc18b027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:13.469749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04409521-cd28-483a-93b6-a132dc18b027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:13.469749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04409521-cd28-483a-93b6-a132dc18b027 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:13.527813 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6edab73b-51ec-4277-b86a-a0d1b29ccc61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba5dc3f951924bd88b2c320ae5bd86a7', 'request_id': 'req-6edab73b-51ec-4277-b86a-a0d1b29ccc61'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:13.542811 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6edab73b-51ec-4277-b86a-a0d1b29ccc61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba5dc3f951924bd88b2c320ae5bd86a7', 'request_id': 'req-6edab73b-51ec-4277-b86a-a0d1b29ccc61'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:13.759697 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6edab73b-51ec-4277-b86a-a0d1b29ccc61 admin admin] The token cache is being invalidate because project ba5dc3f951924bd88b2c320ae5bd86a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:13.759697 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6edab73b-51ec-4277-b86a-a0d1b29ccc61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:13.759697 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6edab73b-51ec-4277-b86a-a0d1b29ccc61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:13.759697 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 968/1960] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:12 2022] DELETE /identity/v3/projects/ba5dc3f951924bd88b2c320ae5bd86a7 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:13.759697 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edab73b-51ec-4277-b86a-a0d1b29ccc61 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:13.761824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-6edab73b-51ec-4277-b86a-a0d1b29ccc61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:13.761824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edab73b-51ec-4277-b86a-a0d1b29ccc61 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:13.761824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d2120-0a95-410b-be78-a590d575b8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:13.762072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d2120-0a95-410b-be78-a590d575b8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:13.762072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d2120-0a95-410b-be78-a590d575b8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:13.762072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d2120-0a95-410b-be78-a590d575b8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:13.762072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d2120-0a95-410b-be78-a590d575b8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:13.762072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d2120-0a95-410b-be78-a590d575b8a4 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:13.762072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 969/1961] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:13.762588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db372e-382b-40ee-95c4-69802f5a046e None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:13.762588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db372e-382b-40ee-95c4-69802f5a046e None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:13.762588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db372e-382b-40ee-95c4-69802f5a046e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:13.783672 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-83db372e-382b-40ee-95c4-69802f5a046e None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:13.785461 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-83db372e-382b-40ee-95c4-69802f5a046e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:13.797474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 970/1962] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:13.798404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db372e-382b-40ee-95c4-69802f5a046e None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:13.809707 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db372e-382b-40ee-95c4-69802f5a046e None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:13.817149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656af88-e680-4362-8778-e5b03e2922e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:13.818129 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656af88-e680-4362-8778-e5b03e2922e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:13.818603 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656af88-e680-4362-8778-e5b03e2922e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:13.818939 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656af88-e680-4362-8778-e5b03e2922e2 admin admin] PATH_INFO: `/v3/projects/176ac011ca0c4fc696aa3212194e65cb/users/cbec270cf84a4f018f877e40d4bf6db1/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:13.820943 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656af88-e680-4362-8778-e5b03e2922e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=176ac011ca0c4fc696aa3212194e65cb, user_id=cbec270cf84a4f018f877e40d4bf6db1, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:13.823682 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656af88-e680-4362-8778-e5b03e2922e2 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:13.836264 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 971/1963] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:13 2022] PUT /identity/v3/projects/176ac011ca0c4fc696aa3212194e65cb/users/cbec270cf84a4f018f877e40d4bf6db1/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:13.837706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b1923-fadd-4813-8a6d-02f52e081c2a None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:13.837997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b1923-fadd-4813-8a6d-02f52e081c2a None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:13.838268 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b1923-fadd-4813-8a6d-02f52e081c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:13.878392 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-182b1923-fadd-4813-8a6d-02f52e081c2a None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:13.879721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-182b1923-fadd-4813-8a6d-02f52e081c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:13.908120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 993/1964] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:21:13 2022] POST /identity/v3/projects => generated 367 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:13.908120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c889a-e62c-4254-9431-a010f9faca1b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:13.908120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c889a-e62c-4254-9431-a010f9faca1b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:13.908120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c889a-e62c-4254-9431-a010f9faca1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:13.945452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7c5c889a-e62c-4254-9431-a010f9faca1b None None] MFA Rules not processed for user `cbec270cf84a4f018f877e40d4bf6db1`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:13.946846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7c5c889a-e62c-4254-9431-a010f9faca1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:13.974307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 972/1965] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:13.975626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b1923-fadd-4813-8a6d-02f52e081c2a None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:13.977452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-182b1923-fadd-4813-8a6d-02f52e081c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:13.998140 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b1923-fadd-4813-8a6d-02f52e081c2a None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:14.057938 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 994/1966] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:14.059014 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c889a-e62c-4254-9431-a010f9faca1b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:14.088223 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b366c3-20a5-4bc8-82af-75e6e668a4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:14.089040 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b366c3-20a5-4bc8-82af-75e6e668a4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:14.090303 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b366c3-20a5-4bc8-82af-75e6e668a4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:14.090303 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b366c3-20a5-4bc8-82af-75e6e668a4d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:14.091235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b366c3-20a5-4bc8-82af-75e6e668a4d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:14.094322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b366c3-20a5-4bc8-82af-75e6e668a4d2 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:14.155502 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c889a-e62c-4254-9431-a010f9faca1b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:14.162704 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d74199-9ab2-4315-a771-591a22a99804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:14.168928 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d74199-9ab2-4315-a771-591a22a99804 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:14.168928 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d74199-9ab2-4315-a771-591a22a99804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:14.168928 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d74199-9ab2-4315-a771-591a22a99804 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:14.168928 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d74199-9ab2-4315-a771-591a22a99804 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:21:14.168928 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d74199-9ab2-4315-a771-591a22a99804 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:14.169789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d74199-9ab2-4315-a771-591a22a99804 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:14.185459 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 995/1967] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:21:14.187510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d74199-9ab2-4315-a771-591a22a99804 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:14.191720 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b3d74199-9ab2-4315-a771-591a22a99804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:14.265260 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 973/1968] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:21:13 2022] POST /identity/v3/users => generated 290 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:14.266190 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b366c3-20a5-4bc8-82af-75e6e668a4d2 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:14.282680 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b366c3-20a5-4bc8-82af-75e6e668a4d2 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:14.289978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e931f-b55d-4aec-bab8-c37ec5333a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:14.290460 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e931f-b55d-4aec-bab8-c37ec5333a4c admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:14.290831 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e931f-b55d-4aec-bab8-c37ec5333a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:14.291253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e931f-b55d-4aec-bab8-c37ec5333a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:14.291994 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e931f-b55d-4aec-bab8-c37ec5333a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:14.294177 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e931f-b55d-4aec-bab8-c37ec5333a4c admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:14.295903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d74199-9ab2-4315-a771-591a22a99804 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:14.302710 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af68c24-0758-457e-bf0c-2646abc13073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:14.304376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af68c24-0758-457e-bf0c-2646abc13073 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:14.307897 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af68c24-0758-457e-bf0c-2646abc13073 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:14.309879 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af68c24-0758-457e-bf0c-2646abc13073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:14.313417 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2af68c24-0758-457e-bf0c-2646abc13073 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:14.387327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af68c24-0758-457e-bf0c-2646abc13073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:14.388979 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af68c24-0758-457e-bf0c-2646abc13073 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:14.397015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 974/1969] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:21:14 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:14.398168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e931f-b55d-4aec-bab8-c37ec5333a4c admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:14.415778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 996/1970] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:14.418839 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af68c24-0758-457e-bf0c-2646abc13073 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:14.436732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af68c24-0758-457e-bf0c-2646abc13073 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:14.479781 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e931f-b55d-4aec-bab8-c37ec5333a4c admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:14.486576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba909de1-8966-4073-9afe-efe689b3f435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:14.487537 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba909de1-8966-4073-9afe-efe689b3f435 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:14.487824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba909de1-8966-4073-9afe-efe689b3f435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:14.488099 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba909de1-8966-4073-9afe-efe689b3f435 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:14.489072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba909de1-8966-4073-9afe-efe689b3f435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:14.490807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba909de1-8966-4073-9afe-efe689b3f435 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:14.513632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 975/1971] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:14.514874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44fdb7-0658-4c14-ac9a-3e5c056c8149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:14.515824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44fdb7-0658-4c14-ac9a-3e5c056c8149 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:14.516298 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44fdb7-0658-4c14-ac9a-3e5c056c8149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:14.516682 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44fdb7-0658-4c14-ac9a-3e5c056c8149 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:14.517470 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba909de1-8966-4073-9afe-efe689b3f435 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:14.517598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44fdb7-0658-4c14-ac9a-3e5c056c8149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:14.520420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44fdb7-0658-4c14-ac9a-3e5c056c8149 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:14.538648 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba909de1-8966-4073-9afe-efe689b3f435 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:14.549125 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0cede-a250-4a15-86d2-d1726b5db93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:14.549125 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0cede-a250-4a15-86d2-d1726b5db93d admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:14.549125 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0cede-a250-4a15-86d2-d1726b5db93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:14.549125 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0cede-a250-4a15-86d2-d1726b5db93d admin admin] PATH_INFO: `/v3/projects/e4be86f2ce814d33bdb24aa20376e1c7/users/61882906f84d4d3d9f561078cee4f2a7/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:14.564853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0cede-a250-4a15-86d2-d1726b5db93d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4be86f2ce814d33bdb24aa20376e1c7, user_id=61882906f84d4d3d9f561078cee4f2a7, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:14.568848 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0cede-a250-4a15-86d2-d1726b5db93d admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:14.598288 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 997/1972] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:21:14 2022] POST /identity/v3/users => generated 284 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:14.599777 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44fdb7-0658-4c14-ac9a-3e5c056c8149 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:14.610078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44fdb7-0658-4c14-ac9a-3e5c056c8149 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:14.620623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd02c2b-68a3-4435-9e15-9ccb37d1eb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:14.620623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd02c2b-68a3-4435-9e15-9ccb37d1eb6f admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:14.620623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd02c2b-68a3-4435-9e15-9ccb37d1eb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:14.620623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd02c2b-68a3-4435-9e15-9ccb37d1eb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:14.621005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd02c2b-68a3-4435-9e15-9ccb37d1eb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:14.621005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd02c2b-68a3-4435-9e15-9ccb37d1eb6f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:14.632778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 998/1973] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:14.635834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 976/1974] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:14 2022] PUT /identity/v3/projects/e4be86f2ce814d33bdb24aa20376e1c7/users/61882906f84d4d3d9f561078cee4f2a7/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:14.638468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd02c2b-68a3-4435-9e15-9ccb37d1eb6f admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:14.639461 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0cede-a250-4a15-86d2-d1726b5db93d admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:14.651206 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd02c2b-68a3-4435-9e15-9ccb37d1eb6f admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:14.712510 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0cede-a250-4a15-86d2-d1726b5db93d admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:14.712727 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5ba78-d030-4d6e-85d3-71574c00d306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:14.713356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5ba78-d030-4d6e-85d3-71574c00d306 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:14.713644 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5ba78-d030-4d6e-85d3-71574c00d306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:14.713909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5ba78-d030-4d6e-85d3-71574c00d306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:14.714695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5ba78-d030-4d6e-85d3-71574c00d306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:14.716314 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5ba78-d030-4d6e-85d3-71574c00d306 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:14.718520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf823cc6-c197-4a01-9a97-2cf3ae22fbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:14.719460 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf823cc6-c197-4a01-9a97-2cf3ae22fbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:14.719899 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf823cc6-c197-4a01-9a97-2cf3ae22fbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:14.720203 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf823cc6-c197-4a01-9a97-2cf3ae22fbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:14.720953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf823cc6-c197-4a01-9a97-2cf3ae22fbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:14.723286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf823cc6-c197-4a01-9a97-2cf3ae22fbb7 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:14.730906 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 999/1975] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:21:14.732043 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5ba78-d030-4d6e-85d3-71574c00d306 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:14.738494 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 977/1976] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:14.742315 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf823cc6-c197-4a01-9a97-2cf3ae22fbb7 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:14.754889 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5ba78-d030-4d6e-85d3-71574c00d306 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:14.756307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf823cc6-c197-4a01-9a97-2cf3ae22fbb7 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:14.761664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccef80-e3c8-4169-87dc-a26a2f0bb076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:14.762658 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccef80-e3c8-4169-87dc-a26a2f0bb076 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:14.763231 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccef80-e3c8-4169-87dc-a26a2f0bb076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:14.763448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee72eb5-b601-4ec6-b3e0-c14f491d2197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:14.763656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccef80-e3c8-4169-87dc-a26a2f0bb076 admin admin] PATH_INFO: `/v3/projects/070137d4f7db4fd3a9d749ab528b63fa/users/ec3e17165e9b4cecbe35acf44a09084c/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:14.764472 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee72eb5-b601-4ec6-b3e0-c14f491d2197 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:14.764883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee72eb5-b601-4ec6-b3e0-c14f491d2197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:14.765329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee72eb5-b601-4ec6-b3e0-c14f491d2197 admin admin] PATH_INFO: `/v3/projects/e4be86f2ce814d33bdb24aa20376e1c7/users/61882906f84d4d3d9f561078cee4f2a7/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:14.772258 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee72eb5-b601-4ec6-b3e0-c14f491d2197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4be86f2ce814d33bdb24aa20376e1c7, user_id=61882906f84d4d3d9f561078cee4f2a7, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:14.772258 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee72eb5-b601-4ec6-b3e0-c14f491d2197 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:14.785840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 978/1977] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:14 2022] PUT /identity/v3/projects/e4be86f2ce814d33bdb24aa20376e1c7/users/61882906f84d4d3d9f561078cee4f2a7/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:21:14.796009 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccef80-e3c8-4169-87dc-a26a2f0bb076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070137d4f7db4fd3a9d749ab528b63fa, user_id=ec3e17165e9b4cecbe35acf44a09084c, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:14.796009 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccef80-e3c8-4169-87dc-a26a2f0bb076 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:14.798118 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80ef3a-4e54-499f-87df-5850cf4bf9fd None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:14.798612 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80ef3a-4e54-499f-87df-5850cf4bf9fd None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:14.798809 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80ef3a-4e54-499f-87df-5850cf4bf9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:14.839687 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-ef80ef3a-4e54-499f-87df-5850cf4bf9fd None None] MFA Rules not processed for user `61882906f84d4d3d9f561078cee4f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:14.841008 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-ef80ef3a-4e54-499f-87df-5850cf4bf9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:14.855177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1000/1978] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:14 2022] PUT /identity/v3/projects/070137d4f7db4fd3a9d749ab528b63fa/users/ec3e17165e9b4cecbe35acf44a09084c/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:14.866129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d6242-9288-4dad-aa80-1ef7940bf2b1 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:14.866427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d6242-9288-4dad-aa80-1ef7940bf2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:14.870158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d6242-9288-4dad-aa80-1ef7940bf2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:14.911842 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-339d6242-9288-4dad-aa80-1ef7940bf2b1 None None] MFA Rules not processed for user `ec3e17165e9b4cecbe35acf44a09084c`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:14.913263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-339d6242-9288-4dad-aa80-1ef7940bf2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:14.933644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 979/1979] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:14 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:14.948142 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80ef3a-4e54-499f-87df-5850cf4bf9fd None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:14.983292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1001/1980] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:14.994789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d6242-9288-4dad-aa80-1ef7940bf2b1 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:14.996138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-339d6242-9288-4dad-aa80-1ef7940bf2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:15.009466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80ef3a-4e54-499f-87df-5850cf4bf9fd None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:15.052737 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d6242-9288-4dad-aa80-1ef7940bf2b1 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:15.056346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd545d53-ba03-422b-be54-5326f34301fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2b6514779d42fa81d34351607dea27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:15.057134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd545d53-ba03-422b-be54-5326f34301fc service glance] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:15.057261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16413d15-0adc-4166-a728-64a2e9e18b47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:15.057425 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd545d53-ba03-422b-be54-5326f34301fc service glance] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:15.057720 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd545d53-ba03-422b-be54-5326f34301fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:15.057826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16413d15-0adc-4166-a728-64a2e9e18b47 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:15.058071 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16413d15-0adc-4166-a728-64a2e9e18b47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:15.058343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16413d15-0adc-4166-a728-64a2e9e18b47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:15.067079 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd545d53-ba03-422b-be54-5326f34301fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:15.068652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd545d53-ba03-422b-be54-5326f34301fc service glance] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:15.079144 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1002/1981] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:21:15.123463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16413d15-0adc-4166-a728-64a2e9e18b47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:15.125026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16413d15-0adc-4166-a728-64a2e9e18b47 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:15.136824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 980/1982] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:14 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:21:15.456324 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd545d53-ba03-422b-be54-5326f34301fc service glance] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:15.465388 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd545d53-ba03-422b-be54-5326f34301fc service glance] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:15.469446 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd92b1-3c1e-4c17-a770-140d3947f27e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:15.470114 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd92b1-3c1e-4c17-a770-140d3947f27e service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:15.470488 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd92b1-3c1e-4c17-a770-140d3947f27e service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:15.470701 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd92b1-3c1e-4c17-a770-140d3947f27e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:15.473035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-29fd92b1-3c1e-4c17-a770-140d3947f27e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:15.533326 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd92b1-3c1e-4c17-a770-140d3947f27e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:15.535337 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd92b1-3c1e-4c17-a770-140d3947f27e service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:15.544238 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1003/1983] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:19.939360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16413d15-0adc-4166-a728-64a2e9e18b47 service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:19.963947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16413d15-0adc-4166-a728-64a2e9e18b47 service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:19.963947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4608115-ccc7-418c-a83c-4225e8c3aaca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:19.963947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4608115-ccc7-418c-a83c-4225e8c3aaca service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:19.963947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4608115-ccc7-418c-a83c-4225e8c3aaca service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:19.964281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4608115-ccc7-418c-a83c-4225e8c3aaca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:20.019584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4608115-ccc7-418c-a83c-4225e8c3aaca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:20.021644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4608115-ccc7-418c-a83c-4225e8c3aaca service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:20.033410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 981/1984] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:22.077931 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd92b1-3c1e-4c17-a770-140d3947f27e service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:22.153273 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd92b1-3c1e-4c17-a770-140d3947f27e service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:22.158636 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdda24-ebaa-48d9-ae04-53e96537cc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:22.159530 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdda24-ebaa-48d9-ae04-53e96537cc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:22.159818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdda24-ebaa-48d9-ae04-53e96537cc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:22.160100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdda24-ebaa-48d9-ae04-53e96537cc48 admin admin] PATH_INFO: `/v3/users/390402db55b34c8aa30da0e3b87395a8` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:22.161827 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdda24-ebaa-48d9-ae04-53e96537cc48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=390402db55b34c8aa30da0e3b87395a8)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:22.163767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdda24-ebaa-48d9-ae04-53e96537cc48 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:22.328073 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6bcdda24-ebaa-48d9-ae04-53e96537cc48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '390402db55b34c8aa30da0e3b87395a8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:22.328659 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6bcdda24-ebaa-48d9-ae04-53e96537cc48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '390402db55b34c8aa30da0e3b87395a8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:22.329270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6bcdda24-ebaa-48d9-ae04-53e96537cc48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '390402db55b34c8aa30da0e3b87395a8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:22.342421 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6bcdda24-ebaa-48d9-ae04-53e96537cc48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '390402db55b34c8aa30da0e3b87395a8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:22.350595 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6bcdda24-ebaa-48d9-ae04-53e96537cc48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '390402db55b34c8aa30da0e3b87395a8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:22.424502 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1004/1985] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:22 2022] DELETE /identity/v3/users/390402db55b34c8aa30da0e3b87395a8 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:22.430096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf6682-e9d7-4091-be63-8b3e3915716f None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:22.430730 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf6682-e9d7-4091-be63-8b3e3915716f None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:22.430730 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf6682-e9d7-4091-be63-8b3e3915716f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:22.450197 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-39bf6682-e9d7-4091-be63-8b3e3915716f None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:22.451447 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-39bf6682-e9d7-4091-be63-8b3e3915716f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:22.509950 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 982/1986] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:22.520326 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdda24-ebaa-48d9-ae04-53e96537cc48 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:22.524118 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6bcdda24-ebaa-48d9-ae04-53e96537cc48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:22.577610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdda24-ebaa-48d9-ae04-53e96537cc48 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:22.581492 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf74dd-61b4-4a41-8028-189c65179e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:22.582082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf74dd-61b4-4a41-8028-189c65179e9a service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:22.583072 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf74dd-61b4-4a41-8028-189c65179e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:22.583358 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf74dd-61b4-4a41-8028-189c65179e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:22.592722 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf74dd-61b4-4a41-8028-189c65179e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:22.594159 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf74dd-61b4-4a41-8028-189c65179e9a service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:22.604717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1005/1987] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:22.810938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf6682-e9d7-4091-be63-8b3e3915716f None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:22.815078 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-39bf6682-e9d7-4091-be63-8b3e3915716f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:22.825315 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf6682-e9d7-4091-be63-8b3e3915716f None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:22.830744 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf03dae-7aa3-4ffb-9afc-5c19ea6ca48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:22.831724 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf03dae-7aa3-4ffb-9afc-5c19ea6ca48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:22.831932 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf03dae-7aa3-4ffb-9afc-5c19ea6ca48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:22.832731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf03dae-7aa3-4ffb-9afc-5c19ea6ca48c admin admin] PATH_INFO: `/v3/users/250d6a26720a4416b62f5f7b2c646c80` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:22.834614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf03dae-7aa3-4ffb-9afc-5c19ea6ca48c admin admin] RBAC: Authorizing `identity:delete_user(user_id=250d6a26720a4416b62f5f7b2c646c80)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:22.836263 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf03dae-7aa3-4ffb-9afc-5c19ea6ca48c admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:23.025558 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-1cf03dae-7aa3-4ffb-9afc-5c19ea6ca48c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '250d6a26720a4416b62f5f7b2c646c80'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:23.026863 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-1cf03dae-7aa3-4ffb-9afc-5c19ea6ca48c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '250d6a26720a4416b62f5f7b2c646c80'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:23.038683 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf74dd-61b4-4a41-8028-189c65179e9a service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:23.041660 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a5cf74dd-61b4-4a41-8028-189c65179e9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:23.045406 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-1cf03dae-7aa3-4ffb-9afc-5c19ea6ca48c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '250d6a26720a4416b62f5f7b2c646c80'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:23.046412 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-1cf03dae-7aa3-4ffb-9afc-5c19ea6ca48c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '250d6a26720a4416b62f5f7b2c646c80'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:23.055351 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-1cf03dae-7aa3-4ffb-9afc-5c19ea6ca48c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '250d6a26720a4416b62f5f7b2c646c80'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:23.056749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf74dd-61b4-4a41-8028-189c65179e9a service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:23.062839 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0f66c-fc1e-4129-a4e2-af1916b8c1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:23.064138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0f66c-fc1e-4129-a4e2-af1916b8c1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:23.064450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0f66c-fc1e-4129-a4e2-af1916b8c1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:23.064779 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0f66c-fc1e-4129-a4e2-af1916b8c1cf admin admin] PATH_INFO: `/v3/projects/e2fefdfef8c04c6eba40c0b43696de7a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:23.065953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0f66c-fc1e-4129-a4e2-af1916b8c1cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2fefdfef8c04c6eba40c0b43696de7a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:23.070189 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0f66c-fc1e-4129-a4e2-af1916b8c1cf admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:23.103797 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 983/1988] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:22 2022] DELETE /identity/v3/users/250d6a26720a4416b62f5f7b2c646c80 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:23.153779 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-86d0f66c-fc1e-4129-a4e2-af1916b8c1cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2fefdfef8c04c6eba40c0b43696de7a', 'request_id': 'req-86d0f66c-fc1e-4129-a4e2-af1916b8c1cf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:23.267802 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-86d0f66c-fc1e-4129-a4e2-af1916b8c1cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2fefdfef8c04c6eba40c0b43696de7a', 'request_id': 'req-86d0f66c-fc1e-4129-a4e2-af1916b8c1cf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:23.276866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-86d0f66c-fc1e-4129-a4e2-af1916b8c1cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2fefdfef8c04c6eba40c0b43696de7a', 'request_id': 'req-86d0f66c-fc1e-4129-a4e2-af1916b8c1cf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:23.290349 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-86d0f66c-fc1e-4129-a4e2-af1916b8c1cf admin admin] The token cache is being invalidate because project e2fefdfef8c04c6eba40c0b43696de7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:23.290674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-86d0f66c-fc1e-4129-a4e2-af1916b8c1cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:23.291339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-86d0f66c-fc1e-4129-a4e2-af1916b8c1cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:23.292895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1006/1989] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:23 2022] DELETE /identity/v3/projects/e2fefdfef8c04c6eba40c0b43696de7a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:23.297084 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf03dae-7aa3-4ffb-9afc-5c19ea6ca48c admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:23.298523 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-1cf03dae-7aa3-4ffb-9afc-5c19ea6ca48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:23.339339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0f66c-fc1e-4129-a4e2-af1916b8c1cf admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:23.340849 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-86d0f66c-fc1e-4129-a4e2-af1916b8c1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:23.373356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf03dae-7aa3-4ffb-9afc-5c19ea6ca48c admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:23.411360 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0f66c-fc1e-4129-a4e2-af1916b8c1cf admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:23.416130 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e18973-f564-4f36-803f-eef5e4d67ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:23.417292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e18973-f564-4f36-803f-eef5e4d67ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:23.417532 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e18973-f564-4f36-803f-eef5e4d67ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:23.417652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e18973-f564-4f36-803f-eef5e4d67ff8 admin admin] PATH_INFO: `/v3/projects/e738363e9f184b01a86d3459779cdfb4` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:23.418874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e18973-f564-4f36-803f-eef5e4d67ff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e738363e9f184b01a86d3459779cdfb4)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:23.420755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e18973-f564-4f36-803f-eef5e4d67ff8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:23.437199 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf040684-827e-4fa3-9162-ddddb68e3928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:23.438094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf040684-827e-4fa3-9162-ddddb68e3928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:23.438431 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf040684-827e-4fa3-9162-ddddb68e3928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:23.438993 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf040684-827e-4fa3-9162-ddddb68e3928 admin admin] PATH_INFO: `/v3/users/61882906f84d4d3d9f561078cee4f2a7` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:23.439946 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf040684-827e-4fa3-9162-ddddb68e3928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61882906f84d4d3d9f561078cee4f2a7)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:23.442740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf040684-827e-4fa3-9162-ddddb68e3928 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:23.520326 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-24e18973-f564-4f36-803f-eef5e4d67ff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e738363e9f184b01a86d3459779cdfb4', 'request_id': 'req-24e18973-f564-4f36-803f-eef5e4d67ff8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:23.622975 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-24e18973-f564-4f36-803f-eef5e4d67ff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e738363e9f184b01a86d3459779cdfb4', 'request_id': 'req-24e18973-f564-4f36-803f-eef5e4d67ff8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:23.633936 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-24e18973-f564-4f36-803f-eef5e4d67ff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e738363e9f184b01a86d3459779cdfb4', 'request_id': 'req-24e18973-f564-4f36-803f-eef5e4d67ff8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:23.640804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-24e18973-f564-4f36-803f-eef5e4d67ff8 admin admin] The token cache is being invalidate because project e738363e9f184b01a86d3459779cdfb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:23.641095 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-24e18973-f564-4f36-803f-eef5e4d67ff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:23.641785 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-24e18973-f564-4f36-803f-eef5e4d67ff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:23.643367 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1007/1990] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:23 2022] DELETE /identity/v3/projects/e738363e9f184b01a86d3459779cdfb4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:21:23.648225 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883693b-afca-42f1-817d-3ed55e88ec2f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:23.648512 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883693b-afca-42f1-817d-3ed55e88ec2f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:23.649024 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883693b-afca-42f1-817d-3ed55e88ec2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:23.668202 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6883693b-afca-42f1-817d-3ed55e88ec2f None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:23.669311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6883693b-afca-42f1-817d-3ed55e88ec2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:23.700492 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-cf040684-827e-4fa3-9162-ddddb68e3928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61882906f84d4d3d9f561078cee4f2a7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:23.701185 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-cf040684-827e-4fa3-9162-ddddb68e3928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61882906f84d4d3d9f561078cee4f2a7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:23.715266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-cf040684-827e-4fa3-9162-ddddb68e3928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61882906f84d4d3d9f561078cee4f2a7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:23.716238 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-cf040684-827e-4fa3-9162-ddddb68e3928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61882906f84d4d3d9f561078cee4f2a7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:23.727054 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-cf040684-827e-4fa3-9162-ddddb68e3928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61882906f84d4d3d9f561078cee4f2a7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:23.733972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1008/1991] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:23.742361 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bda02-d2e4-4286-a909-4aed0ea04da1 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:23.742645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bda02-d2e4-4286-a909-4aed0ea04da1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:23.742930 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bda02-d2e4-4286-a909-4aed0ea04da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:23.760859 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d56bda02-d2e4-4286-a909-4aed0ea04da1 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:23.762060 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d56bda02-d2e4-4286-a909-4aed0ea04da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:23.771149 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1009/1992] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:23.775140 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bda02-d2e4-4286-a909-4aed0ea04da1 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:23.784274 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bda02-d2e4-4286-a909-4aed0ea04da1 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:23.789585 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bcf8e-79e9-4c83-a110-7d086cdd2e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:23.790224 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bcf8e-79e9-4c83-a110-7d086cdd2e15 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:23.790549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bcf8e-79e9-4c83-a110-7d086cdd2e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:23.790829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bcf8e-79e9-4c83-a110-7d086cdd2e15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:23.791552 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599bcf8e-79e9-4c83-a110-7d086cdd2e15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:21:23.791860 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599bcf8e-79e9-4c83-a110-7d086cdd2e15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:23.793435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599bcf8e-79e9-4c83-a110-7d086cdd2e15 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:23.805351 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1010/1993] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:21:23.809337 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bcf8e-79e9-4c83-a110-7d086cdd2e15 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:23.816632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 984/1994] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:23 2022] DELETE /identity/v3/users/61882906f84d4d3d9f561078cee4f2a7 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:23.818857 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bcf8e-79e9-4c83-a110-7d086cdd2e15 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:23.883101 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8399361-2077-4d6d-85c0-2ae1dea495ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:23.884030 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8399361-2077-4d6d-85c0-2ae1dea495ba admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:23.884369 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8399361-2077-4d6d-85c0-2ae1dea495ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:23.884644 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8399361-2077-4d6d-85c0-2ae1dea495ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:23.885623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8399361-2077-4d6d-85c0-2ae1dea495ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:23.887501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8399361-2077-4d6d-85c0-2ae1dea495ba admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:23.984233 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1011/1995] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:21:23 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:21:23.988431 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf040684-827e-4fa3-9162-ddddb68e3928 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:23.998642 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf040684-827e-4fa3-9162-ddddb68e3928 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:24.062927 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e859e7-ca01-4b2b-b6c8-b70715f5005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:24.063667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e859e7-ca01-4b2b-b6c8-b70715f5005f admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:24.063904 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e859e7-ca01-4b2b-b6c8-b70715f5005f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:24.064180 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e859e7-ca01-4b2b-b6c8-b70715f5005f admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:24.064884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e859e7-ca01-4b2b-b6c8-b70715f5005f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:24.067103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e859e7-ca01-4b2b-b6c8-b70715f5005f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:24.157815 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 985/1996] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:21:23 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:24.159031 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8399361-2077-4d6d-85c0-2ae1dea495ba admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:24.170217 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8399361-2077-4d6d-85c0-2ae1dea495ba admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:24.175049 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471099b-f77f-445a-ae8a-dfbb05779444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:24.175726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471099b-f77f-445a-ae8a-dfbb05779444 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:24.176016 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471099b-f77f-445a-ae8a-dfbb05779444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:24.176882 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471099b-f77f-445a-ae8a-dfbb05779444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:24.177636 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471099b-f77f-445a-ae8a-dfbb05779444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:24.179396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471099b-f77f-445a-ae8a-dfbb05779444 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:24.190357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1012/1997] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:21:24.197165 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e859e7-ca01-4b2b-b6c8-b70715f5005f admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:24.207490 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e859e7-ca01-4b2b-b6c8-b70715f5005f admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:24.212418 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd1600-e826-4a43-ba63-c6c09233a94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:24.213183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd1600-e826-4a43-ba63-c6c09233a94f admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:24.213540 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd1600-e826-4a43-ba63-c6c09233a94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:24.213890 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd1600-e826-4a43-ba63-c6c09233a94f admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:24.214739 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd1600-e826-4a43-ba63-c6c09233a94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:24.216397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd1600-e826-4a43-ba63-c6c09233a94f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:24.226965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 986/1998] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:24.237341 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471099b-f77f-445a-ae8a-dfbb05779444 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:24.247662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471099b-f77f-445a-ae8a-dfbb05779444 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:24.252453 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b39162-f959-4f12-890e-4ee8411c6324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:24.253325 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b39162-f959-4f12-890e-4ee8411c6324 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:24.253608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b39162-f959-4f12-890e-4ee8411c6324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:24.253885 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b39162-f959-4f12-890e-4ee8411c6324 admin admin] PATH_INFO: `/v3/projects/ec32ce28e7cf4bd8b127425ac07a7179/users/94c2a15d67c24e9187db81d2a6193113/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:24.278222 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b39162-f959-4f12-890e-4ee8411c6324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec32ce28e7cf4bd8b127425ac07a7179, user_id=94c2a15d67c24e9187db81d2a6193113, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:24.280908 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b39162-f959-4f12-890e-4ee8411c6324 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:24.305878 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd1600-e826-4a43-ba63-c6c09233a94f admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:24.309089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-32cd1600-e826-4a43-ba63-c6c09233a94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:24.325357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd1600-e826-4a43-ba63-c6c09233a94f admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:24.330248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a629bf-bb0b-4341-ba47-21e0c5db7282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:24.337704 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a629bf-bb0b-4341-ba47-21e0c5db7282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:24.337704 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a629bf-bb0b-4341-ba47-21e0c5db7282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:24.337704 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a629bf-bb0b-4341-ba47-21e0c5db7282 admin admin] PATH_INFO: `/v3/projects/e4be86f2ce814d33bdb24aa20376e1c7` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:24.337704 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a629bf-bb0b-4341-ba47-21e0c5db7282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4be86f2ce814d33bdb24aa20376e1c7)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:24.337704 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a629bf-bb0b-4341-ba47-21e0c5db7282 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:24.394422 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1013/1999] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:24 2022] PUT /identity/v3/projects/ec32ce28e7cf4bd8b127425ac07a7179/users/94c2a15d67c24e9187db81d2a6193113/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:24.404364 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b625dc-637c-4c85-8219-d347438f7680 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:24.404655 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b625dc-637c-4c85-8219-d347438f7680 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:24.404929 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b625dc-637c-4c85-8219-d347438f7680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:24.431540 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-43b625dc-637c-4c85-8219-d347438f7680 None None] MFA Rules not processed for user `94c2a15d67c24e9187db81d2a6193113`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:24.432733 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-43b625dc-637c-4c85-8219-d347438f7680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:24.434291 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c4a629bf-bb0b-4341-ba47-21e0c5db7282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4be86f2ce814d33bdb24aa20376e1c7', 'request_id': 'req-c4a629bf-bb0b-4341-ba47-21e0c5db7282'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:24.496746 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1014/2000] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:24.502875 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c4a629bf-bb0b-4341-ba47-21e0c5db7282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4be86f2ce814d33bdb24aa20376e1c7', 'request_id': 'req-c4a629bf-bb0b-4341-ba47-21e0c5db7282'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:24.511544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b625dc-637c-4c85-8219-d347438f7680 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:24.513341 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c4a629bf-bb0b-4341-ba47-21e0c5db7282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4be86f2ce814d33bdb24aa20376e1c7', 'request_id': 'req-c4a629bf-bb0b-4341-ba47-21e0c5db7282'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:24.513480 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-43b625dc-637c-4c85-8219-d347438f7680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:24.527115 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c4a629bf-bb0b-4341-ba47-21e0c5db7282 admin admin] The token cache is being invalidate because project e4be86f2ce814d33bdb24aa20376e1c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:24.527397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c4a629bf-bb0b-4341-ba47-21e0c5db7282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:24.528339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c4a629bf-bb0b-4341-ba47-21e0c5db7282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:24.529869 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 987/2001] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:24 2022] DELETE /identity/v3/projects/e4be86f2ce814d33bdb24aa20376e1c7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:21:24.534528 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49d577-0930-4d74-a857-060d0e4d98cf None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:24.534815 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49d577-0930-4d74-a857-060d0e4d98cf None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:24.535830 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49d577-0930-4d74-a857-060d0e4d98cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:24.552338 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-5a49d577-0930-4d74-a857-060d0e4d98cf None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:24.553545 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-5a49d577-0930-4d74-a857-060d0e4d98cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:24.586669 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b625dc-637c-4c85-8219-d347438f7680 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:24.592500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e16d6-4eff-43f3-a3cb-2738134ad416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:24.593152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e16d6-4eff-43f3-a3cb-2738134ad416 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:24.593439 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e16d6-4eff-43f3-a3cb-2738134ad416 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:24.593718 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e16d6-4eff-43f3-a3cb-2738134ad416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:24.595518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-485e16d6-4eff-43f3-a3cb-2738134ad416 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:24.606762 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e16d6-4eff-43f3-a3cb-2738134ad416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:24.610233 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e16d6-4eff-43f3-a3cb-2738134ad416 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:24.613011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 988/2002] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:24.618372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1015/2003] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:24.621254 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61505098-c9c2-457b-a6ec-daf6e20fb078 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:24.621567 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61505098-c9c2-457b-a6ec-daf6e20fb078 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:24.621879 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61505098-c9c2-457b-a6ec-daf6e20fb078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:24.641163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-61505098-c9c2-457b-a6ec-daf6e20fb078 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:24.642501 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-61505098-c9c2-457b-a6ec-daf6e20fb078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:24.650768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 989/2004] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:24.655400 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e16d6-4eff-43f3-a3cb-2738134ad416 service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:24.667004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e16d6-4eff-43f3-a3cb-2738134ad416 service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:24.671880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7dbc5-8e20-4d48-bf58-cb3e6e8ef15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:24.672622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7dbc5-8e20-4d48-bf58-cb3e6e8ef15a admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:24.673026 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7dbc5-8e20-4d48-bf58-cb3e6e8ef15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:24.673310 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7dbc5-8e20-4d48-bf58-cb3e6e8ef15a admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:24.674040 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7dbc5-8e20-4d48-bf58-cb3e6e8ef15a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:21:24.674351 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7dbc5-8e20-4d48-bf58-cb3e6e8ef15a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:24.675951 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7dbc5-8e20-4d48-bf58-cb3e6e8ef15a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:24.691545 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1016/2005] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:21:24.696572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61505098-c9c2-457b-a6ec-daf6e20fb078 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:24.706643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61505098-c9c2-457b-a6ec-daf6e20fb078 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:24.712620 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50528bc6-21ec-45e7-868f-1d8843baf28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:24.713202 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50528bc6-21ec-45e7-868f-1d8843baf28a admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:24.713486 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50528bc6-21ec-45e7-868f-1d8843baf28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:24.713759 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50528bc6-21ec-45e7-868f-1d8843baf28a admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:24.714519 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50528bc6-21ec-45e7-868f-1d8843baf28a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:24.716420 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50528bc6-21ec-45e7-868f-1d8843baf28a admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:24.853344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 990/2006] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:21:24 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:24.857943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7dbc5-8e20-4d48-bf58-cb3e6e8ef15a admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:24.868269 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7dbc5-8e20-4d48-bf58-cb3e6e8ef15a admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:24.924912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779bf13-d798-4ef3-8ed5-20e3a5a253b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:24.925502 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779bf13-d798-4ef3-8ed5-20e3a5a253b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:24.925787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779bf13-d798-4ef3-8ed5-20e3a5a253b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:24.926071 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779bf13-d798-4ef3-8ed5-20e3a5a253b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:24.927136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779bf13-d798-4ef3-8ed5-20e3a5a253b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:24.929047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779bf13-d798-4ef3-8ed5-20e3a5a253b8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:25.036769 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1017/2007] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:21:24 2022] POST /identity/v3/users => generated 281 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:21:25.041602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50528bc6-21ec-45e7-868f-1d8843baf28a admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:25.054374 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50528bc6-21ec-45e7-868f-1d8843baf28a admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:25.059024 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa456d-c7e0-43c7-8dfb-cda3ca74aff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:25.059677 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa456d-c7e0-43c7-8dfb-cda3ca74aff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:25.059957 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa456d-c7e0-43c7-8dfb-cda3ca74aff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:25.060260 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa456d-c7e0-43c7-8dfb-cda3ca74aff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:25.060960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa456d-c7e0-43c7-8dfb-cda3ca74aff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:25.062597 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa456d-c7e0-43c7-8dfb-cda3ca74aff4 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:25.073516 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 991/2008] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:25.077690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779bf13-d798-4ef3-8ed5-20e3a5a253b8 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:25.091068 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779bf13-d798-4ef3-8ed5-20e3a5a253b8 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:25.096011 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41784ea7-67eb-41c5-adaf-4aa168e8a6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:25.096764 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41784ea7-67eb-41c5-adaf-4aa168e8a6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:25.097042 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41784ea7-67eb-41c5-adaf-4aa168e8a6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:25.097318 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41784ea7-67eb-41c5-adaf-4aa168e8a6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:25.098873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41784ea7-67eb-41c5-adaf-4aa168e8a6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:25.100003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41784ea7-67eb-41c5-adaf-4aa168e8a6d9 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:25.112425 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1018/2009] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:21:25.116916 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa456d-c7e0-43c7-8dfb-cda3ca74aff4 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:25.126931 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa456d-c7e0-43c7-8dfb-cda3ca74aff4 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:25.132690 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876e472-8be6-40b1-94e0-ea710d8d2f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:25.133590 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876e472-8be6-40b1-94e0-ea710d8d2f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:25.134123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876e472-8be6-40b1-94e0-ea710d8d2f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:25.134403 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876e472-8be6-40b1-94e0-ea710d8d2f8b admin admin] PATH_INFO: `/v3/projects/3be646c207a547038903b30f19c2e230/users/2915b5f73e744e87836185289c277757/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:25.155381 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876e472-8be6-40b1-94e0-ea710d8d2f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be646c207a547038903b30f19c2e230, user_id=2915b5f73e744e87836185289c277757, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:25.158385 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876e472-8be6-40b1-94e0-ea710d8d2f8b admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:25.269496 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 992/2010] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:25 2022] PUT /identity/v3/projects/3be646c207a547038903b30f19c2e230/users/2915b5f73e744e87836185289c277757/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:25.281949 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcc665-aa29-4d75-b092-634f4826d88d None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:25.282469 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcc665-aa29-4d75-b092-634f4826d88d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:25.282559 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcc665-aa29-4d75-b092-634f4826d88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:25.309673 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-befcc665-aa29-4d75-b092-634f4826d88d None None] MFA Rules not processed for user `2915b5f73e744e87836185289c277757`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:25.311481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-befcc665-aa29-4d75-b092-634f4826d88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:25.397327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1019/2011] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:25.443267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876e472-8be6-40b1-94e0-ea710d8d2f8b admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:25.445126 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-2876e472-8be6-40b1-94e0-ea710d8d2f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:25.511273 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876e472-8be6-40b1-94e0-ea710d8d2f8b admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:25.515173 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020e4f3-1078-46e0-aae5-6330124e660e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:25.515856 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020e4f3-1078-46e0-aae5-6330124e660e service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:25.516140 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020e4f3-1078-46e0-aae5-6330124e660e service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:25.516425 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020e4f3-1078-46e0-aae5-6330124e660e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:25.525029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020e4f3-1078-46e0-aae5-6330124e660e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:25.526465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020e4f3-1078-46e0-aae5-6330124e660e service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:25.535393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 993/2012] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:25.549952 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcc665-aa29-4d75-b092-634f4826d88d None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:25.613140 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcc665-aa29-4d75-b092-634f4826d88d None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:25.618222 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de0c44-bbcd-4311-900f-184fd106bd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:25.619128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de0c44-bbcd-4311-900f-184fd106bd89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:25.619414 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de0c44-bbcd-4311-900f-184fd106bd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:25.619687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de0c44-bbcd-4311-900f-184fd106bd89 admin admin] PATH_INFO: `/v3/users/2915b5f73e744e87836185289c277757` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:25.620875 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de0c44-bbcd-4311-900f-184fd106bd89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2915b5f73e744e87836185289c277757)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:25.622864 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de0c44-bbcd-4311-900f-184fd106bd89 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:25.813414 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-68de0c44-bbcd-4311-900f-184fd106bd89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2915b5f73e744e87836185289c277757'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:25.813985 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-68de0c44-bbcd-4311-900f-184fd106bd89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2915b5f73e744e87836185289c277757'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:25.814681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-68de0c44-bbcd-4311-900f-184fd106bd89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2915b5f73e744e87836185289c277757'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:25.827086 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-68de0c44-bbcd-4311-900f-184fd106bd89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2915b5f73e744e87836185289c277757'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:25.833903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-68de0c44-bbcd-4311-900f-184fd106bd89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2915b5f73e744e87836185289c277757'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:25.907867 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1020/2013] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:25 2022] DELETE /identity/v3/users/2915b5f73e744e87836185289c277757 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:25.912419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31239362-7fe9-4dc9-8e87-a3fa2224ddc1 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:25.912717 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31239362-7fe9-4dc9-8e87-a3fa2224ddc1 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:25.912996 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31239362-7fe9-4dc9-8e87-a3fa2224ddc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:25.931680 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-31239362-7fe9-4dc9-8e87-a3fa2224ddc1 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:25.932862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-31239362-7fe9-4dc9-8e87-a3fa2224ddc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:25.991049 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 994/2014] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:26.001641 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de0c44-bbcd-4311-900f-184fd106bd89 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:26.003061 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-68de0c44-bbcd-4311-900f-184fd106bd89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:26.059051 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de0c44-bbcd-4311-900f-184fd106bd89 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:26.062855 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5afd2c-5c04-4ad2-ab78-33bff06215c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:26.066231 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5afd2c-5c04-4ad2-ab78-33bff06215c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:26.066231 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5afd2c-5c04-4ad2-ab78-33bff06215c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:26.066231 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5afd2c-5c04-4ad2-ab78-33bff06215c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:26.074520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31239362-7fe9-4dc9-8e87-a3fa2224ddc1 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:26.075262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5afd2c-5c04-4ad2-ab78-33bff06215c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:26.076184 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-31239362-7fe9-4dc9-8e87-a3fa2224ddc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:26.076688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5afd2c-5c04-4ad2-ab78-33bff06215c0 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:26.088443 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1021/2015] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:26.092142 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31239362-7fe9-4dc9-8e87-a3fa2224ddc1 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:26.097183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4124b72-a69d-4e42-a1a4-70f2aebefe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:26.098210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4124b72-a69d-4e42-a1a4-70f2aebefe39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:26.098609 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4124b72-a69d-4e42-a1a4-70f2aebefe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:26.098957 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4124b72-a69d-4e42-a1a4-70f2aebefe39 admin admin] PATH_INFO: `/v3/users/bc2457eef9e54661b34ec9da331b1646` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:26.100261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4124b72-a69d-4e42-a1a4-70f2aebefe39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc2457eef9e54661b34ec9da331b1646)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:26.102398 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4124b72-a69d-4e42-a1a4-70f2aebefe39 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:26.406215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-b4124b72-a69d-4e42-a1a4-70f2aebefe39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc2457eef9e54661b34ec9da331b1646'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:26.407101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-b4124b72-a69d-4e42-a1a4-70f2aebefe39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc2457eef9e54661b34ec9da331b1646'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:26.422695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-b4124b72-a69d-4e42-a1a4-70f2aebefe39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc2457eef9e54661b34ec9da331b1646'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:26.425004 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-b4124b72-a69d-4e42-a1a4-70f2aebefe39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc2457eef9e54661b34ec9da331b1646'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:26.435352 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-b4124b72-a69d-4e42-a1a4-70f2aebefe39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc2457eef9e54661b34ec9da331b1646'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:26.515760 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 995/2016] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:26 2022] DELETE /identity/v3/users/bc2457eef9e54661b34ec9da331b1646 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:26.520138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fbad8-982b-4e8f-99f3-d71d79755f74 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:26.520562 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fbad8-982b-4e8f-99f3-d71d79755f74 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:26.520988 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fbad8-982b-4e8f-99f3-d71d79755f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:26.540346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-5e4fbad8-982b-4e8f-99f3-d71d79755f74 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:26.541545 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5e4fbad8-982b-4e8f-99f3-d71d79755f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:26.608887 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1022/2017] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:26.619333 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4124b72-a69d-4e42-a1a4-70f2aebefe39 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:26.620502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-b4124b72-a69d-4e42-a1a4-70f2aebefe39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:26.644394 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fbad8-982b-4e8f-99f3-d71d79755f74 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:26.649051 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5e4fbad8-982b-4e8f-99f3-d71d79755f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:26.666286 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fbad8-982b-4e8f-99f3-d71d79755f74 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:26.689755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441d32c-e52d-4c0f-bdde-6ffcc1f7e96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:26.690689 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441d32c-e52d-4c0f-bdde-6ffcc1f7e96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:26.691135 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441d32c-e52d-4c0f-bdde-6ffcc1f7e96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:26.691493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441d32c-e52d-4c0f-bdde-6ffcc1f7e96a admin admin] PATH_INFO: `/v3/projects/3be646c207a547038903b30f19c2e230` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:26.692899 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441d32c-e52d-4c0f-bdde-6ffcc1f7e96a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3be646c207a547038903b30f19c2e230)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:26.695978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441d32c-e52d-4c0f-bdde-6ffcc1f7e96a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:26.706790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4124b72-a69d-4e42-a1a4-70f2aebefe39 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:26.711121 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714772ce-930d-438f-9b27-f4c9a45b826d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:26.711782 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714772ce-930d-438f-9b27-f4c9a45b826d service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:26.712055 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714772ce-930d-438f-9b27-f4c9a45b826d service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:26.712346 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714772ce-930d-438f-9b27-f4c9a45b826d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:26.721780 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714772ce-930d-438f-9b27-f4c9a45b826d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:26.723240 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714772ce-930d-438f-9b27-f4c9a45b826d service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:26.732887 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 996/2018] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:26.823366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1441d32c-e52d-4c0f-bdde-6ffcc1f7e96a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3be646c207a547038903b30f19c2e230', 'request_id': 'req-1441d32c-e52d-4c0f-bdde-6ffcc1f7e96a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:26.886075 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1441d32c-e52d-4c0f-bdde-6ffcc1f7e96a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3be646c207a547038903b30f19c2e230', 'request_id': 'req-1441d32c-e52d-4c0f-bdde-6ffcc1f7e96a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:26.894348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1441d32c-e52d-4c0f-bdde-6ffcc1f7e96a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3be646c207a547038903b30f19c2e230', 'request_id': 'req-1441d32c-e52d-4c0f-bdde-6ffcc1f7e96a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:26.907652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1441d32c-e52d-4c0f-bdde-6ffcc1f7e96a admin admin] The token cache is being invalidate because project 3be646c207a547038903b30f19c2e230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:26.908005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1441d32c-e52d-4c0f-bdde-6ffcc1f7e96a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:26.908843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1441d32c-e52d-4c0f-bdde-6ffcc1f7e96a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:26.910902 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1023/2019] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:26 2022] DELETE /identity/v3/projects/3be646c207a547038903b30f19c2e230 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:26.917384 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7568ea-f8eb-4eff-9670-a9f77ecdc5ff None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:26.917875 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7568ea-f8eb-4eff-9670-a9f77ecdc5ff None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:26.918243 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7568ea-f8eb-4eff-9670-a9f77ecdc5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:26.961206 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-4d7568ea-f8eb-4eff-9670-a9f77ecdc5ff None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:26.962475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4d7568ea-f8eb-4eff-9670-a9f77ecdc5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:27.029458 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 997/2020] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:27.031665 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e75b1-26e2-473c-8074-3623fadbd9f2 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:27.031968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e75b1-26e2-473c-8074-3623fadbd9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:27.032250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e75b1-26e2-473c-8074-3623fadbd9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:27.050597 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b34e75b1-26e2-473c-8074-3623fadbd9f2 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:27.051830 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b34e75b1-26e2-473c-8074-3623fadbd9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:27.060919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1024/2021] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:27.065227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7568ea-f8eb-4eff-9670-a9f77ecdc5ff None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:27.075554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7568ea-f8eb-4eff-9670-a9f77ecdc5ff None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:27.080441 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6fb72-eb31-4d5d-938b-372db2ca844f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:27.081100 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6fb72-eb31-4d5d-938b-372db2ca844f admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:27.081382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6fb72-eb31-4d5d-938b-372db2ca844f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:27.081658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6fb72-eb31-4d5d-938b-372db2ca844f admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:27.082409 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6fb72-eb31-4d5d-938b-372db2ca844f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:21:27.082746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6fb72-eb31-4d5d-938b-372db2ca844f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:27.084413 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6fb72-eb31-4d5d-938b-372db2ca844f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:27.096867 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 998/2022] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:21:27.104313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e75b1-26e2-473c-8074-3623fadbd9f2 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:27.113355 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e75b1-26e2-473c-8074-3623fadbd9f2 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:27.118625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c46f90-1237-494b-9a17-9d0d4019d7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:27.119272 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c46f90-1237-494b-9a17-9d0d4019d7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:27.119553 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c46f90-1237-494b-9a17-9d0d4019d7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:27.119828 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c46f90-1237-494b-9a17-9d0d4019d7c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:27.120548 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c46f90-1237-494b-9a17-9d0d4019d7c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:27.122721 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c46f90-1237-494b-9a17-9d0d4019d7c8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:27.144325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6fb72-eb31-4d5d-938b-372db2ca844f admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:27.147933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-6bb6fb72-eb31-4d5d-938b-372db2ca844f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:27.163701 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6fb72-eb31-4d5d-938b-372db2ca844f admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:27.171337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef28a80-983b-403e-b8c5-349516eec4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:27.171337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef28a80-983b-403e-b8c5-349516eec4de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:27.171337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef28a80-983b-403e-b8c5-349516eec4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:27.171337 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef28a80-983b-403e-b8c5-349516eec4de admin admin] PATH_INFO: `/v3/projects/26ad41aafd7f402dafb95eff1442a109` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:27.172143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef28a80-983b-403e-b8c5-349516eec4de admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ad41aafd7f402dafb95eff1442a109)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:27.173999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef28a80-983b-403e-b8c5-349516eec4de admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:27.224858 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1025/2023] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:21:27 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:27.229226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c46f90-1237-494b-9a17-9d0d4019d7c8 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:27.289138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-fef28a80-983b-403e-b8c5-349516eec4de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ad41aafd7f402dafb95eff1442a109', 'request_id': 'req-fef28a80-983b-403e-b8c5-349516eec4de'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:27.300955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c46f90-1237-494b-9a17-9d0d4019d7c8 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:27.342394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-fef28a80-983b-403e-b8c5-349516eec4de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ad41aafd7f402dafb95eff1442a109', 'request_id': 'req-fef28a80-983b-403e-b8c5-349516eec4de'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:27.348566 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-fef28a80-983b-403e-b8c5-349516eec4de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ad41aafd7f402dafb95eff1442a109', 'request_id': 'req-fef28a80-983b-403e-b8c5-349516eec4de'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:27.356091 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ab68f-79e3-4be9-9ab2-49492f3a92e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:27.356766 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ab68f-79e3-4be9-9ab2-49492f3a92e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:27.357053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ab68f-79e3-4be9-9ab2-49492f3a92e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:27.357331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ab68f-79e3-4be9-9ab2-49492f3a92e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:27.358027 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ab68f-79e3-4be9-9ab2-49492f3a92e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:27.359999 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ab68f-79e3-4be9-9ab2-49492f3a92e2 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:27.361382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-fef28a80-983b-403e-b8c5-349516eec4de admin admin] The token cache is being invalidate because project 26ad41aafd7f402dafb95eff1442a109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:27.361677 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-fef28a80-983b-403e-b8c5-349516eec4de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:27.362327 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-fef28a80-983b-403e-b8c5-349516eec4de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:27.365348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 999/2024] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:27 2022] DELETE /identity/v3/projects/26ad41aafd7f402dafb95eff1442a109 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:27.368399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef28a80-983b-403e-b8c5-349516eec4de admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:27.369702 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-fef28a80-983b-403e-b8c5-349516eec4de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:27.381835 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef28a80-983b-403e-b8c5-349516eec4de admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:27.387189 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f168e-0621-4c84-9160-fe132ab0ebd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:27.388043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f168e-0621-4c84-9160-fe132ab0ebd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:27.388362 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f168e-0621-4c84-9160-fe132ab0ebd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:27.388640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f168e-0621-4c84-9160-fe132ab0ebd2 admin admin] PATH_INFO: `/v3/users/cbec270cf84a4f018f877e40d4bf6db1` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:27.389826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f168e-0621-4c84-9160-fe132ab0ebd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbec270cf84a4f018f877e40d4bf6db1)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:27.391785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f168e-0621-4c84-9160-fe132ab0ebd2 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:27.520221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1026/2025] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:21:27 2022] POST /identity/v3/users => generated 286 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:21:27.526407 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ab68f-79e3-4be9-9ab2-49492f3a92e2 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:27.527971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d07ab68f-79e3-4be9-9ab2-49492f3a92e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:27.539800 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ab68f-79e3-4be9-9ab2-49492f3a92e2 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:27.544651 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1e904-c80f-48f5-b8e2-05e27a2d7732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:27.545302 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1e904-c80f-48f5-b8e2-05e27a2d7732 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:27.545583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1e904-c80f-48f5-b8e2-05e27a2d7732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:27.545857 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1e904-c80f-48f5-b8e2-05e27a2d7732 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:27.546618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1e904-c80f-48f5-b8e2-05e27a2d7732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:27.548255 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1e904-c80f-48f5-b8e2-05e27a2d7732 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:27.558321 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1027/2026] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:21:27.562057 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1e904-c80f-48f5-b8e2-05e27a2d7732 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:27.571734 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1e904-c80f-48f5-b8e2-05e27a2d7732 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:27.576298 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60351a17-8f3d-405a-ab6c-5e18fb522c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:27.576908 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60351a17-8f3d-405a-ab6c-5e18fb522c91 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:27.577188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60351a17-8f3d-405a-ab6c-5e18fb522c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:27.577463 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60351a17-8f3d-405a-ab6c-5e18fb522c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:27.578154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60351a17-8f3d-405a-ab6c-5e18fb522c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:27.579695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60351a17-8f3d-405a-ab6c-5e18fb522c91 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:27.589980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1028/2027] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:21:27.593768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60351a17-8f3d-405a-ab6c-5e18fb522c91 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:27.602925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60351a17-8f3d-405a-ab6c-5e18fb522c91 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:27.607358 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5dae1-a216-47ed-a234-5a0ed5bf3a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:27.608184 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5dae1-a216-47ed-a234-5a0ed5bf3a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:27.608464 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5dae1-a216-47ed-a234-5a0ed5bf3a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:27.608739 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5dae1-a216-47ed-a234-5a0ed5bf3a90 admin admin] PATH_INFO: `/v3/projects/ebbee11b6c6b476f9b92408c0ae00dc1/users/989e870c1d7d45b28f87ec264d71332e/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:27.624136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5dae1-a216-47ed-a234-5a0ed5bf3a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebbee11b6c6b476f9b92408c0ae00dc1, user_id=989e870c1d7d45b28f87ec264d71332e, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:27.626845 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5dae1-a216-47ed-a234-5a0ed5bf3a90 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:27.632829 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-343f168e-0621-4c84-9160-fe132ab0ebd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbec270cf84a4f018f877e40d4bf6db1'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:27.633937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-343f168e-0621-4c84-9160-fe132ab0ebd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbec270cf84a4f018f877e40d4bf6db1'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:27.646464 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-343f168e-0621-4c84-9160-fe132ab0ebd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbec270cf84a4f018f877e40d4bf6db1'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:27.647158 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-343f168e-0621-4c84-9160-fe132ab0ebd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbec270cf84a4f018f877e40d4bf6db1'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:27.654762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-343f168e-0621-4c84-9160-fe132ab0ebd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbec270cf84a4f018f877e40d4bf6db1'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:27.781834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1000/2029] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:27 2022] DELETE /identity/v3/users/cbec270cf84a4f018f877e40d4bf6db1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:27.782910 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1029/2029] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:27 2022] PUT /identity/v3/projects/ebbee11b6c6b476f9b92408c0ae00dc1/users/989e870c1d7d45b28f87ec264d71332e/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:21:27.784018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55929f34-5614-4c9a-980e-4bdf5c169c55 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:27.784308 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55929f34-5614-4c9a-980e-4bdf5c169c55 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:27.784642 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55929f34-5614-4c9a-980e-4bdf5c169c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:27.814731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-55929f34-5614-4c9a-980e-4bdf5c169c55 None None] MFA Rules not processed for user `989e870c1d7d45b28f87ec264d71332e`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:27.814731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-55929f34-5614-4c9a-980e-4bdf5c169c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:27.880685 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1001/2030] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:27.893162 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5dae1-a216-47ed-a234-5a0ed5bf3a90 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:27.895355 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8af5dae1-a216-47ed-a234-5a0ed5bf3a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:27.957586 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5dae1-a216-47ed-a234-5a0ed5bf3a90 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:27.987313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55929f34-5614-4c9a-980e-4bdf5c169c55 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:27.987313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-55929f34-5614-4c9a-980e-4bdf5c169c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:28.013023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf34bec-2626-4292-9e5d-497b3d13fca9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2b6514779d42fa81d34351607dea27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:28.013879 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf34bec-2626-4292-9e5d-497b3d13fca9 service glance] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:28.014405 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf34bec-2626-4292-9e5d-497b3d13fca9 service glance] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:28.014846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf34bec-2626-4292-9e5d-497b3d13fca9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:28.027021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf34bec-2626-4292-9e5d-497b3d13fca9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:28.028463 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf34bec-2626-4292-9e5d-497b3d13fca9 service glance] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:28.038067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1030/2031] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:28.059626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55929f34-5614-4c9a-980e-4bdf5c169c55 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:28.064458 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e959c6b-44bd-47dd-9ed5-24578d35eeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:28.065266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e959c6b-44bd-47dd-9ed5-24578d35eeee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:28.065546 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e959c6b-44bd-47dd-9ed5-24578d35eeee admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:28.065818 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e959c6b-44bd-47dd-9ed5-24578d35eeee admin admin] PATH_INFO: `/v3/users/94c2a15d67c24e9187db81d2a6193113` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:28.067057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e959c6b-44bd-47dd-9ed5-24578d35eeee admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c2a15d67c24e9187db81d2a6193113)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:28.069208 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e959c6b-44bd-47dd-9ed5-24578d35eeee admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:28.253129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf34bec-2626-4292-9e5d-497b3d13fca9 service glance] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:28.254758 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fcf34bec-2626-4292-9e5d-497b3d13fca9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:28.274286 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf34bec-2626-4292-9e5d-497b3d13fca9 service glance] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:28.280046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984a95c-ca66-4a82-b863-c4410f04d818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:28.280805 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984a95c-ca66-4a82-b863-c4410f04d818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:28.281094 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984a95c-ca66-4a82-b863-c4410f04d818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:28.281398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984a95c-ca66-4a82-b863-c4410f04d818 admin admin] PATH_INFO: `/v3/projects/176ac011ca0c4fc696aa3212194e65cb` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:28.282577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984a95c-ca66-4a82-b863-c4410f04d818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=176ac011ca0c4fc696aa3212194e65cb)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:28.284562 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984a95c-ca66-4a82-b863-c4410f04d818 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:28.318467 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-5e959c6b-44bd-47dd-9ed5-24578d35eeee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c2a15d67c24e9187db81d2a6193113'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:28.319951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-5e959c6b-44bd-47dd-9ed5-24578d35eeee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c2a15d67c24e9187db81d2a6193113'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:28.332047 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-5e959c6b-44bd-47dd-9ed5-24578d35eeee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c2a15d67c24e9187db81d2a6193113'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:28.332886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-5e959c6b-44bd-47dd-9ed5-24578d35eeee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c2a15d67c24e9187db81d2a6193113'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:28.340933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-5e959c6b-44bd-47dd-9ed5-24578d35eeee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c2a15d67c24e9187db81d2a6193113'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:28.416167 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1984a95c-ca66-4a82-b863-c4410f04d818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176ac011ca0c4fc696aa3212194e65cb', 'request_id': 'req-1984a95c-ca66-4a82-b863-c4410f04d818'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:28.434544 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1002/2032] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:27 2022] DELETE /identity/v3/users/94c2a15d67c24e9187db81d2a6193113 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:28.438990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a0bc1-cd44-458c-8d94-84b05c831178 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:28.439282 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a0bc1-cd44-458c-8d94-84b05c831178 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:28.439564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a0bc1-cd44-458c-8d94-84b05c831178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:28.457436 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-750a0bc1-cd44-458c-8d94-84b05c831178 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:28.458673 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-750a0bc1-cd44-458c-8d94-84b05c831178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:28.514086 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1984a95c-ca66-4a82-b863-c4410f04d818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176ac011ca0c4fc696aa3212194e65cb', 'request_id': 'req-1984a95c-ca66-4a82-b863-c4410f04d818'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:28.520520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1984a95c-ca66-4a82-b863-c4410f04d818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176ac011ca0c4fc696aa3212194e65cb', 'request_id': 'req-1984a95c-ca66-4a82-b863-c4410f04d818'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:28.524917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1003/2033] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:28.532654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1984a95c-ca66-4a82-b863-c4410f04d818 admin admin] The token cache is being invalidate because project 176ac011ca0c4fc696aa3212194e65cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:28.533099 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1984a95c-ca66-4a82-b863-c4410f04d818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:28.533785 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1984a95c-ca66-4a82-b863-c4410f04d818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:28.534999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a0bc1-cd44-458c-8d94-84b05c831178 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:28.536601 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1031/2034] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:28 2022] DELETE /identity/v3/projects/176ac011ca0c4fc696aa3212194e65cb => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:21:28.540063 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-750a0bc1-cd44-458c-8d94-84b05c831178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:28.544639 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3172822-3ed1-4cdf-aeef-a33dbd85daf1 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:28.545191 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3172822-3ed1-4cdf-aeef-a33dbd85daf1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:28.545632 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3172822-3ed1-4cdf-aeef-a33dbd85daf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:28.566034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b3172822-3ed1-4cdf-aeef-a33dbd85daf1 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:28.567364 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b3172822-3ed1-4cdf-aeef-a33dbd85daf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:28.578224 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1032/2035] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:28.586705 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8b3bd-7407-4155-8512-8a9db8bf9b75 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:28.587139 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8b3bd-7407-4155-8512-8a9db8bf9b75 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:28.587537 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8b3bd-7407-4155-8512-8a9db8bf9b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:28.598873 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a0bc1-cd44-458c-8d94-84b05c831178 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:28.603864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9646a07-b211-4600-8460-1b32c98815ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:28.604515 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9646a07-b211-4600-8460-1b32c98815ef service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:28.604799 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9646a07-b211-4600-8460-1b32c98815ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:28.605077 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9646a07-b211-4600-8460-1b32c98815ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:28.606912 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-b9646a07-b211-4600-8460-1b32c98815ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:28.607041 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-c4a8b3bd-7407-4155-8512-8a9db8bf9b75 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:28.608130 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c4a8b3bd-7407-4155-8512-8a9db8bf9b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:28.615991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1033/2036] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:28.619003 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9646a07-b211-4600-8460-1b32c98815ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:28.620582 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8b3bd-7407-4155-8512-8a9db8bf9b75 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:28.620804 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9646a07-b211-4600-8460-1b32c98815ef service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:28.629646 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8b3bd-7407-4155-8512-8a9db8bf9b75 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:28.630661 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1004/2037] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:21:28.635521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88781f8-4c23-41b0-b18d-c57bc4cb701d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:28.636208 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88781f8-4c23-41b0-b18d-c57bc4cb701d admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:28.636491 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88781f8-4c23-41b0-b18d-c57bc4cb701d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:28.636765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88781f8-4c23-41b0-b18d-c57bc4cb701d admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:28.637492 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88781f8-4c23-41b0-b18d-c57bc4cb701d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:21:28.637796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88781f8-4c23-41b0-b18d-c57bc4cb701d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:28.639409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88781f8-4c23-41b0-b18d-c57bc4cb701d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:28.656252 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1034/2038] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:21:28.657535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9646a07-b211-4600-8460-1b32c98815ef service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:28.670880 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9646a07-b211-4600-8460-1b32c98815ef service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:28.676975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df249cb5-5954-4282-bdb9-3e930cee2004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:28.677901 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df249cb5-5954-4282-bdb9-3e930cee2004 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:28.678470 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df249cb5-5954-4282-bdb9-3e930cee2004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:28.678747 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df249cb5-5954-4282-bdb9-3e930cee2004 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:28.679838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df249cb5-5954-4282-bdb9-3e930cee2004 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:28.681838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df249cb5-5954-4282-bdb9-3e930cee2004 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:28.795880 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1005/2039] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:21:28 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:28.800191 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88781f8-4c23-41b0-b18d-c57bc4cb701d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:28.811119 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88781f8-4c23-41b0-b18d-c57bc4cb701d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:28.882511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57623b88-0117-46a8-9f92-2e1a59081be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:28.883396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57623b88-0117-46a8-9f92-2e1a59081be9 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:28.884034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57623b88-0117-46a8-9f92-2e1a59081be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:28.884623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57623b88-0117-46a8-9f92-2e1a59081be9 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:28.886073 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57623b88-0117-46a8-9f92-2e1a59081be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:28.887899 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57623b88-0117-46a8-9f92-2e1a59081be9 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:28.988662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1035/2040] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:21:28 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:28.998420 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df249cb5-5954-4282-bdb9-3e930cee2004 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:29.007241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df249cb5-5954-4282-bdb9-3e930cee2004 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:29.013699 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4047718-1af9-4b5a-8e93-51b73f5758e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:29.014480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4047718-1af9-4b5a-8e93-51b73f5758e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:29.014901 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4047718-1af9-4b5a-8e93-51b73f5758e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:29.015660 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4047718-1af9-4b5a-8e93-51b73f5758e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:29.016421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4047718-1af9-4b5a-8e93-51b73f5758e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:29.017912 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4047718-1af9-4b5a-8e93-51b73f5758e2 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:29.030538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1006/2041] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:29.033906 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57623b88-0117-46a8-9f92-2e1a59081be9 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:29.045008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57623b88-0117-46a8-9f92-2e1a59081be9 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:29.049928 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c62aa-e3ad-40f2-8259-fbdeeeff0b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:29.050633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c62aa-e3ad-40f2-8259-fbdeeeff0b99 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:29.050923 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c62aa-e3ad-40f2-8259-fbdeeeff0b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:29.051205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c62aa-e3ad-40f2-8259-fbdeeeff0b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:29.051945 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c62aa-e3ad-40f2-8259-fbdeeeff0b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:29.053746 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c62aa-e3ad-40f2-8259-fbdeeeff0b99 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:29.066468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1036/2042] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:21:29.068585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4047718-1af9-4b5a-8e93-51b73f5758e2 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:29.082342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4047718-1af9-4b5a-8e93-51b73f5758e2 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:29.087194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b7b7f-b650-47dd-a95d-38bf86ca77f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:29.088094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b7b7f-b650-47dd-a95d-38bf86ca77f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:29.088374 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b7b7f-b650-47dd-a95d-38bf86ca77f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:29.088649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b7b7f-b650-47dd-a95d-38bf86ca77f7 admin admin] PATH_INFO: `/v3/projects/23f3a4bb74154621acd214cc4cfba1e0/users/6f9daed84d20457b94707ee0dd2f0881/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:29.105428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b7b7f-b650-47dd-a95d-38bf86ca77f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f3a4bb74154621acd214cc4cfba1e0, user_id=6f9daed84d20457b94707ee0dd2f0881, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:29.108256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b7b7f-b650-47dd-a95d-38bf86ca77f7 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:29.161205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c62aa-e3ad-40f2-8259-fbdeeeff0b99 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:29.163654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2e2c62aa-e3ad-40f2-8259-fbdeeeff0b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:29.180726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c62aa-e3ad-40f2-8259-fbdeeeff0b99 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:29.184673 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975750d3-f8f1-4c53-a5f2-04777843c664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:29.185801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975750d3-f8f1-4c53-a5f2-04777843c664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:29.185962 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975750d3-f8f1-4c53-a5f2-04777843c664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:29.186283 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975750d3-f8f1-4c53-a5f2-04777843c664 admin admin] PATH_INFO: `/v3/projects/ec32ce28e7cf4bd8b127425ac07a7179` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:29.196377 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975750d3-f8f1-4c53-a5f2-04777843c664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec32ce28e7cf4bd8b127425ac07a7179)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:29.199281 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975750d3-f8f1-4c53-a5f2-04777843c664 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:29.211670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1007/2043] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:29 2022] PUT /identity/v3/projects/23f3a4bb74154621acd214cc4cfba1e0/users/6f9daed84d20457b94707ee0dd2f0881/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:29.223965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f06f13-4c1a-4f21-bcac-cccd6c23fa8c None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:29.224259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f06f13-4c1a-4f21-bcac-cccd6c23fa8c None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:29.224540 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f06f13-4c1a-4f21-bcac-cccd6c23fa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:29.251557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-e2f06f13-4c1a-4f21-bcac-cccd6c23fa8c None None] MFA Rules not processed for user `6f9daed84d20457b94707ee0dd2f0881`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:29.252750 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e2f06f13-4c1a-4f21-bcac-cccd6c23fa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:29.316260 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1008/2044] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:29.328795 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f06f13-4c1a-4f21-bcac-cccd6c23fa8c None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:29.330157 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e2f06f13-4c1a-4f21-bcac-cccd6c23fa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:29.342546 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-975750d3-f8f1-4c53-a5f2-04777843c664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec32ce28e7cf4bd8b127425ac07a7179', 'request_id': 'req-975750d3-f8f1-4c53-a5f2-04777843c664'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:29.387022 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f06f13-4c1a-4f21-bcac-cccd6c23fa8c None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:29.422406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-975750d3-f8f1-4c53-a5f2-04777843c664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec32ce28e7cf4bd8b127425ac07a7179', 'request_id': 'req-975750d3-f8f1-4c53-a5f2-04777843c664'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:29.430192 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-975750d3-f8f1-4c53-a5f2-04777843c664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec32ce28e7cf4bd8b127425ac07a7179', 'request_id': 'req-975750d3-f8f1-4c53-a5f2-04777843c664'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:29.438167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65ccbe-efc5-4df6-8d97-821a9059e0a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:29.438863 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65ccbe-efc5-4df6-8d97-821a9059e0a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:29.439178 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65ccbe-efc5-4df6-8d97-821a9059e0a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:29.439485 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65ccbe-efc5-4df6-8d97-821a9059e0a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:29.443462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-975750d3-f8f1-4c53-a5f2-04777843c664 admin admin] The token cache is being invalidate because project ec32ce28e7cf4bd8b127425ac07a7179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:29.443804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-975750d3-f8f1-4c53-a5f2-04777843c664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:29.445078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-975750d3-f8f1-4c53-a5f2-04777843c664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:29.446988 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1037/2045] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:29 2022] DELETE /identity/v3/projects/ec32ce28e7cf4bd8b127425ac07a7179 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:21:29.451484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7c0c6-f4f0-4c73-a859-00bc03bd9825 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:29.451772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7c0c6-f4f0-4c73-a859-00bc03bd9825 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:29.452048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7c0c6-f4f0-4c73-a859-00bc03bd9825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:29.469461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a5b7c0c6-f4f0-4c73-a859-00bc03bd9825 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:29.470678 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a5b7c0c6-f4f0-4c73-a859-00bc03bd9825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:29.500066 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65ccbe-efc5-4df6-8d97-821a9059e0a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:29.501612 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65ccbe-efc5-4df6-8d97-821a9059e0a8 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:29.512641 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1009/2046] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:21:29.532226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1038/2047] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:29.541722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc81eb-acee-451a-ab0b-a37c6c11341a None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:29.542012 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc81eb-acee-451a-ab0b-a37c6c11341a None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:29.542289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc81eb-acee-451a-ab0b-a37c6c11341a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:29.561494 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-bbcc81eb-acee-451a-ab0b-a37c6c11341a None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:29.562728 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-bbcc81eb-acee-451a-ab0b-a37c6c11341a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:29.571951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1010/2048] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:29.577802 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7c0c6-f4f0-4c73-a859-00bc03bd9825 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:29.590879 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7c0c6-f4f0-4c73-a859-00bc03bd9825 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:29.597905 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909b8d8-f8f7-463b-9a30-48de860b66fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:29.598896 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909b8d8-f8f7-463b-9a30-48de860b66fb admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:29.599577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909b8d8-f8f7-463b-9a30-48de860b66fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:29.599863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909b8d8-f8f7-463b-9a30-48de860b66fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:29.601437 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909b8d8-f8f7-463b-9a30-48de860b66fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:21:29.601758 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909b8d8-f8f7-463b-9a30-48de860b66fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:29.603569 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909b8d8-f8f7-463b-9a30-48de860b66fb admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:29.622121 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1039/2049] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:21:29.623574 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc81eb-acee-451a-ab0b-a37c6c11341a None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:29.634195 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc81eb-acee-451a-ab0b-a37c6c11341a None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:29.639157 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caadbcc-282c-4a49-bf28-eadad72f142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:29.639820 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caadbcc-282c-4a49-bf28-eadad72f142d admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:29.640101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caadbcc-282c-4a49-bf28-eadad72f142d admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:29.640377 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caadbcc-282c-4a49-bf28-eadad72f142d admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:29.641066 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caadbcc-282c-4a49-bf28-eadad72f142d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:29.642986 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caadbcc-282c-4a49-bf28-eadad72f142d admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:29.733632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1011/2050] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:21:29 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:29.737799 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909b8d8-f8f7-463b-9a30-48de860b66fb admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:29.748683 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909b8d8-f8f7-463b-9a30-48de860b66fb admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:29.809078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b883ac-5062-4bb4-92ec-1fe88a44d471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:29.809774 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b883ac-5062-4bb4-92ec-1fe88a44d471 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:29.810060 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b883ac-5062-4bb4-92ec-1fe88a44d471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:29.810342 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b883ac-5062-4bb4-92ec-1fe88a44d471 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:29.811070 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b883ac-5062-4bb4-92ec-1fe88a44d471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:29.813014 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b883ac-5062-4bb4-92ec-1fe88a44d471 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:29.869485 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1040/2051] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:21:29 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:29.876654 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caadbcc-282c-4a49-bf28-eadad72f142d admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:29.905050 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caadbcc-282c-4a49-bf28-eadad72f142d admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:29.910102 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95085ed-11bc-4803-9641-c7da1030506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:29.910935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95085ed-11bc-4803-9641-c7da1030506e admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:29.911371 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95085ed-11bc-4803-9641-c7da1030506e admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:29.911717 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95085ed-11bc-4803-9641-c7da1030506e admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:29.912513 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95085ed-11bc-4803-9641-c7da1030506e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:29.954944 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95085ed-11bc-4803-9641-c7da1030506e admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:29.954944 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1012/2052] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:29.955123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b883ac-5062-4bb4-92ec-1fe88a44d471 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:29.961972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b883ac-5062-4bb4-92ec-1fe88a44d471 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:29.970498 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe7a6f-9fd7-4b79-b4ec-4de6f8f7d67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:29.971180 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe7a6f-9fd7-4b79-b4ec-4de6f8f7d67c admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:29.971465 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe7a6f-9fd7-4b79-b4ec-4de6f8f7d67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:29.971748 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe7a6f-9fd7-4b79-b4ec-4de6f8f7d67c admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:29.972520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe7a6f-9fd7-4b79-b4ec-4de6f8f7d67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:29.974094 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe7a6f-9fd7-4b79-b4ec-4de6f8f7d67c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:29.986308 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1041/2053] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:29.990722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95085ed-11bc-4803-9641-c7da1030506e admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:30.000643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95085ed-11bc-4803-9641-c7da1030506e admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:30.005884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60093e84-491f-4851-90da-cb1c7e65fa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:30.007115 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60093e84-491f-4851-90da-cb1c7e65fa26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:30.007465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60093e84-491f-4851-90da-cb1c7e65fa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:30.007854 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60093e84-491f-4851-90da-cb1c7e65fa26 admin admin] PATH_INFO: `/v3/projects/c523d90b568341d5a77258406445c6ee/users/ecec99a61db64e1d95cfdd1fb5ecf154/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:30.026393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60093e84-491f-4851-90da-cb1c7e65fa26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c523d90b568341d5a77258406445c6ee, user_id=ecec99a61db64e1d95cfdd1fb5ecf154, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:30.029037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60093e84-491f-4851-90da-cb1c7e65fa26 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:30.308431 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1013/2054] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:29 2022] PUT /identity/v3/projects/c523d90b568341d5a77258406445c6ee/users/ecec99a61db64e1d95cfdd1fb5ecf154/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:21:30.321688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e767c8-5ca5-4b44-8303-40d4d50af543 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:30.322095 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e767c8-5ca5-4b44-8303-40d4d50af543 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:30.322536 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e767c8-5ca5-4b44-8303-40d4d50af543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:30.349936 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-54e767c8-5ca5-4b44-8303-40d4d50af543 None None] MFA Rules not processed for user `ecec99a61db64e1d95cfdd1fb5ecf154`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:30.351218 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-54e767c8-5ca5-4b44-8303-40d4d50af543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:30.421722 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1042/2055] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:30.426148 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60093e84-491f-4851-90da-cb1c7e65fa26 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:30.488074 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60093e84-491f-4851-90da-cb1c7e65fa26 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:30.492801 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2af45-2c1a-4c12-86db-91f1c08af357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:30.493460 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2af45-2c1a-4c12-86db-91f1c08af357 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:30.493747 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2af45-2c1a-4c12-86db-91f1c08af357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:30.494026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2af45-2c1a-4c12-86db-91f1c08af357 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:30.494767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2af45-2c1a-4c12-86db-91f1c08af357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:30.496678 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2af45-2c1a-4c12-86db-91f1c08af357 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:30.560976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1014/2056] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:21:30 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:30.565176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e767c8-5ca5-4b44-8303-40d4d50af543 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:30.576319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e767c8-5ca5-4b44-8303-40d4d50af543 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:30.645332 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef3018-369e-4612-90d5-8f377dabbda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:30.646567 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef3018-369e-4612-90d5-8f377dabbda7 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:30.646567 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef3018-369e-4612-90d5-8f377dabbda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:30.646567 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef3018-369e-4612-90d5-8f377dabbda7 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:30.647300 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef3018-369e-4612-90d5-8f377dabbda7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:30.649258 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef3018-369e-4612-90d5-8f377dabbda7 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:30.720878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1043/2057] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:21:30 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:21:30.724323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2af45-2c1a-4c12-86db-91f1c08af357 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:30.735389 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2af45-2c1a-4c12-86db-91f1c08af357 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:30.739929 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585f1c3-5fc0-4769-b6d6-b2b1b55c9581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:30.740587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585f1c3-5fc0-4769-b6d6-b2b1b55c9581 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:30.740866 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585f1c3-5fc0-4769-b6d6-b2b1b55c9581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:30.741220 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585f1c3-5fc0-4769-b6d6-b2b1b55c9581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:30.741852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585f1c3-5fc0-4769-b6d6-b2b1b55c9581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:30.743541 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585f1c3-5fc0-4769-b6d6-b2b1b55c9581 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:30.753884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1015/2058] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:30.758093 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef3018-369e-4612-90d5-8f377dabbda7 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:30.768275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef3018-369e-4612-90d5-8f377dabbda7 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:30.772871 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16cbd9-49ed-49c8-b8af-31467bd41c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:30.774274 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16cbd9-49ed-49c8-b8af-31467bd41c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:30.774593 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16cbd9-49ed-49c8-b8af-31467bd41c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:30.774874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16cbd9-49ed-49c8-b8af-31467bd41c61 admin admin] PATH_INFO: `/v3/projects/b2cf4c229b6648b49bf832f2254eb280/users/1be53f014a244a938d3ad43082455175/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:30.789704 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16cbd9-49ed-49c8-b8af-31467bd41c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2cf4c229b6648b49bf832f2254eb280, user_id=1be53f014a244a938d3ad43082455175, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:30.792570 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16cbd9-49ed-49c8-b8af-31467bd41c61 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:30.869139 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1044/2059] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:30 2022] PUT /identity/v3/projects/b2cf4c229b6648b49bf832f2254eb280/users/1be53f014a244a938d3ad43082455175/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:30.873089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585f1c3-5fc0-4769-b6d6-b2b1b55c9581 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:30.882976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585f1c3-5fc0-4769-b6d6-b2b1b55c9581 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:30.938603 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79237e00-5de7-4778-8996-6def3cf39344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:30.939385 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79237e00-5de7-4778-8996-6def3cf39344 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:30.939759 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79237e00-5de7-4778-8996-6def3cf39344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:30.940130 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79237e00-5de7-4778-8996-6def3cf39344 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:30.941096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79237e00-5de7-4778-8996-6def3cf39344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:30.943958 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79237e00-5de7-4778-8996-6def3cf39344 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:30.957789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1016/2060] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:30.962774 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16cbd9-49ed-49c8-b8af-31467bd41c61 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:30.973274 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16cbd9-49ed-49c8-b8af-31467bd41c61 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:30.978765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8a21d-156a-49da-ab35-fa3383ef69e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:30.979767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8a21d-156a-49da-ab35-fa3383ef69e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:30.980084 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8a21d-156a-49da-ab35-fa3383ef69e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:30.980365 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8a21d-156a-49da-ab35-fa3383ef69e1 admin admin] PATH_INFO: `/v3/projects/b2cf4c229b6648b49bf832f2254eb280/users/1be53f014a244a938d3ad43082455175/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:30.982473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8a21d-156a-49da-ab35-fa3383ef69e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2cf4c229b6648b49bf832f2254eb280, user_id=1be53f014a244a938d3ad43082455175, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:30.985088 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8a21d-156a-49da-ab35-fa3383ef69e1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:30.995982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1045/2061] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:30 2022] PUT /identity/v3/projects/b2cf4c229b6648b49bf832f2254eb280/users/1be53f014a244a938d3ad43082455175/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:31.006317 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa49970-6b6a-4fee-82fd-fc0be64eba2c None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:31.006868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa49970-6b6a-4fee-82fd-fc0be64eba2c None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:31.007154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa49970-6b6a-4fee-82fd-fc0be64eba2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:31.035686 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-afa49970-6b6a-4fee-82fd-fc0be64eba2c None None] MFA Rules not processed for user `1be53f014a244a938d3ad43082455175`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:31.036876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-afa49970-6b6a-4fee-82fd-fc0be64eba2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:31.115405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1017/2062] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:31.128707 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8a21d-156a-49da-ab35-fa3383ef69e1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:31.130583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-15d8a21d-156a-49da-ab35-fa3383ef69e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:31.187741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8a21d-156a-49da-ab35-fa3383ef69e1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:31.191441 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14947c-8a14-4654-a8bd-3062f17ed7a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:31.192184 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14947c-8a14-4654-a8bd-3062f17ed7a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:31.192471 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14947c-8a14-4654-a8bd-3062f17ed7a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:31.192749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14947c-8a14-4654-a8bd-3062f17ed7a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:31.202742 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14947c-8a14-4654-a8bd-3062f17ed7a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:31.204292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14947c-8a14-4654-a8bd-3062f17ed7a2 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:31.214348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1046/2063] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:31.423677 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa49970-6b6a-4fee-82fd-fc0be64eba2c None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:31.433984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa49970-6b6a-4fee-82fd-fc0be64eba2c None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:31.437654 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843c645-f01e-402a-a86d-dd4f7e4ae36a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:31.438227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843c645-f01e-402a-a86d-dd4f7e4ae36a service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:31.438545 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843c645-f01e-402a-a86d-dd4f7e4ae36a service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:31.438826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843c645-f01e-402a-a86d-dd4f7e4ae36a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:31.495658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843c645-f01e-402a-a86d-dd4f7e4ae36a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:31.497229 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843c645-f01e-402a-a86d-dd4f7e4ae36a service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:31.510876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1018/2064] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:33.946427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14947c-8a14-4654-a8bd-3062f17ed7a2 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:33.947925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9c14947c-8a14-4654-a8bd-3062f17ed7a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:34.012593 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14947c-8a14-4654-a8bd-3062f17ed7a2 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:34.017186 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa2c0f-b186-4628-b5be-d2d2076dd586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:34.018055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa2c0f-b186-4628-b5be-d2d2076dd586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:34.018334 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa2c0f-b186-4628-b5be-d2d2076dd586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:34.018660 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa2c0f-b186-4628-b5be-d2d2076dd586 admin admin] PATH_INFO: `/v3/users/6f9daed84d20457b94707ee0dd2f0881` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:34.019837 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa2c0f-b186-4628-b5be-d2d2076dd586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f9daed84d20457b94707ee0dd2f0881)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:34.021739 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa2c0f-b186-4628-b5be-d2d2076dd586 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:34.197792 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-0aaa2c0f-b186-4628-b5be-d2d2076dd586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f9daed84d20457b94707ee0dd2f0881'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:34.198497 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-0aaa2c0f-b186-4628-b5be-d2d2076dd586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f9daed84d20457b94707ee0dd2f0881'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:34.199107 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-0aaa2c0f-b186-4628-b5be-d2d2076dd586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f9daed84d20457b94707ee0dd2f0881'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:34.211651 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-0aaa2c0f-b186-4628-b5be-d2d2076dd586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f9daed84d20457b94707ee0dd2f0881'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:34.218589 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-0aaa2c0f-b186-4628-b5be-d2d2076dd586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f9daed84d20457b94707ee0dd2f0881'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:34.307715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1047/2065] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:33 2022] DELETE /identity/v3/users/6f9daed84d20457b94707ee0dd2f0881 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:34.312266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e82fca-c04d-4bd1-beaa-146ec49410d4 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:34.312801 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e82fca-c04d-4bd1-beaa-146ec49410d4 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:34.312908 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e82fca-c04d-4bd1-beaa-146ec49410d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:34.330691 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-f0e82fca-c04d-4bd1-beaa-146ec49410d4 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:34.331902 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-f0e82fca-c04d-4bd1-beaa-146ec49410d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:34.390358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1019/2066] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:21:34.400895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa2c0f-b186-4628-b5be-d2d2076dd586 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:34.402570 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0aaa2c0f-b186-4628-b5be-d2d2076dd586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:34.459471 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa2c0f-b186-4628-b5be-d2d2076dd586 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:34.463198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f18c02-f7d3-4b02-a95c-efb3767b47f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:34.463836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f18c02-f7d3-4b02-a95c-efb3767b47f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:34.464113 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f18c02-f7d3-4b02-a95c-efb3767b47f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:34.464384 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f18c02-f7d3-4b02-a95c-efb3767b47f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:34.473211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f18c02-f7d3-4b02-a95c-efb3767b47f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:34.474645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f18c02-f7d3-4b02-a95c-efb3767b47f4 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:34.483870 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1048/2067] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:34.926827 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e82fca-c04d-4bd1-beaa-146ec49410d4 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:34.928387 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-f0e82fca-c04d-4bd1-beaa-146ec49410d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:34.941475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e82fca-c04d-4bd1-beaa-146ec49410d4 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:34.944979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accb4ed-5109-4c93-8610-f6090581cd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:34.946394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accb4ed-5109-4c93-8610-f6090581cd13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:34.946701 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accb4ed-5109-4c93-8610-f6090581cd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:34.946972 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accb4ed-5109-4c93-8610-f6090581cd13 admin admin] PATH_INFO: `/v3/projects/23f3a4bb74154621acd214cc4cfba1e0` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:34.948156 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accb4ed-5109-4c93-8610-f6090581cd13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23f3a4bb74154621acd214cc4cfba1e0)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:34.950066 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accb4ed-5109-4c93-8610-f6090581cd13 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:35.073906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2accb4ed-5109-4c93-8610-f6090581cd13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23f3a4bb74154621acd214cc4cfba1e0', 'request_id': 'req-2accb4ed-5109-4c93-8610-f6090581cd13'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:35.165179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2accb4ed-5109-4c93-8610-f6090581cd13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23f3a4bb74154621acd214cc4cfba1e0', 'request_id': 'req-2accb4ed-5109-4c93-8610-f6090581cd13'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:35.175225 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2accb4ed-5109-4c93-8610-f6090581cd13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23f3a4bb74154621acd214cc4cfba1e0', 'request_id': 'req-2accb4ed-5109-4c93-8610-f6090581cd13'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:35.187028 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2accb4ed-5109-4c93-8610-f6090581cd13 admin admin] The token cache is being invalidate because project 23f3a4bb74154621acd214cc4cfba1e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:35.187313 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2accb4ed-5109-4c93-8610-f6090581cd13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:35.187941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2accb4ed-5109-4c93-8610-f6090581cd13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:35.189472 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1020/2068] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:34 2022] DELETE /identity/v3/projects/23f3a4bb74154621acd214cc4cfba1e0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:35.196978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c506b31-7169-4506-a406-92e3bfc10e2e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:35.196978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c506b31-7169-4506-a406-92e3bfc10e2e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:35.196978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c506b31-7169-4506-a406-92e3bfc10e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:35.217628 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-9c506b31-7169-4506-a406-92e3bfc10e2e None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:35.218852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9c506b31-7169-4506-a406-92e3bfc10e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:35.279218 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1049/2069] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:35.286762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9741484-7fc3-4c1e-aaf1-c553c2a2e174 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:35.287353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9741484-7fc3-4c1e-aaf1-c553c2a2e174 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:35.287637 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9741484-7fc3-4c1e-aaf1-c553c2a2e174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:35.306185 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-e9741484-7fc3-4c1e-aaf1-c553c2a2e174 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:35.307636 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e9741484-7fc3-4c1e-aaf1-c553c2a2e174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:35.316184 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1021/2070] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:35.323613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c506b31-7169-4506-a406-92e3bfc10e2e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:35.334190 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c506b31-7169-4506-a406-92e3bfc10e2e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:35.339131 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e1b13-9d8a-4ad5-a697-c0495f65e3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:35.339790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e1b13-9d8a-4ad5-a697-c0495f65e3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:35.340072 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e1b13-9d8a-4ad5-a697-c0495f65e3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:35.340385 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e1b13-9d8a-4ad5-a697-c0495f65e3c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:35.341104 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e1b13-9d8a-4ad5-a697-c0495f65e3c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:21:35.341451 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e1b13-9d8a-4ad5-a697-c0495f65e3c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:35.343074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e1b13-9d8a-4ad5-a697-c0495f65e3c8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:35.354686 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1050/2071] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:21:35.359861 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9741484-7fc3-4c1e-aaf1-c553c2a2e174 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:35.370268 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9741484-7fc3-4c1e-aaf1-c553c2a2e174 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:35.374882 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fc026-6dfc-4445-bf45-ebfb1cca43bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:35.375536 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fc026-6dfc-4445-bf45-ebfb1cca43bc admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:35.375847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fc026-6dfc-4445-bf45-ebfb1cca43bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:35.376116 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fc026-6dfc-4445-bf45-ebfb1cca43bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:35.376808 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fc026-6dfc-4445-bf45-ebfb1cca43bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:35.378768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fc026-6dfc-4445-bf45-ebfb1cca43bc admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:35.463336 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1022/2072] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:21:35 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:21:35.467273 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e1b13-9d8a-4ad5-a697-c0495f65e3c8 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:35.477849 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e1b13-9d8a-4ad5-a697-c0495f65e3c8 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:35.532586 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70b785-83f6-4e59-9911-8aed85481900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:35.533169 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70b785-83f6-4e59-9911-8aed85481900 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:35.533462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70b785-83f6-4e59-9911-8aed85481900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:35.533726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70b785-83f6-4e59-9911-8aed85481900 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:35.534420 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70b785-83f6-4e59-9911-8aed85481900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:35.536489 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70b785-83f6-4e59-9911-8aed85481900 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:35.592743 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1051/2073] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:21:35 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:35.596770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fc026-6dfc-4445-bf45-ebfb1cca43bc admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:35.607557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fc026-6dfc-4445-bf45-ebfb1cca43bc admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:35.612225 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3280a-7da3-4ebd-ab64-c26262762ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:35.612885 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3280a-7da3-4ebd-ab64-c26262762ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:35.613171 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3280a-7da3-4ebd-ab64-c26262762ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:35.613473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3280a-7da3-4ebd-ab64-c26262762ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:35.614278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3280a-7da3-4ebd-ab64-c26262762ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:35.615978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3280a-7da3-4ebd-ab64-c26262762ee1 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:35.628155 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1023/2074] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:35.631956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70b785-83f6-4e59-9911-8aed85481900 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:35.642225 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70b785-83f6-4e59-9911-8aed85481900 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:35.646853 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9a128-c194-478a-81e9-1f9c2b438862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:35.647506 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9a128-c194-478a-81e9-1f9c2b438862 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:35.647793 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9a128-c194-478a-81e9-1f9c2b438862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:35.648070 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9a128-c194-478a-81e9-1f9c2b438862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:35.648922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9a128-c194-478a-81e9-1f9c2b438862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:35.650553 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9a128-c194-478a-81e9-1f9c2b438862 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:35.660210 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1052/2075] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:35.664770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3280a-7da3-4ebd-ab64-c26262762ee1 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:35.674401 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3280a-7da3-4ebd-ab64-c26262762ee1 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:35.678937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d415a-30b4-47ee-afd6-70afb7bf4b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:35.680748 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d415a-30b4-47ee-afd6-70afb7bf4b62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:35.681046 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d415a-30b4-47ee-afd6-70afb7bf4b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:35.681304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d415a-30b4-47ee-afd6-70afb7bf4b62 admin admin] PATH_INFO: `/v3/projects/c450c0c4c3954e96aefb315a599ab588/users/19eda6339bf4481087baea597837f436/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:35.695310 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d415a-30b4-47ee-afd6-70afb7bf4b62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c450c0c4c3954e96aefb315a599ab588, user_id=19eda6339bf4481087baea597837f436, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:35.697947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d415a-30b4-47ee-afd6-70afb7bf4b62 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:35.760561 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1024/2076] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:35 2022] PUT /identity/v3/projects/c450c0c4c3954e96aefb315a599ab588/users/19eda6339bf4481087baea597837f436/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:35.770993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fe6a6-b327-4a33-b8e9-55e7ab1d719a None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:35.771292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fe6a6-b327-4a33-b8e9-55e7ab1d719a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:35.771578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fe6a6-b327-4a33-b8e9-55e7ab1d719a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:35.798129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-cb8fe6a6-b327-4a33-b8e9-55e7ab1d719a None None] MFA Rules not processed for user `19eda6339bf4481087baea597837f436`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:35.799289 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-cb8fe6a6-b327-4a33-b8e9-55e7ab1d719a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:35.865098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1053/2077] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:35.869652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d415a-30b4-47ee-afd6-70afb7bf4b62 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:35.929345 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d415a-30b4-47ee-afd6-70afb7bf4b62 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:35.934151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a9e3f-5596-4463-b478-e527d2d8a396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:35.934864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a9e3f-5596-4463-b478-e527d2d8a396 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:35.935142 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a9e3f-5596-4463-b478-e527d2d8a396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:35.935417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a9e3f-5596-4463-b478-e527d2d8a396 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:35.936107 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a9e3f-5596-4463-b478-e527d2d8a396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:35.937981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a9e3f-5596-4463-b478-e527d2d8a396 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:36.057705 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1025/2078] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:21:35 2022] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:36.057914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fe6a6-b327-4a33-b8e9-55e7ab1d719a None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:36.067512 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fe6a6-b327-4a33-b8e9-55e7ab1d719a None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:36.124639 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b0009-68f2-4420-9644-f43d5fbfd080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:36.125320 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b0009-68f2-4420-9644-f43d5fbfd080 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:36.125606 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b0009-68f2-4420-9644-f43d5fbfd080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:36.125881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b0009-68f2-4420-9644-f43d5fbfd080 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:36.126615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b0009-68f2-4420-9644-f43d5fbfd080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:36.128520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b0009-68f2-4420-9644-f43d5fbfd080 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:36.234269 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1054/2079] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:21:36 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:36.238234 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a9e3f-5596-4463-b478-e527d2d8a396 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:36.248425 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a9e3f-5596-4463-b478-e527d2d8a396 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:36.253083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f0af9-f524-470a-83e1-cb72f4736db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:36.253741 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f0af9-f524-470a-83e1-cb72f4736db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:36.254025 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f0af9-f524-470a-83e1-cb72f4736db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:36.254301 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f0af9-f524-470a-83e1-cb72f4736db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:36.255065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f0af9-f524-470a-83e1-cb72f4736db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:36.256729 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f0af9-f524-470a-83e1-cb72f4736db1 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:36.271123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1026/2080] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:36.272357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b0009-68f2-4420-9644-f43d5fbfd080 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:36.283211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b0009-68f2-4420-9644-f43d5fbfd080 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:36.287850 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ce386-35ad-4827-88e2-137bd0a21c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:36.288506 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ce386-35ad-4827-88e2-137bd0a21c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:36.288823 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ce386-35ad-4827-88e2-137bd0a21c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:36.289136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ce386-35ad-4827-88e2-137bd0a21c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:36.289983 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ce386-35ad-4827-88e2-137bd0a21c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:36.291594 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ce386-35ad-4827-88e2-137bd0a21c93 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:36.301312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1055/2081] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:36.306385 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f0af9-f524-470a-83e1-cb72f4736db1 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:36.316763 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f0af9-f524-470a-83e1-cb72f4736db1 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:36.322115 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5203a-f2a9-482b-8429-55920518d9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:36.323074 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5203a-f2a9-482b-8429-55920518d9d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:36.323363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5203a-f2a9-482b-8429-55920518d9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:36.323660 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5203a-f2a9-482b-8429-55920518d9d5 admin admin] PATH_INFO: `/v3/projects/99e91428c72e44008e768173e2fe1f3a/users/7f074e67e8994f4eaddc4cab95e9c4c1/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:36.338549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5203a-f2a9-482b-8429-55920518d9d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e91428c72e44008e768173e2fe1f3a, user_id=7f074e67e8994f4eaddc4cab95e9c4c1, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:36.341183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5203a-f2a9-482b-8429-55920518d9d5 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:36.410487 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1027/2082] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:36 2022] PUT /identity/v3/projects/99e91428c72e44008e768173e2fe1f3a/users/7f074e67e8994f4eaddc4cab95e9c4c1/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:36.421853 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c017852-e96a-4525-b0ad-de107242b00d None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:36.422248 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c017852-e96a-4525-b0ad-de107242b00d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:36.422697 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c017852-e96a-4525-b0ad-de107242b00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:36.451327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-9c017852-e96a-4525-b0ad-de107242b00d None None] MFA Rules not processed for user `7f074e67e8994f4eaddc4cab95e9c4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:36.452577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9c017852-e96a-4525-b0ad-de107242b00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:36.513238 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1056/2083] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:36.517691 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5203a-f2a9-482b-8429-55920518d9d5 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:36.580453 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5203a-f2a9-482b-8429-55920518d9d5 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:36.584964 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390a130-26f1-4b73-9070-077d740f533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:36.586290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390a130-26f1-4b73-9070-077d740f533f admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:36.586606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390a130-26f1-4b73-9070-077d740f533f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:36.586982 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390a130-26f1-4b73-9070-077d740f533f admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:36.587661 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390a130-26f1-4b73-9070-077d740f533f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:36.589541 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390a130-26f1-4b73-9070-077d740f533f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:36.676205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1028/2084] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:21:36 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:21:36.680419 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c017852-e96a-4525-b0ad-de107242b00d None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:36.691216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c017852-e96a-4525-b0ad-de107242b00d None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:36.746289 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec420d1-81a4-4875-a558-9c68b5554f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:36.746981 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec420d1-81a4-4875-a558-9c68b5554f91 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:36.747267 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec420d1-81a4-4875-a558-9c68b5554f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:36.747544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec420d1-81a4-4875-a558-9c68b5554f91 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:36.748258 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec420d1-81a4-4875-a558-9c68b5554f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:36.750136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec420d1-81a4-4875-a558-9c68b5554f91 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:36.858079 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1057/2085] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:21:36 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:21:36.861149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390a130-26f1-4b73-9070-077d740f533f admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:36.871890 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390a130-26f1-4b73-9070-077d740f533f admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:36.876447 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592d347-b82a-4576-b2db-db39d4b2b152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:36.877123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592d347-b82a-4576-b2db-db39d4b2b152 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:36.877404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592d347-b82a-4576-b2db-db39d4b2b152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:36.877694 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592d347-b82a-4576-b2db-db39d4b2b152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:36.878395 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592d347-b82a-4576-b2db-db39d4b2b152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:36.880017 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592d347-b82a-4576-b2db-db39d4b2b152 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:36.890980 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1029/2086] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:36.895174 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec420d1-81a4-4875-a558-9c68b5554f91 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:36.906960 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec420d1-81a4-4875-a558-9c68b5554f91 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:36.911655 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9295bd-dddc-4eab-8a3a-f1baa98265a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:36.912550 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9295bd-dddc-4eab-8a3a-f1baa98265a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:36.912833 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9295bd-dddc-4eab-8a3a-f1baa98265a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:36.913110 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9295bd-dddc-4eab-8a3a-f1baa98265a1 admin admin] PATH_INFO: `/v3/projects/ecb62edb075d4b67975fb39760c1363b/users/fa414745094c4295b42ab64b3d5f1604/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:36.928688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9295bd-dddc-4eab-8a3a-f1baa98265a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb62edb075d4b67975fb39760c1363b, user_id=fa414745094c4295b42ab64b3d5f1604, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:36.931694 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9295bd-dddc-4eab-8a3a-f1baa98265a1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:37.004493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1058/2087] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:36 2022] PUT /identity/v3/projects/ecb62edb075d4b67975fb39760c1363b/users/fa414745094c4295b42ab64b3d5f1604/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:37.009901 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592d347-b82a-4576-b2db-db39d4b2b152 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:37.019757 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592d347-b82a-4576-b2db-db39d4b2b152 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:37.077392 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f7744-ca5e-4de9-a990-3f9bc06ed4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:37.078093 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f7744-ca5e-4de9-a990-3f9bc06ed4da admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:37.078373 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f7744-ca5e-4de9-a990-3f9bc06ed4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:37.078681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f7744-ca5e-4de9-a990-3f9bc06ed4da admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:37.079406 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f7744-ca5e-4de9-a990-3f9bc06ed4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:37.081111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f7744-ca5e-4de9-a990-3f9bc06ed4da admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:37.091598 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1030/2088] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:21:37.098611 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9295bd-dddc-4eab-8a3a-f1baa98265a1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:37.106498 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9295bd-dddc-4eab-8a3a-f1baa98265a1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:37.111114 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb415e4-2c9a-47ba-896d-31fcfe6f3ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:37.111993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb415e4-2c9a-47ba-896d-31fcfe6f3ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:37.112275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb415e4-2c9a-47ba-896d-31fcfe6f3ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:37.112550 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb415e4-2c9a-47ba-896d-31fcfe6f3ac0 admin admin] PATH_INFO: `/v3/projects/ecb62edb075d4b67975fb39760c1363b/users/fa414745094c4295b42ab64b3d5f1604/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:37.114725 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb415e4-2c9a-47ba-896d-31fcfe6f3ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb62edb075d4b67975fb39760c1363b, user_id=fa414745094c4295b42ab64b3d5f1604, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:37.117576 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb415e4-2c9a-47ba-896d-31fcfe6f3ac0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:37.131423 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1059/2089] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:21:37 2022] PUT /identity/v3/projects/ecb62edb075d4b67975fb39760c1363b/users/fa414745094c4295b42ab64b3d5f1604/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:37.142697 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd6adc-aa73-4dc8-ac31-4f3600c41831 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:37.142984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd6adc-aa73-4dc8-ac31-4f3600c41831 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:37.143257 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd6adc-aa73-4dc8-ac31-4f3600c41831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:37.180126 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-71cd6adc-aa73-4dc8-ac31-4f3600c41831 None None] MFA Rules not processed for user `fa414745094c4295b42ab64b3d5f1604`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:37.181469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-71cd6adc-aa73-4dc8-ac31-4f3600c41831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:37.251405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1031/2090] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:37.263964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb415e4-2c9a-47ba-896d-31fcfe6f3ac0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:37.265874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6cb415e4-2c9a-47ba-896d-31fcfe6f3ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:37.325019 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb415e4-2c9a-47ba-896d-31fcfe6f3ac0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:37.328741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee7c42-58ed-4d44-8c18-948662e5cf3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:37.329395 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee7c42-58ed-4d44-8c18-948662e5cf3c service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:37.329673 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee7c42-58ed-4d44-8c18-948662e5cf3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:37.329958 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee7c42-58ed-4d44-8c18-948662e5cf3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:37.387454 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee7c42-58ed-4d44-8c18-948662e5cf3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:37.388868 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee7c42-58ed-4d44-8c18-948662e5cf3c service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:37.399126 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1060/2091] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:40.393174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd6adc-aa73-4dc8-ac31-4f3600c41831 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:40.394731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-71cd6adc-aa73-4dc8-ac31-4f3600c41831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:40.407044 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd6adc-aa73-4dc8-ac31-4f3600c41831 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:40.410653 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9174dd-0919-4f9e-937f-7793b92e94bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:40.411295 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9174dd-0919-4f9e-937f-7793b92e94bc service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:40.411583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9174dd-0919-4f9e-937f-7793b92e94bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:40.411859 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9174dd-0919-4f9e-937f-7793b92e94bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:40.469880 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9174dd-0919-4f9e-937f-7793b92e94bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:40.471334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9174dd-0919-4f9e-937f-7793b92e94bc service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:40.481074 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1032/2092] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:42.047554 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee7c42-58ed-4d44-8c18-948662e5cf3c service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:42.056379 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee7c42-58ed-4d44-8c18-948662e5cf3c service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:42.060200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee93296-b62b-4aaa-86c7-73874f534015 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:42.060831 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee93296-b62b-4aaa-86c7-73874f534015 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:42.061271 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee93296-b62b-4aaa-86c7-73874f534015 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:42.061543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee93296-b62b-4aaa-86c7-73874f534015 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:42.070549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee93296-b62b-4aaa-86c7-73874f534015 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:42.071963 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee93296-b62b-4aaa-86c7-73874f534015 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:42.081144 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1061/2093] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:49.959293 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9174dd-0919-4f9e-937f-7793b92e94bc service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:50.029044 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9174dd-0919-4f9e-937f-7793b92e94bc service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:50.033747 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d8a5b-a1ef-4e90-96a7-27a200e91e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:50.034680 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d8a5b-a1ef-4e90-96a7-27a200e91e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:50.034961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d8a5b-a1ef-4e90-96a7-27a200e91e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:50.035233 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d8a5b-a1ef-4e90-96a7-27a200e91e4d admin admin] PATH_INFO: `/v3/users/19eda6339bf4481087baea597837f436` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:50.036433 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d8a5b-a1ef-4e90-96a7-27a200e91e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=19eda6339bf4481087baea597837f436)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:50.038352 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d8a5b-a1ef-4e90-96a7-27a200e91e4d admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:50.235345 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-081d8a5b-a1ef-4e90-96a7-27a200e91e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19eda6339bf4481087baea597837f436'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:50.236004 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-081d8a5b-a1ef-4e90-96a7-27a200e91e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19eda6339bf4481087baea597837f436'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:50.247797 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-081d8a5b-a1ef-4e90-96a7-27a200e91e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19eda6339bf4481087baea597837f436'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:50.248452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-081d8a5b-a1ef-4e90-96a7-27a200e91e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19eda6339bf4481087baea597837f436'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:50.254997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-081d8a5b-a1ef-4e90-96a7-27a200e91e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19eda6339bf4481087baea597837f436'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:50.341612 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1033/2094] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:49 2022] DELETE /identity/v3/users/19eda6339bf4481087baea597837f436 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:50.346108 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6237126-415b-45dd-8812-cb06433f3789 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:50.346644 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6237126-415b-45dd-8812-cb06433f3789 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:50.346726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6237126-415b-45dd-8812-cb06433f3789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:50.372918 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f6237126-415b-45dd-8812-cb06433f3789 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:21:50.372918 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f6237126-415b-45dd-8812-cb06433f3789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:50.436434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1062/2095] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:21:50.446742 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d8a5b-a1ef-4e90-96a7-27a200e91e4d admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:50.448287 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-081d8a5b-a1ef-4e90-96a7-27a200e91e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:50.509744 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d8a5b-a1ef-4e90-96a7-27a200e91e4d admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:50.513961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585d7a3-ffa7-47c2-b3fc-7cf7d89019b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:50.514837 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585d7a3-ffa7-47c2-b3fc-7cf7d89019b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:50.515142 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585d7a3-ffa7-47c2-b3fc-7cf7d89019b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:50.515538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585d7a3-ffa7-47c2-b3fc-7cf7d89019b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:50.526371 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585d7a3-ffa7-47c2-b3fc-7cf7d89019b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:50.531272 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585d7a3-ffa7-47c2-b3fc-7cf7d89019b6 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:50.537508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1034/2096] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:21:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:50.932167 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6237126-415b-45dd-8812-cb06433f3789 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:50.933685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f6237126-415b-45dd-8812-cb06433f3789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:50.946703 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6237126-415b-45dd-8812-cb06433f3789 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:50.951363 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1a72e-573e-4870-9d78-8bba6ee9f073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:50.952354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1a72e-573e-4870-9d78-8bba6ee9f073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:50.952642 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1a72e-573e-4870-9d78-8bba6ee9f073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:50.953468 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1a72e-573e-4870-9d78-8bba6ee9f073 admin admin] PATH_INFO: `/v3/projects/c450c0c4c3954e96aefb315a599ab588` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:50.955059 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1a72e-573e-4870-9d78-8bba6ee9f073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c450c0c4c3954e96aefb315a599ab588)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:50.957001 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1a72e-573e-4870-9d78-8bba6ee9f073 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:51.079467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-95d1a72e-573e-4870-9d78-8bba6ee9f073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c450c0c4c3954e96aefb315a599ab588', 'request_id': 'req-95d1a72e-573e-4870-9d78-8bba6ee9f073'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:51.146962 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-95d1a72e-573e-4870-9d78-8bba6ee9f073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c450c0c4c3954e96aefb315a599ab588', 'request_id': 'req-95d1a72e-573e-4870-9d78-8bba6ee9f073'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:51.153433 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-95d1a72e-573e-4870-9d78-8bba6ee9f073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c450c0c4c3954e96aefb315a599ab588', 'request_id': 'req-95d1a72e-573e-4870-9d78-8bba6ee9f073'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:51.164772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-95d1a72e-573e-4870-9d78-8bba6ee9f073 admin admin] The token cache is being invalidate because project c450c0c4c3954e96aefb315a599ab588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:51.165061 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-95d1a72e-573e-4870-9d78-8bba6ee9f073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:51.165889 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-95d1a72e-573e-4870-9d78-8bba6ee9f073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:51.167499 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1063/2097] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:50 2022] DELETE /identity/v3/projects/c450c0c4c3954e96aefb315a599ab588 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:51.171887 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585d7a3-ffa7-47c2-b3fc-7cf7d89019b6 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:51.188406 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585d7a3-ffa7-47c2-b3fc-7cf7d89019b6 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:51.288960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faa678-7240-4fae-8ad5-6794d98c0f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:51.290716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faa678-7240-4fae-8ad5-6794d98c0f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:51.290999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faa678-7240-4fae-8ad5-6794d98c0f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:51.291274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faa678-7240-4fae-8ad5-6794d98c0f8a admin admin] PATH_INFO: `/v3/users/7f074e67e8994f4eaddc4cab95e9c4c1` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:51.292678 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62faa678-7240-4fae-8ad5-6794d98c0f8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f074e67e8994f4eaddc4cab95e9c4c1)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:51.294871 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62faa678-7240-4fae-8ad5-6794d98c0f8a admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:51.474503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-62faa678-7240-4fae-8ad5-6794d98c0f8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f074e67e8994f4eaddc4cab95e9c4c1'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:51.475130 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-62faa678-7240-4fae-8ad5-6794d98c0f8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f074e67e8994f4eaddc4cab95e9c4c1'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:51.487408 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-62faa678-7240-4fae-8ad5-6794d98c0f8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f074e67e8994f4eaddc4cab95e9c4c1'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:51.488125 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-62faa678-7240-4fae-8ad5-6794d98c0f8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f074e67e8994f4eaddc4cab95e9c4c1'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:51.495934 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-62faa678-7240-4fae-8ad5-6794d98c0f8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f074e67e8994f4eaddc4cab95e9c4c1'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:51.592867 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1035/2098] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:51 2022] DELETE /identity/v3/users/7f074e67e8994f4eaddc4cab95e9c4c1 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:51.971682 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1a72e-573e-4870-9d78-8bba6ee9f073 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:51.973132 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-95d1a72e-573e-4870-9d78-8bba6ee9f073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:51.986183 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1a72e-573e-4870-9d78-8bba6ee9f073 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:52.044836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd5038-5247-4de2-ae5b-6f304b489109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:52.045720 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd5038-5247-4de2-ae5b-6f304b489109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:52.046001 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd5038-5247-4de2-ae5b-6f304b489109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:52.046272 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd5038-5247-4de2-ae5b-6f304b489109 admin admin] PATH_INFO: `/v3/projects/99e91428c72e44008e768173e2fe1f3a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:52.047565 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd5038-5247-4de2-ae5b-6f304b489109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99e91428c72e44008e768173e2fe1f3a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:52.049525 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd5038-5247-4de2-ae5b-6f304b489109 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:52.169207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5cdd5038-5247-4de2-ae5b-6f304b489109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99e91428c72e44008e768173e2fe1f3a', 'request_id': 'req-5cdd5038-5247-4de2-ae5b-6f304b489109'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:52.283827 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5cdd5038-5247-4de2-ae5b-6f304b489109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99e91428c72e44008e768173e2fe1f3a', 'request_id': 'req-5cdd5038-5247-4de2-ae5b-6f304b489109'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:52.291211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5cdd5038-5247-4de2-ae5b-6f304b489109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99e91428c72e44008e768173e2fe1f3a', 'request_id': 'req-5cdd5038-5247-4de2-ae5b-6f304b489109'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:52.302700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5cdd5038-5247-4de2-ae5b-6f304b489109 admin admin] The token cache is being invalidate because project 99e91428c72e44008e768173e2fe1f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:52.302999 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5cdd5038-5247-4de2-ae5b-6f304b489109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:52.303780 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5cdd5038-5247-4de2-ae5b-6f304b489109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:52.305383 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1064/2099] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:51 2022] DELETE /identity/v3/projects/99e91428c72e44008e768173e2fe1f3a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:52.310368 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faa678-7240-4fae-8ad5-6794d98c0f8a admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:52.311864 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-62faa678-7240-4fae-8ad5-6794d98c0f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:52.325120 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faa678-7240-4fae-8ad5-6794d98c0f8a admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:52.381471 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c58e5f-d172-48ec-8e38-18c7c2176638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:52.382669 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c58e5f-d172-48ec-8e38-18c7c2176638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:52.382956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c58e5f-d172-48ec-8e38-18c7c2176638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:52.383232 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c58e5f-d172-48ec-8e38-18c7c2176638 admin admin] PATH_INFO: `/v3/users/fa414745094c4295b42ab64b3d5f1604` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:52.385243 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c58e5f-d172-48ec-8e38-18c7c2176638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa414745094c4295b42ab64b3d5f1604)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:52.387214 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c58e5f-d172-48ec-8e38-18c7c2176638 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:52.617154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-31c58e5f-d172-48ec-8e38-18c7c2176638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa414745094c4295b42ab64b3d5f1604'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:52.617811 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-31c58e5f-d172-48ec-8e38-18c7c2176638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa414745094c4295b42ab64b3d5f1604'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:52.630079 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-31c58e5f-d172-48ec-8e38-18c7c2176638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa414745094c4295b42ab64b3d5f1604'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:52.630770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-31c58e5f-d172-48ec-8e38-18c7c2176638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa414745094c4295b42ab64b3d5f1604'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:52.638822 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-31c58e5f-d172-48ec-8e38-18c7c2176638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa414745094c4295b42ab64b3d5f1604'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:52.723291 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1036/2100] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:21:52 2022] DELETE /identity/v3/users/fa414745094c4295b42ab64b3d5f1604 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:21:53.148064 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd5038-5247-4de2-ae5b-6f304b489109 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:53.150652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5cdd5038-5247-4de2-ae5b-6f304b489109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:21:53.163155 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd5038-5247-4de2-ae5b-6f304b489109 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:53.220897 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502d3f9-1407-4e8f-aa5e-75eb8575d644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:53.221812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502d3f9-1407-4e8f-aa5e-75eb8575d644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:53.222118 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502d3f9-1407-4e8f-aa5e-75eb8575d644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:53.222396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502d3f9-1407-4e8f-aa5e-75eb8575d644 admin admin] PATH_INFO: `/v3/projects/ecb62edb075d4b67975fb39760c1363b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:53.223891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502d3f9-1407-4e8f-aa5e-75eb8575d644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb62edb075d4b67975fb39760c1363b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:53.225849 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502d3f9-1407-4e8f-aa5e-75eb8575d644 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:53.341835 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8502d3f9-1407-4e8f-aa5e-75eb8575d644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb62edb075d4b67975fb39760c1363b', 'request_id': 'req-8502d3f9-1407-4e8f-aa5e-75eb8575d644'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:53.421264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8502d3f9-1407-4e8f-aa5e-75eb8575d644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb62edb075d4b67975fb39760c1363b', 'request_id': 'req-8502d3f9-1407-4e8f-aa5e-75eb8575d644'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:53.427583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8502d3f9-1407-4e8f-aa5e-75eb8575d644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb62edb075d4b67975fb39760c1363b', 'request_id': 'req-8502d3f9-1407-4e8f-aa5e-75eb8575d644'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:53.438964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8502d3f9-1407-4e8f-aa5e-75eb8575d644 admin admin] The token cache is being invalidate because project ecb62edb075d4b67975fb39760c1363b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:21:53.439257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8502d3f9-1407-4e8f-aa5e-75eb8575d644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:53.440231 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8502d3f9-1407-4e8f-aa5e-75eb8575d644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:21:53.441405 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1065/2101] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:21:53 2022] DELETE /identity/v3/projects/ecb62edb075d4b67975fb39760c1363b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:03.679993 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c58e5f-d172-48ec-8e38-18c7c2176638 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:03.681437 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-31c58e5f-d172-48ec-8e38-18c7c2176638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:03.765375 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c58e5f-d172-48ec-8e38-18c7c2176638 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:03.823205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444799c-5358-4f63-99b5-ac73546d5d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:03.825894 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444799c-5358-4f63-99b5-ac73546d5d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:03.825894 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444799c-5358-4f63-99b5-ac73546d5d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:03.825894 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444799c-5358-4f63-99b5-ac73546d5d75 admin admin] PATH_INFO: `/v3/users/ec3e17165e9b4cecbe35acf44a09084c` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:03.826886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444799c-5358-4f63-99b5-ac73546d5d75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec3e17165e9b4cecbe35acf44a09084c)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:03.828904 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444799c-5358-4f63-99b5-ac73546d5d75 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:04.050810 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-a444799c-5358-4f63-99b5-ac73546d5d75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec3e17165e9b4cecbe35acf44a09084c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:04.051493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-a444799c-5358-4f63-99b5-ac73546d5d75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec3e17165e9b4cecbe35acf44a09084c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:04.063408 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-a444799c-5358-4f63-99b5-ac73546d5d75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec3e17165e9b4cecbe35acf44a09084c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:04.064049 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-a444799c-5358-4f63-99b5-ac73546d5d75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec3e17165e9b4cecbe35acf44a09084c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:04.070752 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-a444799c-5358-4f63-99b5-ac73546d5d75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec3e17165e9b4cecbe35acf44a09084c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:04.157917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1037/2102] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:22:03 2022] DELETE /identity/v3/users/ec3e17165e9b4cecbe35acf44a09084c => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:04.162306 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd064d75-3dea-492d-a136-854906c031ca None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:04.162801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd064d75-3dea-492d-a136-854906c031ca None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:04.162951 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd064d75-3dea-492d-a136-854906c031ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:04.196112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-cd064d75-3dea-492d-a136-854906c031ca None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:04.196112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-cd064d75-3dea-492d-a136-854906c031ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:04.251456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1066/2103] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:04.261391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444799c-5358-4f63-99b5-ac73546d5d75 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:04.263512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a444799c-5358-4f63-99b5-ac73546d5d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:04.358764 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444799c-5358-4f63-99b5-ac73546d5d75 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:04.362391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a132e07-459d-4ed8-b64e-4bb5cacb4b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:04.363063 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a132e07-459d-4ed8-b64e-4bb5cacb4b93 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:04.363352 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a132e07-459d-4ed8-b64e-4bb5cacb4b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:04.363628 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a132e07-459d-4ed8-b64e-4bb5cacb4b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:04.373225 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a132e07-459d-4ed8-b64e-4bb5cacb4b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:04.374730 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a132e07-459d-4ed8-b64e-4bb5cacb4b93 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:04.384246 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1038/2104] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:22:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:22:04.773090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd064d75-3dea-492d-a136-854906c031ca None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:04.774674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-cd064d75-3dea-492d-a136-854906c031ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:04.786867 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd064d75-3dea-492d-a136-854906c031ca None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:04.791933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ad760-a345-4edf-9149-f68e02926281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:04.792793 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ad760-a345-4edf-9149-f68e02926281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:04.793146 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ad760-a345-4edf-9149-f68e02926281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:04.793339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ad760-a345-4edf-9149-f68e02926281 admin admin] PATH_INFO: `/v3/projects/070137d4f7db4fd3a9d749ab528b63fa` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:04.795109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ad760-a345-4edf-9149-f68e02926281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=070137d4f7db4fd3a9d749ab528b63fa)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:04.796996 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ad760-a345-4edf-9149-f68e02926281 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:04.923335 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2c1ad760-a345-4edf-9149-f68e02926281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070137d4f7db4fd3a9d749ab528b63fa', 'request_id': 'req-2c1ad760-a345-4edf-9149-f68e02926281'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:05.008647 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2c1ad760-a345-4edf-9149-f68e02926281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070137d4f7db4fd3a9d749ab528b63fa', 'request_id': 'req-2c1ad760-a345-4edf-9149-f68e02926281'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:05.014636 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2c1ad760-a345-4edf-9149-f68e02926281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070137d4f7db4fd3a9d749ab528b63fa', 'request_id': 'req-2c1ad760-a345-4edf-9149-f68e02926281'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:05.025672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2c1ad760-a345-4edf-9149-f68e02926281 admin admin] The token cache is being invalidate because project 070137d4f7db4fd3a9d749ab528b63fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:22:05.025963 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2c1ad760-a345-4edf-9149-f68e02926281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:05.026636 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2c1ad760-a345-4edf-9149-f68e02926281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:05.028955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1067/2105] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:22:04 2022] DELETE /identity/v3/projects/070137d4f7db4fd3a9d749ab528b63fa => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:05.033699 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9d586-e3f4-4db1-92a3-56c2fbf8383f None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:05.035416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9d586-e3f4-4db1-92a3-56c2fbf8383f None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:05.035416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9d586-e3f4-4db1-92a3-56c2fbf8383f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:05.071645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-b1f9d586-e3f4-4db1-92a3-56c2fbf8383f None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:05.072841 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-b1f9d586-e3f4-4db1-92a3-56c2fbf8383f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:05.134732 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1039/2106] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:05.140849 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef434e60-d08e-48cc-b1d3-0eb9cb4066a9 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:05.141140 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef434e60-d08e-48cc-b1d3-0eb9cb4066a9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:05.141414 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef434e60-d08e-48cc-b1d3-0eb9cb4066a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:05.159884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-ef434e60-d08e-48cc-b1d3-0eb9cb4066a9 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:05.161074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ef434e60-d08e-48cc-b1d3-0eb9cb4066a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:05.169930 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1068/2107] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:05.174074 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9d586-e3f4-4db1-92a3-56c2fbf8383f None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:05.183639 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9d586-e3f4-4db1-92a3-56c2fbf8383f None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:05.188652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22139f04-510f-4f9d-bf82-ca0528270c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:05.189299 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22139f04-510f-4f9d-bf82-ca0528270c5b admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:05.189576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22139f04-510f-4f9d-bf82-ca0528270c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:05.189847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22139f04-510f-4f9d-bf82-ca0528270c5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:05.190696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22139f04-510f-4f9d-bf82-ca0528270c5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:22:05.191002 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22139f04-510f-4f9d-bf82-ca0528270c5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:05.192575 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22139f04-510f-4f9d-bf82-ca0528270c5b admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:05.204298 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1040/2108] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:22:05.208604 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef434e60-d08e-48cc-b1d3-0eb9cb4066a9 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:05.218053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef434e60-d08e-48cc-b1d3-0eb9cb4066a9 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:05.222819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd803e-ab55-4656-b70d-e77379daa12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:05.223463 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd803e-ab55-4656-b70d-e77379daa12a admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:05.223746 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd803e-ab55-4656-b70d-e77379daa12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:05.224020 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd803e-ab55-4656-b70d-e77379daa12a admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:05.224717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd803e-ab55-4656-b70d-e77379daa12a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:05.226638 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd803e-ab55-4656-b70d-e77379daa12a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:05.318914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1069/2109] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:22:05 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:22:05.322920 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22139f04-510f-4f9d-bf82-ca0528270c5b admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:05.333259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22139f04-510f-4f9d-bf82-ca0528270c5b admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:05.386885 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0fc15-f0a3-4262-bd9e-f4189aa9a90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:05.387547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0fc15-f0a3-4262-bd9e-f4189aa9a90f admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:05.388439 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0fc15-f0a3-4262-bd9e-f4189aa9a90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:05.388732 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0fc15-f0a3-4262-bd9e-f4189aa9a90f admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:05.389496 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0fc15-f0a3-4262-bd9e-f4189aa9a90f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:05.391438 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0fc15-f0a3-4262-bd9e-f4189aa9a90f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:05.466969 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1041/2110] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:22:05 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:22:05.473637 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd803e-ab55-4656-b70d-e77379daa12a admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:05.484181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd803e-ab55-4656-b70d-e77379daa12a admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:05.488771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615b444-04cf-4b57-9ddd-330c66a1576e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:05.489419 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615b444-04cf-4b57-9ddd-330c66a1576e admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:05.489704 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615b444-04cf-4b57-9ddd-330c66a1576e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:05.489985 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615b444-04cf-4b57-9ddd-330c66a1576e admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:05.490749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615b444-04cf-4b57-9ddd-330c66a1576e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:05.492331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615b444-04cf-4b57-9ddd-330c66a1576e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:05.502647 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1070/2111] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:22:05.506306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0fc15-f0a3-4262-bd9e-f4189aa9a90f admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:05.516966 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0fc15-f0a3-4262-bd9e-f4189aa9a90f admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:05.521697 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4d535-4369-43b9-9438-0a3fad24eae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:05.522355 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4d535-4369-43b9-9438-0a3fad24eae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:05.522679 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4d535-4369-43b9-9438-0a3fad24eae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:05.523072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4d535-4369-43b9-9438-0a3fad24eae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:05.523834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4d535-4369-43b9-9438-0a3fad24eae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:05.525474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4d535-4369-43b9-9438-0a3fad24eae4 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:05.539138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1042/2112] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:22:05.540279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615b444-04cf-4b57-9ddd-330c66a1576e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:05.550653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615b444-04cf-4b57-9ddd-330c66a1576e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:05.555379 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103abda9-251e-49a3-bd7d-63c0cdf358da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:05.556261 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103abda9-251e-49a3-bd7d-63c0cdf358da admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:05.556546 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103abda9-251e-49a3-bd7d-63c0cdf358da admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:05.556917 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103abda9-251e-49a3-bd7d-63c0cdf358da admin admin] PATH_INFO: `/v3/projects/eda2d177aafc4fea94a790441a580fcf/users/84dc62e15dfc4212bd91e0946e89dd9d/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:05.571466 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103abda9-251e-49a3-bd7d-63c0cdf358da admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda2d177aafc4fea94a790441a580fcf, user_id=84dc62e15dfc4212bd91e0946e89dd9d, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:05.574056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103abda9-251e-49a3-bd7d-63c0cdf358da admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:05.665932 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1071/2113] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:22:05 2022] PUT /identity/v3/projects/eda2d177aafc4fea94a790441a580fcf/users/84dc62e15dfc4212bd91e0946e89dd9d/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:05.676489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac36f22-a863-4011-b974-1aa8d129f269 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:05.676788 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac36f22-a863-4011-b974-1aa8d129f269 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:05.677068 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac36f22-a863-4011-b974-1aa8d129f269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:05.703675 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-3ac36f22-a863-4011-b974-1aa8d129f269 None None] MFA Rules not processed for user `84dc62e15dfc4212bd91e0946e89dd9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:05.704865 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-3ac36f22-a863-4011-b974-1aa8d129f269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:05.766214 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1043/2114] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:05.776807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103abda9-251e-49a3-bd7d-63c0cdf358da admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:05.778589 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-103abda9-251e-49a3-bd7d-63c0cdf358da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:05.834328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103abda9-251e-49a3-bd7d-63c0cdf358da admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:05.837855 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98afec-3162-4ec4-a1e5-eef695f2a308 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:05.838523 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98afec-3162-4ec4-a1e5-eef695f2a308 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:05.838806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98afec-3162-4ec4-a1e5-eef695f2a308 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:05.839085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98afec-3162-4ec4-a1e5-eef695f2a308 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:05.847552 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98afec-3162-4ec4-a1e5-eef695f2a308 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:05.848965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98afec-3162-4ec4-a1e5-eef695f2a308 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:05.858037 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1072/2115] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:22:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:22:11.722254 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6d3ab-3dbb-4a64-93c3-2c20cbab4d80 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:11.722798 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6d3ab-3dbb-4a64-93c3-2c20cbab4d80 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:11.722964 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6d3ab-3dbb-4a64-93c3-2c20cbab4d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:11.741673 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-08e6d3ab-3dbb-4a64-93c3-2c20cbab4d80 None None] MFA Rules not processed for user `84dc62e15dfc4212bd91e0946e89dd9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:11.744221 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-08e6d3ab-3dbb-4a64-93c3-2c20cbab4d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:11.749921 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1044/2116] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:22:14.545930 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98afec-3162-4ec4-a1e5-eef695f2a308 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:14.547449 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8e98afec-3162-4ec4-a1e5-eef695f2a308 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:14.621398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98afec-3162-4ec4-a1e5-eef695f2a308 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:14.626820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ea87a-d921-4b71-8ad1-ea5b7f69b485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:14.627768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ea87a-d921-4b71-8ad1-ea5b7f69b485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:14.628120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ea87a-d921-4b71-8ad1-ea5b7f69b485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:14.628460 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ea87a-d921-4b71-8ad1-ea5b7f69b485 admin admin] PATH_INFO: `/v3/users/989e870c1d7d45b28f87ec264d71332e` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:14.630872 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ea87a-d921-4b71-8ad1-ea5b7f69b485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=989e870c1d7d45b28f87ec264d71332e)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:14.635129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ea87a-d921-4b71-8ad1-ea5b7f69b485 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:14.852353 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-908ea87a-d921-4b71-8ad1-ea5b7f69b485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989e870c1d7d45b28f87ec264d71332e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:14.853076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-908ea87a-d921-4b71-8ad1-ea5b7f69b485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989e870c1d7d45b28f87ec264d71332e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:14.853687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-908ea87a-d921-4b71-8ad1-ea5b7f69b485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989e870c1d7d45b28f87ec264d71332e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:14.866210 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-908ea87a-d921-4b71-8ad1-ea5b7f69b485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989e870c1d7d45b28f87ec264d71332e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:14.875142 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-908ea87a-d921-4b71-8ad1-ea5b7f69b485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989e870c1d7d45b28f87ec264d71332e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:14.969292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1073/2117] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:22:14 2022] DELETE /identity/v3/users/989e870c1d7d45b28f87ec264d71332e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:14.973919 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cf0c7-a60a-4df5-b895-a5dc33a3e2f8 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:14.974375 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cf0c7-a60a-4df5-b895-a5dc33a3e2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:14.974534 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cf0c7-a60a-4df5-b895-a5dc33a3e2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:14.993283 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-d13cf0c7-a60a-4df5-b895-a5dc33a3e2f8 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:14.994583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-d13cf0c7-a60a-4df5-b895-a5dc33a3e2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:15.056005 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1045/2118] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:15.065649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ea87a-d921-4b71-8ad1-ea5b7f69b485 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:15.067067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-908ea87a-d921-4b71-8ad1-ea5b7f69b485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:15.124486 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ea87a-d921-4b71-8ad1-ea5b7f69b485 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:15.128389 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a8d61-57d2-4abf-8d80-a6b58f2baf5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:15.128975 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a8d61-57d2-4abf-8d80-a6b58f2baf5c service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:15.129255 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a8d61-57d2-4abf-8d80-a6b58f2baf5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:15.129532 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a8d61-57d2-4abf-8d80-a6b58f2baf5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:15.139919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a8d61-57d2-4abf-8d80-a6b58f2baf5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:15.141338 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a8d61-57d2-4abf-8d80-a6b58f2baf5c service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:15.151055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1074/2119] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:22:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:22:15.701855 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cf0c7-a60a-4df5-b895-a5dc33a3e2f8 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:15.707397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-d13cf0c7-a60a-4df5-b895-a5dc33a3e2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:15.746897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cf0c7-a60a-4df5-b895-a5dc33a3e2f8 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:15.754684 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdafc3f-7540-4f18-896f-8b89e7547ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:15.755766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdafc3f-7540-4f18-896f-8b89e7547ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:15.757381 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdafc3f-7540-4f18-896f-8b89e7547ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:15.757689 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdafc3f-7540-4f18-896f-8b89e7547ca1 admin admin] PATH_INFO: `/v3/projects/ebbee11b6c6b476f9b92408c0ae00dc1` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:15.759760 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdafc3f-7540-4f18-896f-8b89e7547ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebbee11b6c6b476f9b92408c0ae00dc1)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:15.774725 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdafc3f-7540-4f18-896f-8b89e7547ca1 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:15.905795 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-ecdafc3f-7540-4f18-896f-8b89e7547ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebbee11b6c6b476f9b92408c0ae00dc1', 'request_id': 'req-ecdafc3f-7540-4f18-896f-8b89e7547ca1'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:15.963090 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-ecdafc3f-7540-4f18-896f-8b89e7547ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebbee11b6c6b476f9b92408c0ae00dc1', 'request_id': 'req-ecdafc3f-7540-4f18-896f-8b89e7547ca1'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:15.972470 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-ecdafc3f-7540-4f18-896f-8b89e7547ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebbee11b6c6b476f9b92408c0ae00dc1', 'request_id': 'req-ecdafc3f-7540-4f18-896f-8b89e7547ca1'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:15.987089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-ecdafc3f-7540-4f18-896f-8b89e7547ca1 admin admin] The token cache is being invalidate because project ebbee11b6c6b476f9b92408c0ae00dc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:22:15.987639 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-ecdafc3f-7540-4f18-896f-8b89e7547ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:15.988170 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-ecdafc3f-7540-4f18-896f-8b89e7547ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:15.989871 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1046/2120] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:22:15 2022] DELETE /identity/v3/projects/ebbee11b6c6b476f9b92408c0ae00dc1 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:15.994909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33255c98-bfb3-412c-b190-b1806a034336 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:15.995385 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33255c98-bfb3-412c-b190-b1806a034336 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:15.995474 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33255c98-bfb3-412c-b190-b1806a034336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:16.030013 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-33255c98-bfb3-412c-b190-b1806a034336 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:16.031292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-33255c98-bfb3-412c-b190-b1806a034336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:16.092774 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1075/2121] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:16.100731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ed1ea-334a-4b15-be8c-2b09f90af6f8 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:16.105511 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ed1ea-334a-4b15-be8c-2b09f90af6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:16.105511 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ed1ea-334a-4b15-be8c-2b09f90af6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:16.120079 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-676ed1ea-334a-4b15-be8c-2b09f90af6f8 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:16.121355 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-676ed1ea-334a-4b15-be8c-2b09f90af6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:16.129974 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1047/2122] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:16.134577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33255c98-bfb3-412c-b190-b1806a034336 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:16.144805 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33255c98-bfb3-412c-b190-b1806a034336 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:16.149477 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f06fd6-7ad3-4a94-a722-efa2fcafc712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:16.150168 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f06fd6-7ad3-4a94-a722-efa2fcafc712 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:16.150552 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f06fd6-7ad3-4a94-a722-efa2fcafc712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:16.150898 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f06fd6-7ad3-4a94-a722-efa2fcafc712 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:16.151688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f06fd6-7ad3-4a94-a722-efa2fcafc712 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:22:16.152060 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f06fd6-7ad3-4a94-a722-efa2fcafc712 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:16.153806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f06fd6-7ad3-4a94-a722-efa2fcafc712 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:16.166467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1076/2123] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:22:16.170976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ed1ea-334a-4b15-be8c-2b09f90af6f8 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:16.180130 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ed1ea-334a-4b15-be8c-2b09f90af6f8 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:16.185595 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9d00d-6eb7-446f-92bb-6e0d792bd488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:16.186545 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9d00d-6eb7-446f-92bb-6e0d792bd488 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:16.186832 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9d00d-6eb7-446f-92bb-6e0d792bd488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:16.187110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9d00d-6eb7-446f-92bb-6e0d792bd488 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:16.187839 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9d00d-6eb7-446f-92bb-6e0d792bd488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:16.189742 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9d00d-6eb7-446f-92bb-6e0d792bd488 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:16.301833 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1048/2124] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:22:16 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:22:16.305894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f06fd6-7ad3-4a94-a722-efa2fcafc712 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:16.316427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f06fd6-7ad3-4a94-a722-efa2fcafc712 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:16.371325 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d033ce-7e83-4b50-9ba5-51e885330090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:16.371988 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d033ce-7e83-4b50-9ba5-51e885330090 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:16.372274 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d033ce-7e83-4b50-9ba5-51e885330090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:16.372634 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d033ce-7e83-4b50-9ba5-51e885330090 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:16.374397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d033ce-7e83-4b50-9ba5-51e885330090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:16.376339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d033ce-7e83-4b50-9ba5-51e885330090 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:16.465863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1077/2125] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:22:16 2022] POST /identity/v3/users => generated 283 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:22:16.467450 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9d00d-6eb7-446f-92bb-6e0d792bd488 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:16.487268 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9d00d-6eb7-446f-92bb-6e0d792bd488 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:16.504987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f03c7-3150-49db-83f0-418ea3268e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:16.505851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f03c7-3150-49db-83f0-418ea3268e64 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:16.506680 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f03c7-3150-49db-83f0-418ea3268e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:16.507029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f03c7-3150-49db-83f0-418ea3268e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:16.508586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f03c7-3150-49db-83f0-418ea3268e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:16.510226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f03c7-3150-49db-83f0-418ea3268e64 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:16.534399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1049/2126] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:22:16.538458 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d033ce-7e83-4b50-9ba5-51e885330090 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:16.554921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d033ce-7e83-4b50-9ba5-51e885330090 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:16.565185 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0034b1c-4d95-454a-82d4-427bba58460e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:16.566386 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0034b1c-4d95-454a-82d4-427bba58460e admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:16.567200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0034b1c-4d95-454a-82d4-427bba58460e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:16.567815 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0034b1c-4d95-454a-82d4-427bba58460e admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:16.568776 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0034b1c-4d95-454a-82d4-427bba58460e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:16.571274 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0034b1c-4d95-454a-82d4-427bba58460e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:16.592788 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1078/2127] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:22:16.596904 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f03c7-3150-49db-83f0-418ea3268e64 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:16.611893 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f03c7-3150-49db-83f0-418ea3268e64 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:16.616769 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87a055-4c3d-4da4-9e44-8599db8ac4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:16.618038 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87a055-4c3d-4da4-9e44-8599db8ac4cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:16.618154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87a055-4c3d-4da4-9e44-8599db8ac4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:16.618900 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87a055-4c3d-4da4-9e44-8599db8ac4cc admin admin] PATH_INFO: `/v3/projects/1f67ba024fe746e48cc30d2803fbf2c8/users/76a9648345304db88a007eb8b604c418/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:16.636323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87a055-4c3d-4da4-9e44-8599db8ac4cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f67ba024fe746e48cc30d2803fbf2c8, user_id=76a9648345304db88a007eb8b604c418, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:16.640547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87a055-4c3d-4da4-9e44-8599db8ac4cc admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:16.717390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1050/2128] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:22:16 2022] PUT /identity/v3/projects/1f67ba024fe746e48cc30d2803fbf2c8/users/76a9648345304db88a007eb8b604c418/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:22:16.727539 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab89a6a-a009-4c24-a17d-8809818d9668 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:16.727836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab89a6a-a009-4c24-a17d-8809818d9668 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:16.728118 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab89a6a-a009-4c24-a17d-8809818d9668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:16.754891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-9ab89a6a-a009-4c24-a17d-8809818d9668 None None] MFA Rules not processed for user `76a9648345304db88a007eb8b604c418`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:16.756406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9ab89a6a-a009-4c24-a17d-8809818d9668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:16.822804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1079/2129] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:16.834777 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87a055-4c3d-4da4-9e44-8599db8ac4cc admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:16.836590 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-de87a055-4c3d-4da4-9e44-8599db8ac4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:16.971737 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87a055-4c3d-4da4-9e44-8599db8ac4cc admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:16.980462 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7b975-c8b1-4203-a395-8bf48be3087a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:16.985280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7b975-c8b1-4203-a395-8bf48be3087a service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:16.985280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7b975-c8b1-4203-a395-8bf48be3087a service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:16.985280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7b975-c8b1-4203-a395-8bf48be3087a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:17.002090 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7b975-c8b1-4203-a395-8bf48be3087a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:17.004299 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7b975-c8b1-4203-a395-8bf48be3087a service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:17.018230 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1051/2130] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:22:16 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:22:28.333769 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab89a6a-a009-4c24-a17d-8809818d9668 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:28.340907 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9ab89a6a-a009-4c24-a17d-8809818d9668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:28.437639 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab89a6a-a009-4c24-a17d-8809818d9668 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:28.444129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7937f0-4f45-464e-8faa-4548e1642fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:28.444997 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7937f0-4f45-464e-8faa-4548e1642fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:28.445331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7937f0-4f45-464e-8faa-4548e1642fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:28.445554 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7937f0-4f45-464e-8faa-4548e1642fbb admin admin] PATH_INFO: `/v3/users/ecec99a61db64e1d95cfdd1fb5ecf154` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:28.446826 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7937f0-4f45-464e-8faa-4548e1642fbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecec99a61db64e1d95cfdd1fb5ecf154)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:28.448788 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7937f0-4f45-464e-8faa-4548e1642fbb admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:28.593002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3d7937f0-4f45-464e-8faa-4548e1642fbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecec99a61db64e1d95cfdd1fb5ecf154'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:28.593655 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3d7937f0-4f45-464e-8faa-4548e1642fbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecec99a61db64e1d95cfdd1fb5ecf154'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:28.594253 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3d7937f0-4f45-464e-8faa-4548e1642fbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecec99a61db64e1d95cfdd1fb5ecf154'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:28.605957 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3d7937f0-4f45-464e-8faa-4548e1642fbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecec99a61db64e1d95cfdd1fb5ecf154'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:28.612949 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3d7937f0-4f45-464e-8faa-4548e1642fbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecec99a61db64e1d95cfdd1fb5ecf154'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:28.683777 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1080/2131] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:22:28 2022] DELETE /identity/v3/users/ecec99a61db64e1d95cfdd1fb5ecf154 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:28.688780 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717eb9c-a5c2-4648-9e60-b72b4faa0c98 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:28.689231 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717eb9c-a5c2-4648-9e60-b72b4faa0c98 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:28.689597 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717eb9c-a5c2-4648-9e60-b72b4faa0c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:28.712916 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-a717eb9c-a5c2-4648-9e60-b72b4faa0c98 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:28.714280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a717eb9c-a5c2-4648-9e60-b72b4faa0c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:28.797194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1052/2132] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:28.808459 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7937f0-4f45-464e-8faa-4548e1642fbb admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:28.810044 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3d7937f0-4f45-464e-8faa-4548e1642fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:28.870119 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7937f0-4f45-464e-8faa-4548e1642fbb admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:28.874958 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14989db3-c4c7-4ffa-8a6c-3e4aa7ca640c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:28.875610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14989db3-c4c7-4ffa-8a6c-3e4aa7ca640c service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:28.875898 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14989db3-c4c7-4ffa-8a6c-3e4aa7ca640c service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:28.876175 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14989db3-c4c7-4ffa-8a6c-3e4aa7ca640c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:28.885578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14989db3-c4c7-4ffa-8a6c-3e4aa7ca640c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:28.887126 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14989db3-c4c7-4ffa-8a6c-3e4aa7ca640c service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:28.898927 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1081/2133] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:22:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:22:29.288681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717eb9c-a5c2-4648-9e60-b72b4faa0c98 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:29.290109 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a717eb9c-a5c2-4648-9e60-b72b4faa0c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:29.302887 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717eb9c-a5c2-4648-9e60-b72b4faa0c98 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:29.307837 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3ce4e-fcb9-4562-9b4c-0665fd077fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:29.308968 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3ce4e-fcb9-4562-9b4c-0665fd077fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:29.310256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3ce4e-fcb9-4562-9b4c-0665fd077fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:29.310770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3ce4e-fcb9-4562-9b4c-0665fd077fd1 admin admin] PATH_INFO: `/v3/projects/c523d90b568341d5a77258406445c6ee` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:29.312473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3ce4e-fcb9-4562-9b4c-0665fd077fd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c523d90b568341d5a77258406445c6ee)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:29.314658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3ce4e-fcb9-4562-9b4c-0665fd077fd1 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:29.408040 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-79a3ce4e-fcb9-4562-9b4c-0665fd077fd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c523d90b568341d5a77258406445c6ee', 'request_id': 'req-79a3ce4e-fcb9-4562-9b4c-0665fd077fd1'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:29.475974 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-79a3ce4e-fcb9-4562-9b4c-0665fd077fd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c523d90b568341d5a77258406445c6ee', 'request_id': 'req-79a3ce4e-fcb9-4562-9b4c-0665fd077fd1'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:29.482718 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-79a3ce4e-fcb9-4562-9b4c-0665fd077fd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c523d90b568341d5a77258406445c6ee', 'request_id': 'req-79a3ce4e-fcb9-4562-9b4c-0665fd077fd1'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:29.493444 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-79a3ce4e-fcb9-4562-9b4c-0665fd077fd1 admin admin] The token cache is being invalidate because project c523d90b568341d5a77258406445c6ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:22:29.493731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-79a3ce4e-fcb9-4562-9b4c-0665fd077fd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:29.494346 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-79a3ce4e-fcb9-4562-9b4c-0665fd077fd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:29.495888 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1053/2134] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:22:29 2022] DELETE /identity/v3/projects/c523d90b568341d5a77258406445c6ee => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:29.500640 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14989db3-c4c7-4ffa-8a6c-3e4aa7ca640c service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:29.510271 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14989db3-c4c7-4ffa-8a6c-3e4aa7ca640c service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:29.564639 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a3154-6eb6-4f84-8bdb-c4f66322bf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:29.565502 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a3154-6eb6-4f84-8bdb-c4f66322bf85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:29.565793 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a3154-6eb6-4f84-8bdb-c4f66322bf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:29.566069 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a3154-6eb6-4f84-8bdb-c4f66322bf85 admin admin] PATH_INFO: `/v3/users/1be53f014a244a938d3ad43082455175` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:29.567279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a3154-6eb6-4f84-8bdb-c4f66322bf85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be53f014a244a938d3ad43082455175)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:29.569230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a3154-6eb6-4f84-8bdb-c4f66322bf85 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:29.696232 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-070a3154-6eb6-4f84-8bdb-c4f66322bf85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be53f014a244a938d3ad43082455175'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:29.696795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-070a3154-6eb6-4f84-8bdb-c4f66322bf85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be53f014a244a938d3ad43082455175'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:29.697387 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-070a3154-6eb6-4f84-8bdb-c4f66322bf85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be53f014a244a938d3ad43082455175'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:29.709011 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-070a3154-6eb6-4f84-8bdb-c4f66322bf85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be53f014a244a938d3ad43082455175'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:29.715507 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-070a3154-6eb6-4f84-8bdb-c4f66322bf85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be53f014a244a938d3ad43082455175'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:29.772487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1082/2135] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:22:29 2022] DELETE /identity/v3/users/1be53f014a244a938d3ad43082455175 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:22:30.209535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3ce4e-fcb9-4562-9b4c-0665fd077fd1 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:30.211021 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-79a3ce4e-fcb9-4562-9b4c-0665fd077fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:30.227417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3ce4e-fcb9-4562-9b4c-0665fd077fd1 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:30.286952 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b639d-a2f1-4082-9fe4-0e76051cf153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:30.287832 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b639d-a2f1-4082-9fe4-0e76051cf153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:30.292745 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b639d-a2f1-4082-9fe4-0e76051cf153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:30.292745 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b639d-a2f1-4082-9fe4-0e76051cf153 admin admin] PATH_INFO: `/v3/projects/b2cf4c229b6648b49bf832f2254eb280` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:30.292745 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b639d-a2f1-4082-9fe4-0e76051cf153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2cf4c229b6648b49bf832f2254eb280)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:30.292745 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b639d-a2f1-4082-9fe4-0e76051cf153 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:30.384453 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6a7b639d-a2f1-4082-9fe4-0e76051cf153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2cf4c229b6648b49bf832f2254eb280', 'request_id': 'req-6a7b639d-a2f1-4082-9fe4-0e76051cf153'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:30.424413 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6a7b639d-a2f1-4082-9fe4-0e76051cf153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2cf4c229b6648b49bf832f2254eb280', 'request_id': 'req-6a7b639d-a2f1-4082-9fe4-0e76051cf153'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:30.429746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6a7b639d-a2f1-4082-9fe4-0e76051cf153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2cf4c229b6648b49bf832f2254eb280', 'request_id': 'req-6a7b639d-a2f1-4082-9fe4-0e76051cf153'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:30.441231 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6a7b639d-a2f1-4082-9fe4-0e76051cf153 admin admin] The token cache is being invalidate because project b2cf4c229b6648b49bf832f2254eb280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:22:30.441518 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6a7b639d-a2f1-4082-9fe4-0e76051cf153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:30.442163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6a7b639d-a2f1-4082-9fe4-0e76051cf153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:30.443885 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1054/2136] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:22:30 2022] DELETE /identity/v3/projects/b2cf4c229b6648b49bf832f2254eb280 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:30.448561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4f1d0-44f8-4973-a1e6-9307aa34d9d5 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:30.448846 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4f1d0-44f8-4973-a1e6-9307aa34d9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:30.449118 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4f1d0-44f8-4973-a1e6-9307aa34d9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:30.468307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-e4b4f1d0-44f8-4973-a1e6-9307aa34d9d5 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:30.469512 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e4b4f1d0-44f8-4973-a1e6-9307aa34d9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:30.526889 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1083/2137] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:30.534573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6f92c-ed3b-40ff-9103-fdeec1a3b51f None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:30.534871 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6f92c-ed3b-40ff-9103-fdeec1a3b51f None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:30.535148 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6f92c-ed3b-40ff-9103-fdeec1a3b51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:30.552758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-56d6f92c-ed3b-40ff-9103-fdeec1a3b51f None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:30.553941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-56d6f92c-ed3b-40ff-9103-fdeec1a3b51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:30.562653 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1055/2138] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:30.566611 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4f1d0-44f8-4973-a1e6-9307aa34d9d5 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:30.576905 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4f1d0-44f8-4973-a1e6-9307aa34d9d5 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:30.581426 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab37fa-a785-448f-81da-b210be0fd602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:30.582064 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab37fa-a785-448f-81da-b210be0fd602 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:30.582348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab37fa-a785-448f-81da-b210be0fd602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:30.582655 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab37fa-a785-448f-81da-b210be0fd602 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:30.583376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab37fa-a785-448f-81da-b210be0fd602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:22:30.583680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab37fa-a785-448f-81da-b210be0fd602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:30.585242 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab37fa-a785-448f-81da-b210be0fd602 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:30.596558 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1084/2139] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:22:30.600500 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6f92c-ed3b-40ff-9103-fdeec1a3b51f None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:30.610365 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6f92c-ed3b-40ff-9103-fdeec1a3b51f None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:30.615333 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bff84-744f-4e7d-9fc6-fbe41b176a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:30.615977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bff84-744f-4e7d-9fc6-fbe41b176a09 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:30.616263 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bff84-744f-4e7d-9fc6-fbe41b176a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:30.616543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bff84-744f-4e7d-9fc6-fbe41b176a09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:30.617231 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1bff84-744f-4e7d-9fc6-fbe41b176a09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:30.619169 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1bff84-744f-4e7d-9fc6-fbe41b176a09 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:30.706057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1056/2140] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:22:30 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:22:30.710213 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab37fa-a785-448f-81da-b210be0fd602 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:30.720436 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab37fa-a785-448f-81da-b210be0fd602 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:30.775041 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abb6df-128f-45cb-a9eb-fa5712e34a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:30.775716 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abb6df-128f-45cb-a9eb-fa5712e34a64 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:30.775980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abb6df-128f-45cb-a9eb-fa5712e34a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:30.776252 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abb6df-128f-45cb-a9eb-fa5712e34a64 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:30.776942 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abb6df-128f-45cb-a9eb-fa5712e34a64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:30.778873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abb6df-128f-45cb-a9eb-fa5712e34a64 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:30.864941 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1085/2141] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:22:30 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:22:30.868976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bff84-744f-4e7d-9fc6-fbe41b176a09 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:30.879940 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bff84-744f-4e7d-9fc6-fbe41b176a09 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:30.884793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35059f9f-8a72-4bbd-be46-cdfee6bebc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:30.885445 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35059f9f-8a72-4bbd-be46-cdfee6bebc59 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:30.885725 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35059f9f-8a72-4bbd-be46-cdfee6bebc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:30.886001 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35059f9f-8a72-4bbd-be46-cdfee6bebc59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:30.886760 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35059f9f-8a72-4bbd-be46-cdfee6bebc59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:30.888483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35059f9f-8a72-4bbd-be46-cdfee6bebc59 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:30.898457 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1057/2142] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:22:30.902215 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abb6df-128f-45cb-a9eb-fa5712e34a64 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:30.911963 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abb6df-128f-45cb-a9eb-fa5712e34a64 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:30.916538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa1f64-bfff-4139-aa5a-b4585fb4d2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:30.917185 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa1f64-bfff-4139-aa5a-b4585fb4d2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:30.917469 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa1f64-bfff-4139-aa5a-b4585fb4d2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:30.917744 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa1f64-bfff-4139-aa5a-b4585fb4d2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:30.918501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa1f64-bfff-4139-aa5a-b4585fb4d2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:30.920622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa1f64-bfff-4139-aa5a-b4585fb4d2e6 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:30.930181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1086/2143] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:22:30.934318 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35059f9f-8a72-4bbd-be46-cdfee6bebc59 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:30.945169 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35059f9f-8a72-4bbd-be46-cdfee6bebc59 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:30.949698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf0f4f-767c-4d00-a79b-8a74d1a17aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:30.950632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf0f4f-767c-4d00-a79b-8a74d1a17aee admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:30.951442 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf0f4f-767c-4d00-a79b-8a74d1a17aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:30.951726 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf0f4f-767c-4d00-a79b-8a74d1a17aee admin admin] PATH_INFO: `/v3/projects/a7ee8b5d1af04607ba2264d0454aeffa/users/d6c58d10954f444d8953a0ea27eec1c2/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:30.965612 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf0f4f-767c-4d00-a79b-8a74d1a17aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ee8b5d1af04607ba2264d0454aeffa, user_id=d6c58d10954f444d8953a0ea27eec1c2, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:30.968654 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf0f4f-767c-4d00-a79b-8a74d1a17aee admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:31.036156 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1058/2144] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:22:30 2022] PUT /identity/v3/projects/a7ee8b5d1af04607ba2264d0454aeffa/users/d6c58d10954f444d8953a0ea27eec1c2/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:31.048475 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a37ba-6991-42ec-8fc2-5be3addc36b9 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:31.048768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a37ba-6991-42ec-8fc2-5be3addc36b9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:31.049043 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a37ba-6991-42ec-8fc2-5be3addc36b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:31.078293 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-850a37ba-6991-42ec-8fc2-5be3addc36b9 None None] MFA Rules not processed for user `d6c58d10954f444d8953a0ea27eec1c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:31.079893 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-850a37ba-6991-42ec-8fc2-5be3addc36b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:31.153415 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1087/2145] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:31.157284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf0f4f-767c-4d00-a79b-8a74d1a17aee admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:31.233356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf0f4f-767c-4d00-a79b-8a74d1a17aee admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:31.237964 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b67a6-6ad7-4482-a44e-d7d56707e4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:31.238648 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b67a6-6ad7-4482-a44e-d7d56707e4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:31.238929 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b67a6-6ad7-4482-a44e-d7d56707e4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:31.239202 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b67a6-6ad7-4482-a44e-d7d56707e4d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:31.239887 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b67a6-6ad7-4482-a44e-d7d56707e4d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:31.241785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b67a6-6ad7-4482-a44e-d7d56707e4d1 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:31.340429 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1059/2146] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:22:31 2022] POST /identity/v3/projects => generated 369 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:22:31.350782 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a37ba-6991-42ec-8fc2-5be3addc36b9 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:31.362072 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a37ba-6991-42ec-8fc2-5be3addc36b9 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:31.417198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa73b9-138b-4812-846d-f8c607a32a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:31.417868 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa73b9-138b-4812-846d-f8c607a32a6e admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:31.418170 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa73b9-138b-4812-846d-f8c607a32a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:31.418506 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa73b9-138b-4812-846d-f8c607a32a6e admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:31.419212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa73b9-138b-4812-846d-f8c607a32a6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:31.421183 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa73b9-138b-4812-846d-f8c607a32a6e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:31.608047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1088/2147] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:22:31 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:22:31.612096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b67a6-6ad7-4482-a44e-d7d56707e4d1 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:31.622180 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b67a6-6ad7-4482-a44e-d7d56707e4d1 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:31.626755 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48509de7-b65e-4c95-af02-7094873bdbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:31.627415 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48509de7-b65e-4c95-af02-7094873bdbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:31.627702 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48509de7-b65e-4c95-af02-7094873bdbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:31.627979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48509de7-b65e-4c95-af02-7094873bdbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:31.628823 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48509de7-b65e-4c95-af02-7094873bdbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:31.630626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48509de7-b65e-4c95-af02-7094873bdbd1 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:31.641453 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1060/2148] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:22:31.645558 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa73b9-138b-4812-846d-f8c607a32a6e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:31.655912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa73b9-138b-4812-846d-f8c607a32a6e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:31.660569 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5a131-f022-47c4-bdc8-efac5c7b6cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:31.661443 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5a131-f022-47c4-bdc8-efac5c7b6cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:31.661750 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5a131-f022-47c4-bdc8-efac5c7b6cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:31.662028 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5a131-f022-47c4-bdc8-efac5c7b6cbf admin admin] PATH_INFO: `/v3/projects/1d335dec1412499c8715b2009f65d4d2/users/902254cefa4240c8a5a923a06ae49b58/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:31.676512 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5a131-f022-47c4-bdc8-efac5c7b6cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d335dec1412499c8715b2009f65d4d2, user_id=902254cefa4240c8a5a923a06ae49b58, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:31.679214 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5a131-f022-47c4-bdc8-efac5c7b6cbf admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:31.749919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1089/2149] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:22:31 2022] PUT /identity/v3/projects/1d335dec1412499c8715b2009f65d4d2/users/902254cefa4240c8a5a923a06ae49b58/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:31.753924 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48509de7-b65e-4c95-af02-7094873bdbd1 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:31.764949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48509de7-b65e-4c95-af02-7094873bdbd1 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:31.821600 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e1c84-9ae0-43bb-b153-48ce3c269cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:31.822270 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e1c84-9ae0-43bb-b153-48ce3c269cbd admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:31.822601 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e1c84-9ae0-43bb-b153-48ce3c269cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:31.822880 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e1c84-9ae0-43bb-b153-48ce3c269cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:31.823606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e1c84-9ae0-43bb-b153-48ce3c269cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:31.825194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e1c84-9ae0-43bb-b153-48ce3c269cbd admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:31.834793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1061/2150] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:22:31.838980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5a131-f022-47c4-bdc8-efac5c7b6cbf admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:31.849815 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5a131-f022-47c4-bdc8-efac5c7b6cbf admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:31.854693 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41747c-456a-43a1-bb50-3d5bdc1c2e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:31.855572 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41747c-456a-43a1-bb50-3d5bdc1c2e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:31.855854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41747c-456a-43a1-bb50-3d5bdc1c2e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:31.856337 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41747c-456a-43a1-bb50-3d5bdc1c2e41 admin admin] PATH_INFO: `/v3/projects/1d335dec1412499c8715b2009f65d4d2/users/902254cefa4240c8a5a923a06ae49b58/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:31.858981 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41747c-456a-43a1-bb50-3d5bdc1c2e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d335dec1412499c8715b2009f65d4d2, user_id=902254cefa4240c8a5a923a06ae49b58, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:31.861680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41747c-456a-43a1-bb50-3d5bdc1c2e41 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:31.872000 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1090/2151] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:22:31 2022] PUT /identity/v3/projects/1d335dec1412499c8715b2009f65d4d2/users/902254cefa4240c8a5a923a06ae49b58/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:31.882943 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deca129-e369-4f1b-b4ea-3b1f37e903d3 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:31.883261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deca129-e369-4f1b-b4ea-3b1f37e903d3 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:31.883546 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deca129-e369-4f1b-b4ea-3b1f37e903d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:31.910649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-5deca129-e369-4f1b-b4ea-3b1f37e903d3 None None] MFA Rules not processed for user `902254cefa4240c8a5a923a06ae49b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:31.911897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-5deca129-e369-4f1b-b4ea-3b1f37e903d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:31.977860 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1062/2152] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:31 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:31.989425 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41747c-456a-43a1-bb50-3d5bdc1c2e41 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:31.994944 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6c41747c-456a-43a1-bb50-3d5bdc1c2e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:32.067424 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41747c-456a-43a1-bb50-3d5bdc1c2e41 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:32.070982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a7099-688d-45d6-93a4-37d2846ca5ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:32.071618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a7099-688d-45d6-93a4-37d2846ca5ca service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:32.071906 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a7099-688d-45d6-93a4-37d2846ca5ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:32.072182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a7099-688d-45d6-93a4-37d2846ca5ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:32.082108 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a7099-688d-45d6-93a4-37d2846ca5ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:32.083578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a7099-688d-45d6-93a4-37d2846ca5ca service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:32.093135 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1091/2153] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:22:31 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:22:34.659023 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb95189-05f5-4378-a086-046e0634b6d3 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:34.660059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb95189-05f5-4378-a086-046e0634b6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:34.660415 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb95189-05f5-4378-a086-046e0634b6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:34.679446 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-5cb95189-05f5-4378-a086-046e0634b6d3 None None] MFA Rules not processed for user `02af0eded57547f489be63cd6dc09399`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:34.680895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-5cb95189-05f5-4378-a086-046e0634b6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:34.743500 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1063/2154] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:22:35.888908 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a7099-688d-45d6-93a4-37d2846ca5ca service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:35.921783 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef960ad-2e86-4e2c-bdc9-4a9c8322c084 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:35.922245 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef960ad-2e86-4e2c-bdc9-4a9c8322c084 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:35.922580 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef960ad-2e86-4e2c-bdc9-4a9c8322c084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:35.951932 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-1ef960ad-2e86-4e2c-bdc9-4a9c8322c084 None None] MFA Rules not processed for user `c0fc3052af194b48b7ce036ff605ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:35.953068 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-1ef960ad-2e86-4e2c-bdc9-4a9c8322c084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:35.960155 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a7099-688d-45d6-93a4-37d2846ca5ca service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:35.965327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dea6a-e274-4abb-9146-a751f204253c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:35.967217 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dea6a-e274-4abb-9146-a751f204253c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:35.967503 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dea6a-e274-4abb-9146-a751f204253c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:35.967781 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dea6a-e274-4abb-9146-a751f204253c admin admin] PATH_INFO: `/v3/users/d6c58d10954f444d8953a0ea27eec1c2` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:35.969147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9dea6a-e274-4abb-9146-a751f204253c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6c58d10954f444d8953a0ea27eec1c2)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:35.972197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9dea6a-e274-4abb-9146-a751f204253c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:36.029322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1064/2155] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 10 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:22:36.031413 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453bfda-0065-46e7-87e4-52ca4df44df3 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:36.031712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453bfda-0065-46e7-87e4-52ca4df44df3 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:36.031992 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453bfda-0065-46e7-87e4-52ca4df44df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:36.056612 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-b453bfda-0065-46e7-87e4-52ca4df44df3 None None] MFA Rules not processed for user `c0fc3052af194b48b7ce036ff605ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:36.067610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-b453bfda-0065-46e7-87e4-52ca4df44df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:36.083005 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1065/2156] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 10 21:22:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:36.088451 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453bfda-0065-46e7-87e4-52ca4df44df3 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:36.089897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-b453bfda-0065-46e7-87e4-52ca4df44df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:36.142233 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-0f9dea6a-e274-4abb-9146-a751f204253c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6c58d10954f444d8953a0ea27eec1c2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:36.142919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-0f9dea6a-e274-4abb-9146-a751f204253c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6c58d10954f444d8953a0ea27eec1c2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:36.143710 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-0f9dea6a-e274-4abb-9146-a751f204253c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6c58d10954f444d8953a0ea27eec1c2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:36.157294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-0f9dea6a-e274-4abb-9146-a751f204253c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6c58d10954f444d8953a0ea27eec1c2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:36.166290 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-0f9dea6a-e274-4abb-9146-a751f204253c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6c58d10954f444d8953a0ea27eec1c2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:36.169131 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453bfda-0065-46e7-87e4-52ca4df44df3 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:36.175870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c94c3-3951-45bd-8c2b-681937b966c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76040882d4374087bb7458fd8b5c1d8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:36.176814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c94c3-3951-45bd-8c2b-681937b966c3 service swift] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:36.177097 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c94c3-3951-45bd-8c2b-681937b966c3 service swift] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:36.177712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c94c3-3951-45bd-8c2b-681937b966c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:36.179652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-1d8c94c3-3951-45bd-8c2b-681937b966c3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:36.195476 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c94c3-3951-45bd-8c2b-681937b966c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:36.197103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c94c3-3951-45bd-8c2b-681937b966c3 service swift] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:36.206129 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1066/2157] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 10 21:22:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 21:22:36.206917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c94c3-3951-45bd-8c2b-681937b966c3 service swift] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:36.208311 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-1d8c94c3-3951-45bd-8c2b-681937b966c3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:36.221222 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c94c3-3951-45bd-8c2b-681937b966c3 service swift] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:36.226797 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1092/2158] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:22:35 2022] DELETE /identity/v3/users/d6c58d10954f444d8953a0ea27eec1c2 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:36.227446 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3b40a-e1fa-4fc7-919a-ff7aad6bd545 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76040882d4374087bb7458fd8b5c1d8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:36.228246 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3b40a-e1fa-4fc7-919a-ff7aad6bd545 service swift] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:36.228534 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3b40a-e1fa-4fc7-919a-ff7aad6bd545 service swift] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:36.228815 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3b40a-e1fa-4fc7-919a-ff7aad6bd545 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:36.229765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571721e6-44ac-4361-8aec-84a93d37269c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:36.230125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571721e6-44ac-4361-8aec-84a93d37269c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:36.230493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571721e6-44ac-4361-8aec-84a93d37269c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:36.232600 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-fea3b40a-e1fa-4fc7-919a-ff7aad6bd545 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:36.263333 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3b40a-e1fa-4fc7-919a-ff7aad6bd545 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:36.263576 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-571721e6-44ac-4361-8aec-84a93d37269c None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:36.264703 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-571721e6-44ac-4361-8aec-84a93d37269c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:36.265499 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3b40a-e1fa-4fc7-919a-ff7aad6bd545 service swift] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:36.295512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1067/2159] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 10 21:22:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 21:22:36.352255 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1093/2160] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:36.353377 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3b40a-e1fa-4fc7-919a-ff7aad6bd545 service swift] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:36.355187 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-fea3b40a-e1fa-4fc7-919a-ff7aad6bd545 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:36.447374 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3b40a-e1fa-4fc7-919a-ff7aad6bd545 service swift] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:36.535436 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8e3a0-d6c4-4c87-8b5a-8b7de098bb64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:36.536065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8e3a0-d6c4-4c87-8b5a-8b7de098bb64 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:36.536525 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8e3a0-d6c4-4c87-8b5a-8b7de098bb64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:36.537026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8e3a0-d6c4-4c87-8b5a-8b7de098bb64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:36.554023 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8e3a0-d6c4-4c87-8b5a-8b7de098bb64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:36.556981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8e3a0-d6c4-4c87-8b5a-8b7de098bb64 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:36.570499 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1068/2161] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:22:37.172453 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571721e6-44ac-4361-8aec-84a93d37269c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:37.174933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-571721e6-44ac-4361-8aec-84a93d37269c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:37.192087 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571721e6-44ac-4361-8aec-84a93d37269c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:37.199505 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e1bed-ae89-4858-98e2-28284fd31423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:37.201313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e1bed-ae89-4858-98e2-28284fd31423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:37.203662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e1bed-ae89-4858-98e2-28284fd31423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:37.203662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e1bed-ae89-4858-98e2-28284fd31423 admin admin] PATH_INFO: `/v3/projects/a7ee8b5d1af04607ba2264d0454aeffa` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:37.204419 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e1bed-ae89-4858-98e2-28284fd31423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ee8b5d1af04607ba2264d0454aeffa)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:37.206619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e1bed-ae89-4858-98e2-28284fd31423 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:37.538128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-528e1bed-ae89-4858-98e2-28284fd31423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ee8b5d1af04607ba2264d0454aeffa', 'request_id': 'req-528e1bed-ae89-4858-98e2-28284fd31423'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:37.599127 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867ecc8-f89b-40a0-8962-04f529bcb51f None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:37.599653 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867ecc8-f89b-40a0-8962-04f529bcb51f None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:37.599752 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867ecc8-f89b-40a0-8962-04f529bcb51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:37.609611 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-528e1bed-ae89-4858-98e2-28284fd31423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ee8b5d1af04607ba2264d0454aeffa', 'request_id': 'req-528e1bed-ae89-4858-98e2-28284fd31423'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:37.620151 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-528e1bed-ae89-4858-98e2-28284fd31423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ee8b5d1af04607ba2264d0454aeffa', 'request_id': 'req-528e1bed-ae89-4858-98e2-28284fd31423'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:37.625450 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-4867ecc8-f89b-40a0-8962-04f529bcb51f None None] MFA Rules not processed for user `c0fc3052af194b48b7ce036ff605ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:37.626706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4867ecc8-f89b-40a0-8962-04f529bcb51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:37.644897 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-528e1bed-ae89-4858-98e2-28284fd31423 admin admin] The token cache is being invalidate because project a7ee8b5d1af04607ba2264d0454aeffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:22:37.645226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-528e1bed-ae89-4858-98e2-28284fd31423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:37.645900 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-528e1bed-ae89-4858-98e2-28284fd31423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:37.647970 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1094/2162] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:22:37 2022] DELETE /identity/v3/projects/a7ee8b5d1af04607ba2264d0454aeffa => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:37.652315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e1bed-ae89-4858-98e2-28284fd31423 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:37.655197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-528e1bed-ae89-4858-98e2-28284fd31423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:37.702755 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1069/2163] 10.222.0.25 () {58 vars in 967 bytes} [Tue May 10 21:22:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:22:37.727106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867ecc8-f89b-40a0-8962-04f529bcb51f None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:37.728409 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4867ecc8-f89b-40a0-8962-04f529bcb51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:37.740109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e1bed-ae89-4858-98e2-28284fd31423 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:37.746760 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef172c-a918-424d-bd9b-764a688a77ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:37.748019 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef172c-a918-424d-bd9b-764a688a77ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:37.748376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef172c-a918-424d-bd9b-764a688a77ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:37.748747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef172c-a918-424d-bd9b-764a688a77ff admin admin] PATH_INFO: `/v3/users/902254cefa4240c8a5a923a06ae49b58` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:37.750060 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef172c-a918-424d-bd9b-764a688a77ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=902254cefa4240c8a5a923a06ae49b58)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:37.753215 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef172c-a918-424d-bd9b-764a688a77ff admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:37.833364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867ecc8-f89b-40a0-8962-04f529bcb51f None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:37.856637 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0220693-42ff-4276-b203-b79760b5a377 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76040882d4374087bb7458fd8b5c1d8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:37.857292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0220693-42ff-4276-b203-b79760b5a377 service swift] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:37.859840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0220693-42ff-4276-b203-b79760b5a377 service swift] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:37.860133 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0220693-42ff-4276-b203-b79760b5a377 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:37.871951 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0220693-42ff-4276-b203-b79760b5a377 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:37.874268 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0220693-42ff-4276-b203-b79760b5a377 service swift] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:37.884735 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1070/2164] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 10 21:22:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 21:22:37.929601 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-c6ef172c-a918-424d-bd9b-764a688a77ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '902254cefa4240c8a5a923a06ae49b58'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:37.930411 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-c6ef172c-a918-424d-bd9b-764a688a77ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '902254cefa4240c8a5a923a06ae49b58'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:37.931120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-c6ef172c-a918-424d-bd9b-764a688a77ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '902254cefa4240c8a5a923a06ae49b58'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:37.958393 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-c6ef172c-a918-424d-bd9b-764a688a77ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '902254cefa4240c8a5a923a06ae49b58'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:37.980339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-c6ef172c-a918-424d-bd9b-764a688a77ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '902254cefa4240c8a5a923a06ae49b58'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:38.203311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1095/2165] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:22:37 2022] DELETE /identity/v3/users/902254cefa4240c8a5a923a06ae49b58 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:38.891556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0220693-42ff-4276-b203-b79760b5a377 service swift] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:38.907985 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0220693-42ff-4276-b203-b79760b5a377 service swift] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:38.993782 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d0417-3895-4e9f-a614-0ecfb5a1b9c9 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:38.994589 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d0417-3895-4e9f-a614-0ecfb5a1b9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:38.995264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d0417-3895-4e9f-a614-0ecfb5a1b9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:39.019614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df716478-c34b-4ef9-90c3-6f0a5e58030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:39.020159 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df716478-c34b-4ef9-90c3-6f0a5e58030f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:39.020583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df716478-c34b-4ef9-90c3-6f0a5e58030f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:39.020868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df716478-c34b-4ef9-90c3-6f0a5e58030f admin admin] PATH_INFO: `/v3/projects/1d335dec1412499c8715b2009f65d4d2` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:39.022756 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df716478-c34b-4ef9-90c3-6f0a5e58030f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d335dec1412499c8715b2009f65d4d2)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:39.024384 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df716478-c34b-4ef9-90c3-6f0a5e58030f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:39.050252 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-0f4d0417-3895-4e9f-a614-0ecfb5a1b9c9 None None] MFA Rules not processed for user `c0fc3052af194b48b7ce036ff605ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:39.052320 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0f4d0417-3895-4e9f-a614-0ecfb5a1b9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:39.136675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1096/2166] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 10 21:22:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:22:39.159992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d0417-3895-4e9f-a614-0ecfb5a1b9c9 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:39.161872 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0f4d0417-3895-4e9f-a614-0ecfb5a1b9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:39.202342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-df716478-c34b-4ef9-90c3-6f0a5e58030f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d335dec1412499c8715b2009f65d4d2', 'request_id': 'req-df716478-c34b-4ef9-90c3-6f0a5e58030f'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:39.292941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-df716478-c34b-4ef9-90c3-6f0a5e58030f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d335dec1412499c8715b2009f65d4d2', 'request_id': 'req-df716478-c34b-4ef9-90c3-6f0a5e58030f'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:39.300097 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-df716478-c34b-4ef9-90c3-6f0a5e58030f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d335dec1412499c8715b2009f65d4d2', 'request_id': 'req-df716478-c34b-4ef9-90c3-6f0a5e58030f'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:39.320490 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-df716478-c34b-4ef9-90c3-6f0a5e58030f admin admin] The token cache is being invalidate because project 1d335dec1412499c8715b2009f65d4d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:22:39.320490 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-df716478-c34b-4ef9-90c3-6f0a5e58030f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:39.321531 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-df716478-c34b-4ef9-90c3-6f0a5e58030f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:39.323817 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1071/2167] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:22:38 2022] DELETE /identity/v3/projects/1d335dec1412499c8715b2009f65d4d2 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:39.331179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e5dc3-c864-44d6-985a-feecf606a6c2 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:39.332062 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e5dc3-c864-44d6-985a-feecf606a6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:39.332910 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e5dc3-c864-44d6-985a-feecf606a6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:39.356294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d0417-3895-4e9f-a614-0ecfb5a1b9c9 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:39.366239 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-8c4e5dc3-c864-44d6-985a-feecf606a6c2 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:39.367539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-8c4e5dc3-c864-44d6-985a-feecf606a6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:39.448001 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1072/2168] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:39.451073 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d553aac-a13a-4566-808f-4215f1bf3dcd None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:39.451073 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d553aac-a13a-4566-808f-4215f1bf3dcd None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:39.451073 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d553aac-a13a-4566-808f-4215f1bf3dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:39.472393 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9b382-4187-4aa9-804e-6e01a601ab14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76040882d4374087bb7458fd8b5c1d8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:39.473433 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b382-4187-4aa9-804e-6e01a601ab14 service swift] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:39.474088 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b382-4187-4aa9-804e-6e01a601ab14 service swift] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:39.475109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b382-4187-4aa9-804e-6e01a601ab14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:39.479824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b0d9b382-4187-4aa9-804e-6e01a601ab14 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:39.490308 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-4d553aac-a13a-4566-808f-4215f1bf3dcd None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:39.491666 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4d553aac-a13a-4566-808f-4215f1bf3dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:39.517805 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1073/2169] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:39.518925 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d553aac-a13a-4566-808f-4215f1bf3dcd None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:39.548078 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d553aac-a13a-4566-808f-4215f1bf3dcd None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:39.555432 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a9f2e-b7e0-409e-8ef9-ed4e992ed4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:39.556117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a9f2e-b7e0-409e-8ef9-ed4e992ed4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:39.556404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a9f2e-b7e0-409e-8ef9-ed4e992ed4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:39.557386 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a9f2e-b7e0-409e-8ef9-ed4e992ed4c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:39.558140 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a9f2e-b7e0-409e-8ef9-ed4e992ed4c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:22:39.558470 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a9f2e-b7e0-409e-8ef9-ed4e992ed4c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:39.561019 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a9f2e-b7e0-409e-8ef9-ed4e992ed4c9 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:39.586173 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1074/2170] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:22:39.589867 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a9f2e-b7e0-409e-8ef9-ed4e992ed4c9 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:39.603070 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9b382-4187-4aa9-804e-6e01a601ab14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:39.607986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9b382-4187-4aa9-804e-6e01a601ab14 service swift] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:39.613700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a9f2e-b7e0-409e-8ef9-ed4e992ed4c9 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:39.627328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1097/2171] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 10 21:22:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 21:22:39.628869 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d38b6-0c50-429f-91fb-48e937f08e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:39.630547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d38b6-0c50-429f-91fb-48e937f08e9a admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:39.630547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d38b6-0c50-429f-91fb-48e937f08e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:39.630547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d38b6-0c50-429f-91fb-48e937f08e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:39.631524 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d38b6-0c50-429f-91fb-48e937f08e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:39.633618 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d38b6-0c50-429f-91fb-48e937f08e9a admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:39.735477 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1075/2172] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:22:39 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:22:39.739832 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9b382-4187-4aa9-804e-6e01a601ab14 service swift] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:39.752390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9b382-4187-4aa9-804e-6e01a601ab14 service swift] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:39.908707 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831648bc-1933-4d28-a751-a1f15902045b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:39.908707 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831648bc-1933-4d28-a751-a1f15902045b admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:39.908707 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831648bc-1933-4d28-a751-a1f15902045b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:39.908707 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831648bc-1933-4d28-a751-a1f15902045b admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:39.909721 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831648bc-1933-4d28-a751-a1f15902045b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:39.909721 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831648bc-1933-4d28-a751-a1f15902045b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:40.055146 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1098/2173] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:22:39 2022] POST /identity/v3/users => generated 293 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:22:40.061210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d38b6-0c50-429f-91fb-48e937f08e9a admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:40.075198 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d38b6-0c50-429f-91fb-48e937f08e9a admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:40.082418 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b7ec6-5935-4ae2-9f1e-5f71cb18f676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:40.086780 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b7ec6-5935-4ae2-9f1e-5f71cb18f676 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:40.086780 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b7ec6-5935-4ae2-9f1e-5f71cb18f676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:40.086780 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b7ec6-5935-4ae2-9f1e-5f71cb18f676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:40.086780 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b7ec6-5935-4ae2-9f1e-5f71cb18f676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:40.086780 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b7ec6-5935-4ae2-9f1e-5f71cb18f676 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:40.098125 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1076/2174] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:22:40.102068 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831648bc-1933-4d28-a751-a1f15902045b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:40.113874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831648bc-1933-4d28-a751-a1f15902045b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:40.127492 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22f568-5d99-4b06-a1d9-648ade3b69a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:40.128252 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22f568-5d99-4b06-a1d9-648ade3b69a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:40.128541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22f568-5d99-4b06-a1d9-648ade3b69a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:40.128823 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22f568-5d99-4b06-a1d9-648ade3b69a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:40.129621 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22f568-5d99-4b06-a1d9-648ade3b69a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:40.144741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22f568-5d99-4b06-a1d9-648ade3b69a7 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:40.165290 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1099/2175] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:22:40.166613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b7ec6-5935-4ae2-9f1e-5f71cb18f676 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:40.225175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b7ec6-5935-4ae2-9f1e-5f71cb18f676 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:40.225175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1976c1e-73e5-45f1-b9bb-1999bab49511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:40.225175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1976c1e-73e5-45f1-b9bb-1999bab49511 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:40.225175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1976c1e-73e5-45f1-b9bb-1999bab49511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:40.226611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1976c1e-73e5-45f1-b9bb-1999bab49511 admin admin] PATH_INFO: `/v3/projects/26a842b57d0346bea53e7ed3b42079f1/users/e226bd00be29468e8a5dd3b34c239c5a/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:40.226611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1976c1e-73e5-45f1-b9bb-1999bab49511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a842b57d0346bea53e7ed3b42079f1, user_id=e226bd00be29468e8a5dd3b34c239c5a, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:40.226611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1976c1e-73e5-45f1-b9bb-1999bab49511 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:40.583729 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1077/2176] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:22:40 2022] PUT /identity/v3/projects/26a842b57d0346bea53e7ed3b42079f1/users/e226bd00be29468e8a5dd3b34c239c5a/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:40.596630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde1858-3fcd-4ba3-9f3b-e8b44e9ba6b8 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:40.597235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde1858-3fcd-4ba3-9f3b-e8b44e9ba6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:40.597404 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde1858-3fcd-4ba3-9f3b-e8b44e9ba6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:40.677346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-1cde1858-3fcd-4ba3-9f3b-e8b44e9ba6b8 None None] MFA Rules not processed for user `e226bd00be29468e8a5dd3b34c239c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:40.681094 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1cde1858-3fcd-4ba3-9f3b-e8b44e9ba6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:40.873955 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1100/2177] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:40.875431 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1976c1e-73e5-45f1-b9bb-1999bab49511 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:40.991592 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1976c1e-73e5-45f1-b9bb-1999bab49511 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:40.999028 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075395cb-2753-42ef-a97b-b57e7192d042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:40.999714 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075395cb-2753-42ef-a97b-b57e7192d042 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:41.000141 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075395cb-2753-42ef-a97b-b57e7192d042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:41.000256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075395cb-2753-42ef-a97b-b57e7192d042 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:41.001304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075395cb-2753-42ef-a97b-b57e7192d042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:41.003465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075395cb-2753-42ef-a97b-b57e7192d042 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:41.151006 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1078/2178] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:22:40 2022] POST /identity/v3/projects => generated 385 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:22:41.155671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde1858-3fcd-4ba3-9f3b-e8b44e9ba6b8 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:41.188536 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde1858-3fcd-4ba3-9f3b-e8b44e9ba6b8 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:41.401913 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa0abd-b3a8-4a43-a096-616e4c85b0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:41.402641 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa0abd-b3a8-4a43-a096-616e4c85b0cc admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:41.405456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa0abd-b3a8-4a43-a096-616e4c85b0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:41.405771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa0abd-b3a8-4a43-a096-616e4c85b0cc admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:41.407818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa0abd-b3a8-4a43-a096-616e4c85b0cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:41.411058 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa0abd-b3a8-4a43-a096-616e4c85b0cc admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:41.461417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d76618-e35b-462b-969a-8fad8711ecf2 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:41.463274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d76618-e35b-462b-969a-8fad8711ecf2 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:41.463774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d76618-e35b-462b-969a-8fad8711ecf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:41.490673 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-72d76618-e35b-462b-969a-8fad8711ecf2 None None] MFA Rules not processed for user `c0fc3052af194b48b7ce036ff605ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:41.492258 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-72d76618-e35b-462b-969a-8fad8711ecf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:41.565331 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1101/2179] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:22:41 2022] POST /identity/v3/users => generated 299 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:22:41.568256 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa0abd-b3a8-4a43-a096-616e4c85b0cc admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:41.588492 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa0abd-b3a8-4a43-a096-616e4c85b0cc admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:41.604025 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36584e8-3fd7-4358-a10c-e60e645cf848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:41.604823 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36584e8-3fd7-4358-a10c-e60e645cf848 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:41.605284 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36584e8-3fd7-4358-a10c-e60e645cf848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:41.605938 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36584e8-3fd7-4358-a10c-e60e645cf848 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:41.606947 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36584e8-3fd7-4358-a10c-e60e645cf848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:41.609063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36584e8-3fd7-4358-a10c-e60e645cf848 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:41.617776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1079/2180] 10.222.0.25 () {58 vars in 967 bytes} [Tue May 10 21:22:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:22:41.633696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d76618-e35b-462b-969a-8fad8711ecf2 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:41.636221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1102/2181] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:22:41.637342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-72d76618-e35b-462b-969a-8fad8711ecf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:41.644257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36584e8-3fd7-4358-a10c-e60e645cf848 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:41.663578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36584e8-3fd7-4358-a10c-e60e645cf848 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:41.675993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890eff4-a2e1-476a-8720-1a5b7aadf581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:41.677244 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890eff4-a2e1-476a-8720-1a5b7aadf581 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:41.677687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890eff4-a2e1-476a-8720-1a5b7aadf581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:41.678099 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890eff4-a2e1-476a-8720-1a5b7aadf581 admin admin] PATH_INFO: `/v3/projects/6fcd2a15d72b4d4eabfd5de82b084178/users/001b0ae21c9c4086b55c100c68b1c201/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:41.715812 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890eff4-a2e1-476a-8720-1a5b7aadf581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fcd2a15d72b4d4eabfd5de82b084178, user_id=001b0ae21c9c4086b55c100c68b1c201, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:41.720498 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890eff4-a2e1-476a-8720-1a5b7aadf581 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:41.751507 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d76618-e35b-462b-969a-8fad8711ecf2 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:41.772042 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeb82d-ffab-4a40-a186-fbd205973d9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76040882d4374087bb7458fd8b5c1d8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:41.772713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb82d-ffab-4a40-a186-fbd205973d9a service swift] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:41.773077 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb82d-ffab-4a40-a186-fbd205973d9a service swift] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:41.773571 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb82d-ffab-4a40-a186-fbd205973d9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:41.786190 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaeb82d-ffab-4a40-a186-fbd205973d9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:41.788798 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaeb82d-ffab-4a40-a186-fbd205973d9a service swift] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:41.820430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1080/2182] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 10 21:22:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 21:22:41.851168 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1103/2183] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:22:41 2022] PUT /identity/v3/projects/6fcd2a15d72b4d4eabfd5de82b084178/users/001b0ae21c9c4086b55c100c68b1c201/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:41.855548 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeb82d-ffab-4a40-a186-fbd205973d9a service swift] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:41.872992 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeb82d-ffab-4a40-a186-fbd205973d9a service swift] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:42.003210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea874dc-813e-422b-b99f-cec16cdd6504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:42.005716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea874dc-813e-422b-b99f-cec16cdd6504 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:42.005716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea874dc-813e-422b-b99f-cec16cdd6504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:42.005716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea874dc-813e-422b-b99f-cec16cdd6504 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:42.005716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea874dc-813e-422b-b99f-cec16cdd6504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:42.007385 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea874dc-813e-422b-b99f-cec16cdd6504 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:42.022249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1081/2184] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:22:42.023517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890eff4-a2e1-476a-8720-1a5b7aadf581 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:42.036707 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890eff4-a2e1-476a-8720-1a5b7aadf581 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:42.052228 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b63d2-ffb8-46de-887f-af788cd3766a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:42.053586 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b63d2-ffb8-46de-887f-af788cd3766a admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:42.054085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b63d2-ffb8-46de-887f-af788cd3766a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:42.054774 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b63d2-ffb8-46de-887f-af788cd3766a admin admin] PATH_INFO: `/v3/projects/6fcd2a15d72b4d4eabfd5de82b084178/users/001b0ae21c9c4086b55c100c68b1c201/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:42.061675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b63d2-ffb8-46de-887f-af788cd3766a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fcd2a15d72b4d4eabfd5de82b084178, user_id=001b0ae21c9c4086b55c100c68b1c201, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:42.069056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b63d2-ffb8-46de-887f-af788cd3766a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:42.110055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1104/2185] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:22:42 2022] PUT /identity/v3/projects/6fcd2a15d72b4d4eabfd5de82b084178/users/001b0ae21c9c4086b55c100c68b1c201/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:42.124353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e768270-e5bf-41a7-b055-956b816c6b16 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:42.124560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e768270-e5bf-41a7-b055-956b816c6b16 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:42.124847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e768270-e5bf-41a7-b055-956b816c6b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:42.236210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-1e768270-e5bf-41a7-b055-956b816c6b16 None None] MFA Rules not processed for user `001b0ae21c9c4086b55c100c68b1c201`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:42.238633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-1e768270-e5bf-41a7-b055-956b816c6b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:42.379964 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1082/2186] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:42.391500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b63d2-ffb8-46de-887f-af788cd3766a admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:42.391790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1d0b63d2-ffb8-46de-887f-af788cd3766a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:42.522606 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b63d2-ffb8-46de-887f-af788cd3766a admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:42.526427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf632fe0-8e41-4bdd-a404-7e6a51d3a803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:42.527104 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf632fe0-8e41-4bdd-a404-7e6a51d3a803 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:42.527388 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf632fe0-8e41-4bdd-a404-7e6a51d3a803 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:42.527666 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf632fe0-8e41-4bdd-a404-7e6a51d3a803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:42.538368 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf632fe0-8e41-4bdd-a404-7e6a51d3a803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:42.539817 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf632fe0-8e41-4bdd-a404-7e6a51d3a803 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:42.566956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1105/2187] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:22:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:22:42.588348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e768270-e5bf-41a7-b055-956b816c6b16 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:42.742506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e768270-e5bf-41a7-b055-956b816c6b16 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:42.765397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d35679-4025-44ea-8308-a54dee4d9b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:42.765677 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d35679-4025-44ea-8308-a54dee4d9b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:42.766059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d35679-4025-44ea-8308-a54dee4d9b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:42.766211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d35679-4025-44ea-8308-a54dee4d9b32 admin admin] PATH_INFO: `/v3/users/e226bd00be29468e8a5dd3b34c239c5a` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:42.772375 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d35679-4025-44ea-8308-a54dee4d9b32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e226bd00be29468e8a5dd3b34c239c5a)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:42.778083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d35679-4025-44ea-8308-a54dee4d9b32 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:43.033530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-65d35679-4025-44ea-8308-a54dee4d9b32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e226bd00be29468e8a5dd3b34c239c5a'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:43.033530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-65d35679-4025-44ea-8308-a54dee4d9b32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e226bd00be29468e8a5dd3b34c239c5a'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:43.048365 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-65d35679-4025-44ea-8308-a54dee4d9b32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e226bd00be29468e8a5dd3b34c239c5a'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:43.049244 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-65d35679-4025-44ea-8308-a54dee4d9b32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e226bd00be29468e8a5dd3b34c239c5a'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:43.056459 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-65d35679-4025-44ea-8308-a54dee4d9b32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e226bd00be29468e8a5dd3b34c239c5a'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:43.146515 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1083/2188] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:22:42 2022] DELETE /identity/v3/users/e226bd00be29468e8a5dd3b34c239c5a => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:43.150498 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da0e45-da72-40b0-b7c5-68340ed25232 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:43.151008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da0e45-da72-40b0-b7c5-68340ed25232 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:43.151591 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da0e45-da72-40b0-b7c5-68340ed25232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:43.183813 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-02da0e45-da72-40b0-b7c5-68340ed25232 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:43.185728 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-02da0e45-da72-40b0-b7c5-68340ed25232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:43.321518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1106/2189] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:22:43.336147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d35679-4025-44ea-8308-a54dee4d9b32 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:43.337580 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-65d35679-4025-44ea-8308-a54dee4d9b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:43.499231 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d35679-4025-44ea-8308-a54dee4d9b32 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:43.503094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52a220-e796-4be3-acd9-e9aeb4f42332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:43.503769 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52a220-e796-4be3-acd9-e9aeb4f42332 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:43.504065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52a220-e796-4be3-acd9-e9aeb4f42332 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:43.504323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52a220-e796-4be3-acd9-e9aeb4f42332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:43.516542 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52a220-e796-4be3-acd9-e9aeb4f42332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:43.518047 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52a220-e796-4be3-acd9-e9aeb4f42332 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:43.532537 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1084/2190] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:22:44.765102 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da0e45-da72-40b0-b7c5-68340ed25232 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:44.766621 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-02da0e45-da72-40b0-b7c5-68340ed25232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:44.790794 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da0e45-da72-40b0-b7c5-68340ed25232 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:44.797182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c571ea-ee32-439c-a7bb-9b7e558417eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:44.799628 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c571ea-ee32-439c-a7bb-9b7e558417eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:44.800401 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c571ea-ee32-439c-a7bb-9b7e558417eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:44.801616 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c571ea-ee32-439c-a7bb-9b7e558417eb admin admin] PATH_INFO: `/v3/projects/26a842b57d0346bea53e7ed3b42079f1` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:44.803292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c571ea-ee32-439c-a7bb-9b7e558417eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=26a842b57d0346bea53e7ed3b42079f1)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:44.806177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c571ea-ee32-439c-a7bb-9b7e558417eb admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:44.963327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e0c571ea-ee32-439c-a7bb-9b7e558417eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26a842b57d0346bea53e7ed3b42079f1', 'request_id': 'req-e0c571ea-ee32-439c-a7bb-9b7e558417eb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:45.090367 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e0c571ea-ee32-439c-a7bb-9b7e558417eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26a842b57d0346bea53e7ed3b42079f1', 'request_id': 'req-e0c571ea-ee32-439c-a7bb-9b7e558417eb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:45.114700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e0c571ea-ee32-439c-a7bb-9b7e558417eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26a842b57d0346bea53e7ed3b42079f1', 'request_id': 'req-e0c571ea-ee32-439c-a7bb-9b7e558417eb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:45.172610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e0c571ea-ee32-439c-a7bb-9b7e558417eb admin admin] The token cache is being invalidate because project 26a842b57d0346bea53e7ed3b42079f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:22:45.172610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e0c571ea-ee32-439c-a7bb-9b7e558417eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:45.173185 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e0c571ea-ee32-439c-a7bb-9b7e558417eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:45.195967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1107/2191] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:22:44 2022] DELETE /identity/v3/projects/26a842b57d0346bea53e7ed3b42079f1 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:45.204176 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52a220-e796-4be3-acd9-e9aeb4f42332 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:45.228895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52a220-e796-4be3-acd9-e9aeb4f42332 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:45.283440 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c571ea-ee32-439c-a7bb-9b7e558417eb admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:45.289843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e0c571ea-ee32-439c-a7bb-9b7e558417eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:45.390662 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16b4e2-3854-49e1-855a-47ed613a3723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:45.391843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16b4e2-3854-49e1-855a-47ed613a3723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:45.392210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16b4e2-3854-49e1-855a-47ed613a3723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:45.392567 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16b4e2-3854-49e1-855a-47ed613a3723 admin admin] PATH_INFO: `/v3/users/001b0ae21c9c4086b55c100c68b1c201` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:45.396090 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16b4e2-3854-49e1-855a-47ed613a3723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=001b0ae21c9c4086b55c100c68b1c201)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:45.398547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16b4e2-3854-49e1-855a-47ed613a3723 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:45.442417 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c571ea-ee32-439c-a7bb-9b7e558417eb admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:45.449722 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c563f-42b8-44b5-b0ee-54386d6bb53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:45.450682 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c563f-42b8-44b5-b0ee-54386d6bb53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:45.452230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c563f-42b8-44b5-b0ee-54386d6bb53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:45.452590 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c563f-42b8-44b5-b0ee-54386d6bb53d admin admin] PATH_INFO: `/v3/users/84dc62e15dfc4212bd91e0946e89dd9d` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:45.453948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c563f-42b8-44b5-b0ee-54386d6bb53d admin admin] RBAC: Authorizing `identity:delete_user(user_id=84dc62e15dfc4212bd91e0946e89dd9d)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:45.455964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c563f-42b8-44b5-b0ee-54386d6bb53d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:45.972825 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9d16b4e2-3854-49e1-855a-47ed613a3723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001b0ae21c9c4086b55c100c68b1c201'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:45.973587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9d16b4e2-3854-49e1-855a-47ed613a3723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001b0ae21c9c4086b55c100c68b1c201'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:45.993883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9d16b4e2-3854-49e1-855a-47ed613a3723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001b0ae21c9c4086b55c100c68b1c201'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:45.994623 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9d16b4e2-3854-49e1-855a-47ed613a3723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001b0ae21c9c4086b55c100c68b1c201'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:46.001511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-038c563f-42b8-44b5-b0ee-54386d6bb53d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84dc62e15dfc4212bd91e0946e89dd9d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:46.002268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-038c563f-42b8-44b5-b0ee-54386d6bb53d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84dc62e15dfc4212bd91e0946e89dd9d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:46.003413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-038c563f-42b8-44b5-b0ee-54386d6bb53d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84dc62e15dfc4212bd91e0946e89dd9d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:46.010225 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9d16b4e2-3854-49e1-855a-47ed613a3723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001b0ae21c9c4086b55c100c68b1c201'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:46.028208 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-038c563f-42b8-44b5-b0ee-54386d6bb53d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84dc62e15dfc4212bd91e0946e89dd9d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:46.036851 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-038c563f-42b8-44b5-b0ee-54386d6bb53d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84dc62e15dfc4212bd91e0946e89dd9d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:46.107601 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1085/2192] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:22:45 2022] DELETE /identity/v3/users/001b0ae21c9c4086b55c100c68b1c201 => generated 0 bytes in 897 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:46.115421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e45526-ed9d-4f63-b4e2-ea9ed780fd79 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:46.121099 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e45526-ed9d-4f63-b4e2-ea9ed780fd79 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:46.121584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e45526-ed9d-4f63-b4e2-ea9ed780fd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:46.152194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-24e45526-ed9d-4f63-b4e2-ea9ed780fd79 None None] MFA Rules not processed for user `ca39678abe6e476283f94c675d4ea369`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:46.154089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-24e45526-ed9d-4f63-b4e2-ea9ed780fd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:46.167020 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1108/2193] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:22:45 2022] DELETE /identity/v3/users/84dc62e15dfc4212bd91e0946e89dd9d => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:46.172674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731d98d-e058-4cdd-9130-651bbb412834 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:46.172977 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731d98d-e058-4cdd-9130-651bbb412834 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:46.174852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731d98d-e058-4cdd-9130-651bbb412834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:46.224057 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6731d98d-e058-4cdd-9130-651bbb412834 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:46.228969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6731d98d-e058-4cdd-9130-651bbb412834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:46.262415 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1086/2194] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:46.317877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1109/2195] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:46.329047 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e45526-ed9d-4f63-b4e2-ea9ed780fd79 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:46.330654 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-24e45526-ed9d-4f63-b4e2-ea9ed780fd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:46.459254 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e45526-ed9d-4f63-b4e2-ea9ed780fd79 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:46.553197 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43996959-12a9-4356-a3af-054d5695c701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:46.556978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43996959-12a9-4356-a3af-054d5695c701 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:46.556978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43996959-12a9-4356-a3af-054d5695c701 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:46.558872 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43996959-12a9-4356-a3af-054d5695c701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:46.572609 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43996959-12a9-4356-a3af-054d5695c701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:46.580361 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43996959-12a9-4356-a3af-054d5695c701 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:46.597719 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1087/2196] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:22:46.709694 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731d98d-e058-4cdd-9130-651bbb412834 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:46.711048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6731d98d-e058-4cdd-9130-651bbb412834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:46.723661 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731d98d-e058-4cdd-9130-651bbb412834 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:46.735572 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2a3cf-a239-43c1-8b4e-d5ba9c0c38cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:46.735572 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2a3cf-a239-43c1-8b4e-d5ba9c0c38cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:46.735572 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2a3cf-a239-43c1-8b4e-d5ba9c0c38cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:46.735572 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2a3cf-a239-43c1-8b4e-d5ba9c0c38cc admin admin] PATH_INFO: `/v3/projects/6fcd2a15d72b4d4eabfd5de82b084178` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:46.737148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2a3cf-a239-43c1-8b4e-d5ba9c0c38cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fcd2a15d72b4d4eabfd5de82b084178)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:46.739090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2a3cf-a239-43c1-8b4e-d5ba9c0c38cc admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:46.895511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-27d2a3cf-a239-43c1-8b4e-d5ba9c0c38cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fcd2a15d72b4d4eabfd5de82b084178', 'request_id': 'req-27d2a3cf-a239-43c1-8b4e-d5ba9c0c38cc'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:46.979246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-27d2a3cf-a239-43c1-8b4e-d5ba9c0c38cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fcd2a15d72b4d4eabfd5de82b084178', 'request_id': 'req-27d2a3cf-a239-43c1-8b4e-d5ba9c0c38cc'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:46.989123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-27d2a3cf-a239-43c1-8b4e-d5ba9c0c38cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fcd2a15d72b4d4eabfd5de82b084178', 'request_id': 'req-27d2a3cf-a239-43c1-8b4e-d5ba9c0c38cc'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:47.012901 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-27d2a3cf-a239-43c1-8b4e-d5ba9c0c38cc admin admin] The token cache is being invalidate because project 6fcd2a15d72b4d4eabfd5de82b084178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:22:47.021828 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-27d2a3cf-a239-43c1-8b4e-d5ba9c0c38cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:47.021828 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-27d2a3cf-a239-43c1-8b4e-d5ba9c0c38cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:47.021828 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1110/2197] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:22:46 2022] DELETE /identity/v3/projects/6fcd2a15d72b4d4eabfd5de82b084178 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:47.023090 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a96516-1b23-4cb1-8534-694e7b004941 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:47.023499 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a96516-1b23-4cb1-8534-694e7b004941 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:47.023877 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a96516-1b23-4cb1-8534-694e7b004941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:47.044179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-71a96516-1b23-4cb1-8534-694e7b004941 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:47.045785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-71a96516-1b23-4cb1-8534-694e7b004941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:47.052097 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2a3cf-a239-43c1-8b4e-d5ba9c0c38cc admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:47.054341 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-27d2a3cf-a239-43c1-8b4e-d5ba9c0c38cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:47.189132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1088/2198] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:47.193642 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562b110-1dd5-4004-b35a-69cede430a30 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:47.194064 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562b110-1dd5-4004-b35a-69cede430a30 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:47.196077 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562b110-1dd5-4004-b35a-69cede430a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:47.230975 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2a3cf-a239-43c1-8b4e-d5ba9c0c38cc admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:47.230975 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7552316-2dc5-482f-8025-425005924143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:47.230975 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7552316-2dc5-482f-8025-425005924143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:47.231567 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7552316-2dc5-482f-8025-425005924143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:47.231567 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7552316-2dc5-482f-8025-425005924143 admin admin] PATH_INFO: `/v3/projects/eda2d177aafc4fea94a790441a580fcf` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:47.233413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7552316-2dc5-482f-8025-425005924143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eda2d177aafc4fea94a790441a580fcf)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:47.234966 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-e562b110-1dd5-4004-b35a-69cede430a30 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:47.236311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7552316-2dc5-482f-8025-425005924143 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:47.236464 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e562b110-1dd5-4004-b35a-69cede430a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:47.263058 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1089/2199] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:47.264705 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562b110-1dd5-4004-b35a-69cede430a30 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:47.277519 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562b110-1dd5-4004-b35a-69cede430a30 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:47.283026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e4670-01b3-420d-ae63-dfe9798a8921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:47.284384 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e4670-01b3-420d-ae63-dfe9798a8921 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:47.284783 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e4670-01b3-420d-ae63-dfe9798a8921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:47.285158 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e4670-01b3-420d-ae63-dfe9798a8921 admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:47.286109 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e4670-01b3-420d-ae63-dfe9798a8921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:22:47.296183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e4670-01b3-420d-ae63-dfe9798a8921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:47.298078 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e4670-01b3-420d-ae63-dfe9798a8921 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:47.324670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1090/2200] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:22:47.324670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e4670-01b3-420d-ae63-dfe9798a8921 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:47.351310 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e4670-01b3-420d-ae63-dfe9798a8921 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:47.364688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d7552316-2dc5-482f-8025-425005924143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eda2d177aafc4fea94a790441a580fcf', 'request_id': 'req-d7552316-2dc5-482f-8025-425005924143'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:47.455553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee709281-0c30-44ac-8128-fc5d3188aeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:47.465305 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee709281-0c30-44ac-8128-fc5d3188aeb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:47.465305 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee709281-0c30-44ac-8128-fc5d3188aeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:47.465305 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee709281-0c30-44ac-8128-fc5d3188aeb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:47.465305 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee709281-0c30-44ac-8128-fc5d3188aeb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:47.465305 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee709281-0c30-44ac-8128-fc5d3188aeb3 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:47.476920 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d7552316-2dc5-482f-8025-425005924143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eda2d177aafc4fea94a790441a580fcf', 'request_id': 'req-d7552316-2dc5-482f-8025-425005924143'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:47.491790 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d7552316-2dc5-482f-8025-425005924143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eda2d177aafc4fea94a790441a580fcf', 'request_id': 'req-d7552316-2dc5-482f-8025-425005924143'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:47.515602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d7552316-2dc5-482f-8025-425005924143 admin admin] The token cache is being invalidate because project eda2d177aafc4fea94a790441a580fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:22:47.517268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d7552316-2dc5-482f-8025-425005924143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:47.517268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d7552316-2dc5-482f-8025-425005924143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:47.519428 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1111/2201] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:22:47 2022] DELETE /identity/v3/projects/eda2d177aafc4fea94a790441a580fcf => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:47.528078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd3c94-c2d6-42db-988d-02f362d0895b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:47.528513 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd3c94-c2d6-42db-988d-02f362d0895b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:47.528903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd3c94-c2d6-42db-988d-02f362d0895b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:47.546828 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1091/2202] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:22:47 2022] POST /identity/v3/projects => generated 387 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:22:47.550816 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee709281-0c30-44ac-8128-fc5d3188aeb3 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:47.554420 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-ee709281-0c30-44ac-8128-fc5d3188aeb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:47.588061 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-00cd3c94-c2d6-42db-988d-02f362d0895b None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:47.594456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-00cd3c94-c2d6-42db-988d-02f362d0895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:47.671762 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee709281-0c30-44ac-8128-fc5d3188aeb3 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:47.677845 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ac067-c8cc-4d43-a336-6610ca1efc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:47.678637 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ac067-c8cc-4d43-a336-6610ca1efc3f admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:47.678987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ac067-c8cc-4d43-a336-6610ca1efc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:47.679336 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ac067-c8cc-4d43-a336-6610ca1efc3f admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:47.680099 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ac067-c8cc-4d43-a336-6610ca1efc3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:47.682270 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ac067-c8cc-4d43-a336-6610ca1efc3f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:47.697138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1112/2203] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:47.705831 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c5825-75b4-4a9a-abee-94c5f5608071 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:47.706163 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c5825-75b4-4a9a-abee-94c5f5608071 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:47.706487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c5825-75b4-4a9a-abee-94c5f5608071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:47.727642 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-662c5825-75b4-4a9a-abee-94c5f5608071 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:47.731590 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-662c5825-75b4-4a9a-abee-94c5f5608071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:47.741575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1113/2204] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:47.746401 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c5825-75b4-4a9a-abee-94c5f5608071 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:47.757250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c5825-75b4-4a9a-abee-94c5f5608071 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:47.764677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185b39a-59cc-40fd-b121-ed924d5d8917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:47.765657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185b39a-59cc-40fd-b121-ed924d5d8917 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:47.765941 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185b39a-59cc-40fd-b121-ed924d5d8917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:47.766214 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185b39a-59cc-40fd-b121-ed924d5d8917 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:47.767007 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185b39a-59cc-40fd-b121-ed924d5d8917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:22:47.767312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185b39a-59cc-40fd-b121-ed924d5d8917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:47.768887 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185b39a-59cc-40fd-b121-ed924d5d8917 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:47.783138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1114/2205] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:22:47.787743 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185b39a-59cc-40fd-b121-ed924d5d8917 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:47.803266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1092/2206] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:22:47 2022] POST /identity/v3/users => generated 294 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:22:47.804599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ac067-c8cc-4d43-a336-6610ca1efc3f admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:47.814549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185b39a-59cc-40fd-b121-ed924d5d8917 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:47.819412 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ac067-c8cc-4d43-a336-6610ca1efc3f admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:47.820777 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d1ada-7041-460d-8eae-7c23f15f42d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:47.821527 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d1ada-7041-460d-8eae-7c23f15f42d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:47.821988 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d1ada-7041-460d-8eae-7c23f15f42d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:47.822538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d1ada-7041-460d-8eae-7c23f15f42d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:47.823568 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d1ada-7041-460d-8eae-7c23f15f42d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:47.825408 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107f32b-a5a9-4a37-92ac-41052cfb7fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:47.825857 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d1ada-7041-460d-8eae-7c23f15f42d8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:47.826151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107f32b-a5a9-4a37-92ac-41052cfb7fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:47.826480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107f32b-a5a9-4a37-92ac-41052cfb7fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:47.826757 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107f32b-a5a9-4a37-92ac-41052cfb7fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:47.827496 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107f32b-a5a9-4a37-92ac-41052cfb7fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:47.829108 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107f32b-a5a9-4a37-92ac-41052cfb7fb0 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:47.847622 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1093/2207] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:22:47.853490 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107f32b-a5a9-4a37-92ac-41052cfb7fb0 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:47.865357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107f32b-a5a9-4a37-92ac-41052cfb7fb0 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:47.870493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924e1c4-065d-4257-9a3f-d5cb577c8b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:47.871138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924e1c4-065d-4257-9a3f-d5cb577c8b82 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:47.871421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924e1c4-065d-4257-9a3f-d5cb577c8b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:47.871692 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924e1c4-065d-4257-9a3f-d5cb577c8b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:47.872429 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924e1c4-065d-4257-9a3f-d5cb577c8b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:47.874091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924e1c4-065d-4257-9a3f-d5cb577c8b82 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:47.889377 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1094/2208] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:22:47.890555 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924e1c4-065d-4257-9a3f-d5cb577c8b82 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:47.901055 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924e1c4-065d-4257-9a3f-d5cb577c8b82 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:47.909318 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7241b2-5c04-4e9b-a1cc-871ce41a003e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:47.910216 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7241b2-5c04-4e9b-a1cc-871ce41a003e admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:47.910526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7241b2-5c04-4e9b-a1cc-871ce41a003e admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:47.910802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7241b2-5c04-4e9b-a1cc-871ce41a003e admin admin] PATH_INFO: `/v3/projects/a79fdf24582f41c1b7f612aeda47a9af/users/6399f4f72410424c849f1fd2ad1ec174/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:47.918348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1115/2209] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:22:47 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:22:47.923091 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d1ada-7041-460d-8eae-7c23f15f42d8 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:47.935385 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7241b2-5c04-4e9b-a1cc-871ce41a003e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a79fdf24582f41c1b7f612aeda47a9af, user_id=6399f4f72410424c849f1fd2ad1ec174, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:47.938709 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7241b2-5c04-4e9b-a1cc-871ce41a003e admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:48.005125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d1ada-7041-460d-8eae-7c23f15f42d8 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:48.009979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1095/2210] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:22:47 2022] PUT /identity/v3/projects/a79fdf24582f41c1b7f612aeda47a9af/users/6399f4f72410424c849f1fd2ad1ec174/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:48.026169 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba619f-46c8-459d-b155-9c45093dfef4 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:48.031776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba619f-46c8-459d-b155-9c45093dfef4 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:48.032358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba619f-46c8-459d-b155-9c45093dfef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:48.085057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-e2ba619f-46c8-459d-b155-9c45093dfef4 None None] MFA Rules not processed for user `6399f4f72410424c849f1fd2ad1ec174`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:48.085057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e2ba619f-46c8-459d-b155-9c45093dfef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:48.125698 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448f2b8-8e48-41c1-a376-9b22ddc4ff76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:48.127169 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448f2b8-8e48-41c1-a376-9b22ddc4ff76 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:48.127625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448f2b8-8e48-41c1-a376-9b22ddc4ff76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:48.128046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448f2b8-8e48-41c1-a376-9b22ddc4ff76 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:48.128920 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448f2b8-8e48-41c1-a376-9b22ddc4ff76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:48.131583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448f2b8-8e48-41c1-a376-9b22ddc4ff76 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:48.193449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1096/2211] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:48.197417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba619f-46c8-459d-b155-9c45093dfef4 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:48.212767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba619f-46c8-459d-b155-9c45093dfef4 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:48.217861 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f43a5-5f9b-4cb1-84df-599ec2f151f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:48.222657 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f43a5-5f9b-4cb1-84df-599ec2f151f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:48.222657 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f43a5-5f9b-4cb1-84df-599ec2f151f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:48.222657 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f43a5-5f9b-4cb1-84df-599ec2f151f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:48.222657 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f43a5-5f9b-4cb1-84df-599ec2f151f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:48.222657 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f43a5-5f9b-4cb1-84df-599ec2f151f4 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:48.246959 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1116/2212] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:22:47 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:22:48.251526 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448f2b8-8e48-41c1-a376-9b22ddc4ff76 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:48.268107 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448f2b8-8e48-41c1-a376-9b22ddc4ff76 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:48.270558 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c335e-11da-47b3-9abc-73ff4b476d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:48.271240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c335e-11da-47b3-9abc-73ff4b476d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:48.271525 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c335e-11da-47b3-9abc-73ff4b476d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:48.271804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c335e-11da-47b3-9abc-73ff4b476d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:48.272554 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c335e-11da-47b3-9abc-73ff4b476d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:48.274121 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c335e-11da-47b3-9abc-73ff4b476d03 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:48.285452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1117/2213] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:22:48.289434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c335e-11da-47b3-9abc-73ff4b476d03 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:48.300507 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c335e-11da-47b3-9abc-73ff4b476d03 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:48.306028 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20b6f9-4b6e-40be-907f-462624b6bb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:48.306836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20b6f9-4b6e-40be-907f-462624b6bb39 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:48.307196 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20b6f9-4b6e-40be-907f-462624b6bb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:48.307547 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20b6f9-4b6e-40be-907f-462624b6bb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:48.308478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20b6f9-4b6e-40be-907f-462624b6bb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:48.310677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20b6f9-4b6e-40be-907f-462624b6bb39 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:48.322229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1118/2214] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:22:48.327469 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20b6f9-4b6e-40be-907f-462624b6bb39 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:48.339872 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1097/2215] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:22:48 2022] POST /identity/v3/projects => generated 389 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:22:48.342588 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20b6f9-4b6e-40be-907f-462624b6bb39 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:48.343431 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f43a5-5f9b-4cb1-84df-599ec2f151f4 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:48.439394 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f3101-097e-4271-8bf2-8687b6bd3d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:48.440527 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f3101-097e-4271-8bf2-8687b6bd3d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:48.448165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f3101-097e-4271-8bf2-8687b6bd3d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:48.448165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f3101-097e-4271-8bf2-8687b6bd3d3f admin admin] PATH_INFO: `/v3/projects/7858ff72ee9843a493c27f9592a540b0/users/cee2a53cb70b4281bb49e39d70abfaa6/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:48.484194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f43a5-5f9b-4cb1-84df-599ec2f151f4 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:48.484450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f3101-097e-4271-8bf2-8687b6bd3d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7858ff72ee9843a493c27f9592a540b0, user_id=cee2a53cb70b4281bb49e39d70abfaa6, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:48.487381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f3101-097e-4271-8bf2-8687b6bd3d3f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:48.491905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b711bc-dab4-4ef7-8943-5c9e69b7a7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:48.492855 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b711bc-dab4-4ef7-8943-5c9e69b7a7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:48.493302 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b711bc-dab4-4ef7-8943-5c9e69b7a7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:48.493755 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b711bc-dab4-4ef7-8943-5c9e69b7a7a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:48.495118 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b711bc-dab4-4ef7-8943-5c9e69b7a7a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:48.497564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b711bc-dab4-4ef7-8943-5c9e69b7a7a7 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:48.552091 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1119/2216] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:22:48 2022] PUT /identity/v3/projects/7858ff72ee9843a493c27f9592a540b0/users/cee2a53cb70b4281bb49e39d70abfaa6/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:48.556741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2d750-cd0c-4ca6-b47f-84b1b959b490 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:48.557042 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2d750-cd0c-4ca6-b47f-84b1b959b490 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:48.557337 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2d750-cd0c-4ca6-b47f-84b1b959b490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:48.574354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1098/2217] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:22:48 2022] POST /identity/v3/users => generated 301 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:22:48.578895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b711bc-dab4-4ef7-8943-5c9e69b7a7a7 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:48.586255 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-1cd2d750-cd0c-4ca6-b47f-84b1b959b490 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:48.588255 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1cd2d750-cd0c-4ca6-b47f-84b1b959b490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:48.593324 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b711bc-dab4-4ef7-8943-5c9e69b7a7a7 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:48.693158 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b6e3c-7789-4aea-9e69-01e75eb0e0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:48.695029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6e3c-7789-4aea-9e69-01e75eb0e0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:48.695653 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6e3c-7789-4aea-9e69-01e75eb0e0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:48.696408 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6e3c-7789-4aea-9e69-01e75eb0e0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:48.697576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b6e3c-7789-4aea-9e69-01e75eb0e0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:48.700457 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b6e3c-7789-4aea-9e69-01e75eb0e0a3 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:48.716025 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1099/2218] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:22:48.721440 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b6e3c-7789-4aea-9e69-01e75eb0e0a3 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:48.722359 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1120/2219] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:22:48.724292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2d750-cd0c-4ca6-b47f-84b1b959b490 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:48.729931 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1cd2d750-cd0c-4ca6-b47f-84b1b959b490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:48.736607 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b6e3c-7789-4aea-9e69-01e75eb0e0a3 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:48.743075 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1094d28-56d8-4900-9556-e5d17b6dd306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:48.744174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1094d28-56d8-4900-9556-e5d17b6dd306 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:48.744601 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1094d28-56d8-4900-9556-e5d17b6dd306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:48.744890 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1094d28-56d8-4900-9556-e5d17b6dd306 admin admin] PATH_INFO: `/v3/projects/f226621ab56847a988bdab74fa9b8e2f/users/9af22085a38940bc97d68f0b6ef8c450/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:48.769789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1094d28-56d8-4900-9556-e5d17b6dd306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f226621ab56847a988bdab74fa9b8e2f, user_id=9af22085a38940bc97d68f0b6ef8c450, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:48.772670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1094d28-56d8-4900-9556-e5d17b6dd306 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:48.809584 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2d750-cd0c-4ca6-b47f-84b1b959b490 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:48.817168 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b977a0d-1412-467e-bbeb-dc0861de76e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:48.821208 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b977a0d-1412-467e-bbeb-dc0861de76e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:48.821208 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b977a0d-1412-467e-bbeb-dc0861de76e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:48.821208 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b977a0d-1412-467e-bbeb-dc0861de76e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:48.829560 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b977a0d-1412-467e-bbeb-dc0861de76e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:48.831267 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b977a0d-1412-467e-bbeb-dc0861de76e6 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:48.843462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1121/2220] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:22:48.849776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1100/2221] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:22:48 2022] PUT /identity/v3/projects/f226621ab56847a988bdab74fa9b8e2f/users/9af22085a38940bc97d68f0b6ef8c450/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:48.856147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b977a0d-1412-467e-bbeb-dc0861de76e6 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:48.893413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b977a0d-1412-467e-bbeb-dc0861de76e6 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:48.960796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e1c59-67d8-4340-8491-67954ccc7001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:48.961589 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e1c59-67d8-4340-8491-67954ccc7001 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:48.961772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e1c59-67d8-4340-8491-67954ccc7001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:48.962048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e1c59-67d8-4340-8491-67954ccc7001 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:48.962827 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e1c59-67d8-4340-8491-67954ccc7001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:48.964716 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e1c59-67d8-4340-8491-67954ccc7001 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:48.982870 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1122/2222] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:22:48.983936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1094d28-56d8-4900-9556-e5d17b6dd306 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:49.000400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1094d28-56d8-4900-9556-e5d17b6dd306 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:49.005724 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd726afb-80ba-4a0f-8dfc-ec7bcd8fb471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:49.006668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd726afb-80ba-4a0f-8dfc-ec7bcd8fb471 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:49.006958 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd726afb-80ba-4a0f-8dfc-ec7bcd8fb471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:49.007235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd726afb-80ba-4a0f-8dfc-ec7bcd8fb471 admin admin] PATH_INFO: `/v3/projects/f226621ab56847a988bdab74fa9b8e2f/users/9af22085a38940bc97d68f0b6ef8c450/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:49.009555 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd726afb-80ba-4a0f-8dfc-ec7bcd8fb471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f226621ab56847a988bdab74fa9b8e2f, user_id=9af22085a38940bc97d68f0b6ef8c450, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:49.012324 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd726afb-80ba-4a0f-8dfc-ec7bcd8fb471 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:49.051661 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1101/2223] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:22:48 2022] PUT /identity/v3/projects/f226621ab56847a988bdab74fa9b8e2f/users/9af22085a38940bc97d68f0b6ef8c450/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:49.053514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0026c3-9347-442b-a9aa-dec79375d321 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:49.054213 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0026c3-9347-442b-a9aa-dec79375d321 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:49.054213 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0026c3-9347-442b-a9aa-dec79375d321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:49.087433 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-ca0026c3-9347-442b-a9aa-dec79375d321 None None] MFA Rules not processed for user `9af22085a38940bc97d68f0b6ef8c450`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:49.088816 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ca0026c3-9347-442b-a9aa-dec79375d321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:49.187335 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1123/2224] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:49.205103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd726afb-80ba-4a0f-8dfc-ec7bcd8fb471 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:49.209323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-bd726afb-80ba-4a0f-8dfc-ec7bcd8fb471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:49.302995 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd726afb-80ba-4a0f-8dfc-ec7bcd8fb471 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:49.339531 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266f1ab-1228-4fec-b758-2e6f4a69a0e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:49.340248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266f1ab-1228-4fec-b758-2e6f4a69a0e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:49.340790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266f1ab-1228-4fec-b758-2e6f4a69a0e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:49.340928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266f1ab-1228-4fec-b758-2e6f4a69a0e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:49.356457 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266f1ab-1228-4fec-b758-2e6f4a69a0e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:49.359031 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266f1ab-1228-4fec-b758-2e6f4a69a0e6 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:49.379481 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1102/2225] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:22:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:22:49.601538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0026c3-9347-442b-a9aa-dec79375d321 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:49.709116 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0026c3-9347-442b-a9aa-dec79375d321 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:49.716243 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf7a43-ee9a-4a9b-bcb3-a7c6e434ef53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:49.720534 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf7a43-ee9a-4a9b-bcb3-a7c6e434ef53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:49.720534 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf7a43-ee9a-4a9b-bcb3-a7c6e434ef53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:49.720534 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf7a43-ee9a-4a9b-bcb3-a7c6e434ef53 admin admin] PATH_INFO: `/v3/users/6399f4f72410424c849f1fd2ad1ec174` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:49.721485 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf7a43-ee9a-4a9b-bcb3-a7c6e434ef53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6399f4f72410424c849f1fd2ad1ec174)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:49.723638 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf7a43-ee9a-4a9b-bcb3-a7c6e434ef53 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:50.644140 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-51cf7a43-ee9a-4a9b-bcb3-a7c6e434ef53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6399f4f72410424c849f1fd2ad1ec174'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:50.644863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-51cf7a43-ee9a-4a9b-bcb3-a7c6e434ef53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6399f4f72410424c849f1fd2ad1ec174'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:50.645388 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-51cf7a43-ee9a-4a9b-bcb3-a7c6e434ef53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6399f4f72410424c849f1fd2ad1ec174'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:50.672027 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-51cf7a43-ee9a-4a9b-bcb3-a7c6e434ef53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6399f4f72410424c849f1fd2ad1ec174'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:50.679593 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-51cf7a43-ee9a-4a9b-bcb3-a7c6e434ef53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6399f4f72410424c849f1fd2ad1ec174'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:50.794248 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1124/2226] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:22:49 2022] DELETE /identity/v3/users/6399f4f72410424c849f1fd2ad1ec174 => generated 0 bytes in 1193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:50.799514 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc74f7-4dd0-4865-8c3f-cc2e5f619f52 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:50.800418 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc74f7-4dd0-4865-8c3f-cc2e5f619f52 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:50.801095 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc74f7-4dd0-4865-8c3f-cc2e5f619f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:50.841081 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-4bbc74f7-4dd0-4865-8c3f-cc2e5f619f52 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:50.843359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4bbc74f7-4dd0-4865-8c3f-cc2e5f619f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:50.978618 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1103/2227] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:50.989456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf7a43-ee9a-4a9b-bcb3-a7c6e434ef53 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:50.991036 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-51cf7a43-ee9a-4a9b-bcb3-a7c6e434ef53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:51.079451 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf7a43-ee9a-4a9b-bcb3-a7c6e434ef53 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:51.083312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47b61c-8cd5-43c1-bd39-cc842b351695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:51.083975 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47b61c-8cd5-43c1-bd39-cc842b351695 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:51.084384 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47b61c-8cd5-43c1-bd39-cc842b351695 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:51.084671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47b61c-8cd5-43c1-bd39-cc842b351695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:51.096591 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47b61c-8cd5-43c1-bd39-cc842b351695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:51.098290 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47b61c-8cd5-43c1-bd39-cc842b351695 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:51.122970 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1125/2228] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:22:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:22:51.951980 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc74f7-4dd0-4865-8c3f-cc2e5f619f52 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:51.954685 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4bbc74f7-4dd0-4865-8c3f-cc2e5f619f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:51.990592 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc74f7-4dd0-4865-8c3f-cc2e5f619f52 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:52.006212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aaf38-7e28-46a5-8e0e-193d446f966b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:52.007328 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aaf38-7e28-46a5-8e0e-193d446f966b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:52.008930 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aaf38-7e28-46a5-8e0e-193d446f966b admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:52.013041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aaf38-7e28-46a5-8e0e-193d446f966b admin admin] PATH_INFO: `/v3/projects/a79fdf24582f41c1b7f612aeda47a9af` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:52.023673 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300aaf38-7e28-46a5-8e0e-193d446f966b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a79fdf24582f41c1b7f612aeda47a9af)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:52.026202 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300aaf38-7e28-46a5-8e0e-193d446f966b admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:52.349817 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-300aaf38-7e28-46a5-8e0e-193d446f966b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a79fdf24582f41c1b7f612aeda47a9af', 'request_id': 'req-300aaf38-7e28-46a5-8e0e-193d446f966b'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:52.441891 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-300aaf38-7e28-46a5-8e0e-193d446f966b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a79fdf24582f41c1b7f612aeda47a9af', 'request_id': 'req-300aaf38-7e28-46a5-8e0e-193d446f966b'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:52.452451 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-300aaf38-7e28-46a5-8e0e-193d446f966b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a79fdf24582f41c1b7f612aeda47a9af', 'request_id': 'req-300aaf38-7e28-46a5-8e0e-193d446f966b'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:52.503601 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-300aaf38-7e28-46a5-8e0e-193d446f966b admin admin] The token cache is being invalidate because project a79fdf24582f41c1b7f612aeda47a9af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:22:52.503601 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-300aaf38-7e28-46a5-8e0e-193d446f966b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:52.504582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-300aaf38-7e28-46a5-8e0e-193d446f966b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:52.512024 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47b61c-8cd5-43c1-bd39-cc842b351695 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:52.512661 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1104/2229] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:22:51 2022] DELETE /identity/v3/projects/a79fdf24582f41c1b7f612aeda47a9af => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:52.536361 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47b61c-8cd5-43c1-bd39-cc842b351695 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:52.673705 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b93eb-a65d-41c8-8069-e28e988d860e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:52.675063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b93eb-a65d-41c8-8069-e28e988d860e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:52.675361 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b93eb-a65d-41c8-8069-e28e988d860e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:52.675638 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b93eb-a65d-41c8-8069-e28e988d860e admin admin] PATH_INFO: `/v3/users/9af22085a38940bc97d68f0b6ef8c450` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:52.678727 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b93eb-a65d-41c8-8069-e28e988d860e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af22085a38940bc97d68f0b6ef8c450)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:52.681556 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b93eb-a65d-41c8-8069-e28e988d860e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:52.965387 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9b7b93eb-a65d-41c8-8069-e28e988d860e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af22085a38940bc97d68f0b6ef8c450'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:52.966223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9b7b93eb-a65d-41c8-8069-e28e988d860e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af22085a38940bc97d68f0b6ef8c450'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:52.967594 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9b7b93eb-a65d-41c8-8069-e28e988d860e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af22085a38940bc97d68f0b6ef8c450'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:52.985430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9b7b93eb-a65d-41c8-8069-e28e988d860e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af22085a38940bc97d68f0b6ef8c450'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:52.994708 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9b7b93eb-a65d-41c8-8069-e28e988d860e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af22085a38940bc97d68f0b6ef8c450'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:53.072079 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1126/2230] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:22:52 2022] DELETE /identity/v3/users/9af22085a38940bc97d68f0b6ef8c450 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:22:53.556730 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aaf38-7e28-46a5-8e0e-193d446f966b admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:53.558738 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-300aaf38-7e28-46a5-8e0e-193d446f966b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:53.579585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aaf38-7e28-46a5-8e0e-193d446f966b admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:53.684918 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840bedd-4dd7-4cf5-a3e6-90cbe72eadc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:53.690989 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840bedd-4dd7-4cf5-a3e6-90cbe72eadc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:53.702325 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840bedd-4dd7-4cf5-a3e6-90cbe72eadc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:53.702909 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840bedd-4dd7-4cf5-a3e6-90cbe72eadc3 admin admin] PATH_INFO: `/v3/projects/f226621ab56847a988bdab74fa9b8e2f` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:53.704553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840bedd-4dd7-4cf5-a3e6-90cbe72eadc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f226621ab56847a988bdab74fa9b8e2f)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:53.706927 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840bedd-4dd7-4cf5-a3e6-90cbe72eadc3 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:53.889750 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d840bedd-4dd7-4cf5-a3e6-90cbe72eadc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f226621ab56847a988bdab74fa9b8e2f', 'request_id': 'req-d840bedd-4dd7-4cf5-a3e6-90cbe72eadc3'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:53.974077 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d840bedd-4dd7-4cf5-a3e6-90cbe72eadc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f226621ab56847a988bdab74fa9b8e2f', 'request_id': 'req-d840bedd-4dd7-4cf5-a3e6-90cbe72eadc3'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:53.981586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d840bedd-4dd7-4cf5-a3e6-90cbe72eadc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f226621ab56847a988bdab74fa9b8e2f', 'request_id': 'req-d840bedd-4dd7-4cf5-a3e6-90cbe72eadc3'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:54.006387 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d840bedd-4dd7-4cf5-a3e6-90cbe72eadc3 admin admin] The token cache is being invalidate because project f226621ab56847a988bdab74fa9b8e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:22:54.006816 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d840bedd-4dd7-4cf5-a3e6-90cbe72eadc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:54.009529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d840bedd-4dd7-4cf5-a3e6-90cbe72eadc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:22:54.016170 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1105/2231] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:22:53 2022] DELETE /identity/v3/projects/f226621ab56847a988bdab74fa9b8e2f => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:54.020874 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9aeec-64c1-4d20-bc9b-faeae0a2b435 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:54.021374 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9aeec-64c1-4d20-bc9b-faeae0a2b435 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:54.021927 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9aeec-64c1-4d20-bc9b-faeae0a2b435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:54.044276 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7ae9aeec-64c1-4d20-bc9b-faeae0a2b435 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:54.046647 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7ae9aeec-64c1-4d20-bc9b-faeae0a2b435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:54.165484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1127/2232] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:22:54.174154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684dd33-2f56-42a3-b7c5-80bd7e8f0db8 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:54.174470 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684dd33-2f56-42a3-b7c5-80bd7e8f0db8 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:54.174764 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684dd33-2f56-42a3-b7c5-80bd7e8f0db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:54.217408 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-5684dd33-2f56-42a3-b7c5-80bd7e8f0db8 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:54.218772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-5684dd33-2f56-42a3-b7c5-80bd7e8f0db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:54.235341 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1106/2233] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:54.239488 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9aeec-64c1-4d20-bc9b-faeae0a2b435 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:54.250876 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9aeec-64c1-4d20-bc9b-faeae0a2b435 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:54.263718 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8761dd-4034-4fb5-8061-9a06c38f4848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:54.263718 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8761dd-4034-4fb5-8061-9a06c38f4848 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:54.263718 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8761dd-4034-4fb5-8061-9a06c38f4848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:54.264814 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8761dd-4034-4fb5-8061-9a06c38f4848 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:54.265965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8761dd-4034-4fb5-8061-9a06c38f4848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:22:54.266060 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8761dd-4034-4fb5-8061-9a06c38f4848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:54.267866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8761dd-4034-4fb5-8061-9a06c38f4848 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:54.282392 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1128/2234] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:22:54.287582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684dd33-2f56-42a3-b7c5-80bd7e8f0db8 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:54.300152 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684dd33-2f56-42a3-b7c5-80bd7e8f0db8 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:54.305752 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b1d54-fdea-4331-bf4e-3f8b0784fd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:54.306603 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b1d54-fdea-4331-bf4e-3f8b0784fd0c admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:54.307137 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b1d54-fdea-4331-bf4e-3f8b0784fd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:54.307671 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b1d54-fdea-4331-bf4e-3f8b0784fd0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:54.308655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b1d54-fdea-4331-bf4e-3f8b0784fd0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:54.312105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b1d54-fdea-4331-bf4e-3f8b0784fd0c admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:54.478081 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1107/2235] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:22:54 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:22:54.479345 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8761dd-4034-4fb5-8061-9a06c38f4848 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:54.490705 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8761dd-4034-4fb5-8061-9a06c38f4848 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:54.549722 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a6ca6-ac9f-4cb4-9d76-0ade022263fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:54.550819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a6ca6-ac9f-4cb4-9d76-0ade022263fd admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:54.551272 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a6ca6-ac9f-4cb4-9d76-0ade022263fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:54.551696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a6ca6-ac9f-4cb4-9d76-0ade022263fd admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:54.552561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a6ca6-ac9f-4cb4-9d76-0ade022263fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:54.556254 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a6ca6-ac9f-4cb4-9d76-0ade022263fd admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:54.656986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1129/2236] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:22:54 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:22:54.658611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b1d54-fdea-4331-bf4e-3f8b0784fd0c admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:54.669186 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b1d54-fdea-4331-bf4e-3f8b0784fd0c admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:54.674550 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e529e0f-5ce7-4831-8d53-70e6428c8152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:54.675406 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e529e0f-5ce7-4831-8d53-70e6428c8152 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:54.678981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e529e0f-5ce7-4831-8d53-70e6428c8152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:54.678981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e529e0f-5ce7-4831-8d53-70e6428c8152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:54.678981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e529e0f-5ce7-4831-8d53-70e6428c8152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:54.678981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e529e0f-5ce7-4831-8d53-70e6428c8152 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:54.689735 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1108/2237] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:22:54.693791 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a6ca6-ac9f-4cb4-9d76-0ade022263fd admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:54.704589 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a6ca6-ac9f-4cb4-9d76-0ade022263fd admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:54.709290 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c0b56-b762-4525-a01c-85e3d378b030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:54.709959 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c0b56-b762-4525-a01c-85e3d378b030 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:54.713591 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c0b56-b762-4525-a01c-85e3d378b030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:54.713591 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c0b56-b762-4525-a01c-85e3d378b030 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:54.713591 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c0b56-b762-4525-a01c-85e3d378b030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:54.713591 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c0b56-b762-4525-a01c-85e3d378b030 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:54.724443 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1130/2238] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:22:54.728740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e529e0f-5ce7-4831-8d53-70e6428c8152 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:54.739829 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e529e0f-5ce7-4831-8d53-70e6428c8152 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:54.745052 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e3bbb-f1a1-4296-a46c-b1caf69b0b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:54.745930 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e3bbb-f1a1-4296-a46c-b1caf69b0b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:54.746375 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e3bbb-f1a1-4296-a46c-b1caf69b0b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:54.746947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e3bbb-f1a1-4296-a46c-b1caf69b0b39 admin admin] PATH_INFO: `/v3/projects/a21d64ebb9f844ebb1398e83dac91403/users/a74f11c1224e45388bec4f5927e6a43b/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:54.773736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e3bbb-f1a1-4296-a46c-b1caf69b0b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21d64ebb9f844ebb1398e83dac91403, user_id=a74f11c1224e45388bec4f5927e6a43b, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:54.773736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e3bbb-f1a1-4296-a46c-b1caf69b0b39 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:54.853839 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1109/2239] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:22:54 2022] PUT /identity/v3/projects/a21d64ebb9f844ebb1398e83dac91403/users/a74f11c1224e45388bec4f5927e6a43b/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:54.863705 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803659f-4923-47b0-88d3-6b88a59d5866 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:54.864071 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803659f-4923-47b0-88d3-6b88a59d5866 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:54.864473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803659f-4923-47b0-88d3-6b88a59d5866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:54.895131 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2803659f-4923-47b0-88d3-6b88a59d5866 None None] MFA Rules not processed for user `a74f11c1224e45388bec4f5927e6a43b`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:54.896472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2803659f-4923-47b0-88d3-6b88a59d5866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:54.981586 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1131/2240] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:54.983319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e3bbb-f1a1-4296-a46c-b1caf69b0b39 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:55.065297 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e3bbb-f1a1-4296-a46c-b1caf69b0b39 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:55.071103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41326f67-8daf-4e7a-b239-b66ba5f562b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:55.071846 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41326f67-8daf-4e7a-b239-b66ba5f562b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:55.072200 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41326f67-8daf-4e7a-b239-b66ba5f562b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:55.072469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41326f67-8daf-4e7a-b239-b66ba5f562b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:55.075374 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41326f67-8daf-4e7a-b239-b66ba5f562b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:55.075374 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41326f67-8daf-4e7a-b239-b66ba5f562b0 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:55.153586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1110/2241] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:22:54 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:22:55.158521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803659f-4923-47b0-88d3-6b88a59d5866 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:55.171201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803659f-4923-47b0-88d3-6b88a59d5866 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:55.243580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2497062-b03a-4b5c-a124-c2050f86e456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:55.244457 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2497062-b03a-4b5c-a124-c2050f86e456 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:55.244878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2497062-b03a-4b5c-a124-c2050f86e456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:55.245167 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2497062-b03a-4b5c-a124-c2050f86e456 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:55.246467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2497062-b03a-4b5c-a124-c2050f86e456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:55.249239 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2497062-b03a-4b5c-a124-c2050f86e456 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:55.351504 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1132/2242] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:22:55 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:22:55.355249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41326f67-8daf-4e7a-b239-b66ba5f562b0 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:55.366838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41326f67-8daf-4e7a-b239-b66ba5f562b0 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:55.371756 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014b338-6e0a-4399-acfc-fe6f54284ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:55.372499 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014b338-6e0a-4399-acfc-fe6f54284ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:55.373011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014b338-6e0a-4399-acfc-fe6f54284ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:55.373361 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014b338-6e0a-4399-acfc-fe6f54284ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:55.374510 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014b338-6e0a-4399-acfc-fe6f54284ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:55.376211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014b338-6e0a-4399-acfc-fe6f54284ea6 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:55.387577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1111/2243] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:22:55.391346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2497062-b03a-4b5c-a124-c2050f86e456 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:55.402187 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2497062-b03a-4b5c-a124-c2050f86e456 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:55.408014 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56765fc-9e12-475d-81ae-c6f9f5f53fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:55.408758 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56765fc-9e12-475d-81ae-c6f9f5f53fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:55.409116 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56765fc-9e12-475d-81ae-c6f9f5f53fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:55.409467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56765fc-9e12-475d-81ae-c6f9f5f53fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:55.410296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56765fc-9e12-475d-81ae-c6f9f5f53fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:55.412013 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56765fc-9e12-475d-81ae-c6f9f5f53fa1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:55.427348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1133/2244] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:22:55.430994 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014b338-6e0a-4399-acfc-fe6f54284ea6 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:55.440977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014b338-6e0a-4399-acfc-fe6f54284ea6 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:55.445796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bc01d-e921-4380-a7e4-3453e7b40b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:55.446723 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bc01d-e921-4380-a7e4-3453e7b40b19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:55.447006 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bc01d-e921-4380-a7e4-3453e7b40b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:55.447280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bc01d-e921-4380-a7e4-3453e7b40b19 admin admin] PATH_INFO: `/v3/projects/7b1b06e0dc85427f84e0643b0e0ed0cf/users/372a2339a9774dc598db9032ac6e1e4f/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:55.463800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bc01d-e921-4380-a7e4-3453e7b40b19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b1b06e0dc85427f84e0643b0e0ed0cf, user_id=372a2339a9774dc598db9032ac6e1e4f, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:55.468007 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bc01d-e921-4380-a7e4-3453e7b40b19 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:55.535727 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1112/2245] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:22:55 2022] PUT /identity/v3/projects/7b1b06e0dc85427f84e0643b0e0ed0cf/users/372a2339a9774dc598db9032ac6e1e4f/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:55.547528 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b1e6a-7ca4-4b75-a720-3994007c94ae None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:55.547864 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b1e6a-7ca4-4b75-a720-3994007c94ae None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:55.548106 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b1e6a-7ca4-4b75-a720-3994007c94ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:55.581598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6e8b1e6a-7ca4-4b75-a720-3994007c94ae None None] MFA Rules not processed for user `372a2339a9774dc598db9032ac6e1e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:55.583069 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6e8b1e6a-7ca4-4b75-a720-3994007c94ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:55.653584 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1134/2246] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:55.657781 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bc01d-e921-4380-a7e4-3453e7b40b19 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:55.727744 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bc01d-e921-4380-a7e4-3453e7b40b19 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:55.734566 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3b554-32cc-4e53-8f81-82138663d62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:55.735564 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3b554-32cc-4e53-8f81-82138663d62f admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:55.736020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3b554-32cc-4e53-8f81-82138663d62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:55.736450 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3b554-32cc-4e53-8f81-82138663d62f admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:55.737319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3b554-32cc-4e53-8f81-82138663d62f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:55.739277 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3b554-32cc-4e53-8f81-82138663d62f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:55.854070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1113/2247] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:22:55 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:22:55.855213 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b1e6a-7ca4-4b75-a720-3994007c94ae None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:55.868976 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b1e6a-7ca4-4b75-a720-3994007c94ae None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:55.951950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d465eb-8a19-4d45-a8a1-767d854ea85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:55.952528 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d465eb-8a19-4d45-a8a1-767d854ea85b admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:55.952877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d465eb-8a19-4d45-a8a1-767d854ea85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:55.953078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d465eb-8a19-4d45-a8a1-767d854ea85b admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:55.953781 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d465eb-8a19-4d45-a8a1-767d854ea85b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:55.955775 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d465eb-8a19-4d45-a8a1-767d854ea85b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:56.042954 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1135/2248] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:22:55 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:22:56.047333 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3b554-32cc-4e53-8f81-82138663d62f admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:56.058644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3b554-32cc-4e53-8f81-82138663d62f admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:56.064631 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0355d-20cb-4d59-bdd4-2b6639504f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:56.065385 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0355d-20cb-4d59-bdd4-2b6639504f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:56.068351 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0355d-20cb-4d59-bdd4-2b6639504f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:56.068351 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0355d-20cb-4d59-bdd4-2b6639504f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:56.068351 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0355d-20cb-4d59-bdd4-2b6639504f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:56.068989 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0355d-20cb-4d59-bdd4-2b6639504f41 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:56.083850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1114/2249] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:22:56.087951 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d465eb-8a19-4d45-a8a1-767d854ea85b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:56.101514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d465eb-8a19-4d45-a8a1-767d854ea85b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:56.109742 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda08543-e968-4e42-8442-5941d3e6b4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:56.109742 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda08543-e968-4e42-8442-5941d3e6b4fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:56.110119 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda08543-e968-4e42-8442-5941d3e6b4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:56.110524 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda08543-e968-4e42-8442-5941d3e6b4fb admin admin] PATH_INFO: `/v3/projects/aabdc29aa753410aaf7c11021f212ec0/users/cd0b86115cb7422c8647679009e03fb8/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:56.133642 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda08543-e968-4e42-8442-5941d3e6b4fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=aabdc29aa753410aaf7c11021f212ec0, user_id=cd0b86115cb7422c8647679009e03fb8, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:56.144201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda08543-e968-4e42-8442-5941d3e6b4fb admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:56.221199 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1136/2250] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:22:56 2022] PUT /identity/v3/projects/aabdc29aa753410aaf7c11021f212ec0/users/cd0b86115cb7422c8647679009e03fb8/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:56.225193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0355d-20cb-4d59-bdd4-2b6639504f41 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:56.237230 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0355d-20cb-4d59-bdd4-2b6639504f41 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:56.297022 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12cc90-777c-4b22-b89a-20ba508875cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:56.297671 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12cc90-777c-4b22-b89a-20ba508875cc admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:56.297956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12cc90-777c-4b22-b89a-20ba508875cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:56.298230 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12cc90-777c-4b22-b89a-20ba508875cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:56.298992 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12cc90-777c-4b22-b89a-20ba508875cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:56.300586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12cc90-777c-4b22-b89a-20ba508875cc admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:56.313702 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1115/2251] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:22:56.317593 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda08543-e968-4e42-8442-5941d3e6b4fb admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:56.329930 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda08543-e968-4e42-8442-5941d3e6b4fb admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:56.335032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3677d7-f719-46e0-94bf-74271d2e34a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:56.335931 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3677d7-f719-46e0-94bf-74271d2e34a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:56.336222 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3677d7-f719-46e0-94bf-74271d2e34a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:56.336501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3677d7-f719-46e0-94bf-74271d2e34a3 admin admin] PATH_INFO: `/v3/projects/aabdc29aa753410aaf7c11021f212ec0/users/cd0b86115cb7422c8647679009e03fb8/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:56.339363 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3677d7-f719-46e0-94bf-74271d2e34a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aabdc29aa753410aaf7c11021f212ec0, user_id=cd0b86115cb7422c8647679009e03fb8, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:56.342687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3677d7-f719-46e0-94bf-74271d2e34a3 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:56.358630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1137/2252] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:22:56 2022] PUT /identity/v3/projects/aabdc29aa753410aaf7c11021f212ec0/users/cd0b86115cb7422c8647679009e03fb8/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:22:56.369814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797fab2-9285-4be5-9f9d-4d084f1937a3 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:56.370104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797fab2-9285-4be5-9f9d-4d084f1937a3 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:56.370381 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797fab2-9285-4be5-9f9d-4d084f1937a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:56.406990 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-2797fab2-9285-4be5-9f9d-4d084f1937a3 None None] MFA Rules not processed for user `cd0b86115cb7422c8647679009e03fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:56.408721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-2797fab2-9285-4be5-9f9d-4d084f1937a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:56.521986 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1116/2253] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:56.538854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3677d7-f719-46e0-94bf-74271d2e34a3 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:56.542541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6a3677d7-f719-46e0-94bf-74271d2e34a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:56.671770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3677d7-f719-46e0-94bf-74271d2e34a3 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:56.683613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eaab47-0825-4c0a-a9e0-53d0c6b82fd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:56.690834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eaab47-0825-4c0a-a9e0-53d0c6b82fd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:56.697070 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eaab47-0825-4c0a-a9e0-53d0c6b82fd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:56.697070 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eaab47-0825-4c0a-a9e0-53d0c6b82fd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:56.705365 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eaab47-0825-4c0a-a9e0-53d0c6b82fd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:56.707005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eaab47-0825-4c0a-a9e0-53d0c6b82fd5 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:56.721292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1138/2254] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:22:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:22:56.888105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797fab2-9285-4be5-9f9d-4d084f1937a3 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:56.890984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-2797fab2-9285-4be5-9f9d-4d084f1937a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:56.909307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797fab2-9285-4be5-9f9d-4d084f1937a3 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:56.913913 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e3ac9-ca5f-4be4-86bb-44621de09158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:56.914894 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e3ac9-ca5f-4be4-86bb-44621de09158 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:56.915382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e3ac9-ca5f-4be4-86bb-44621de09158 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:56.915923 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e3ac9-ca5f-4be4-86bb-44621de09158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:57.039166 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e3ac9-ca5f-4be4-86bb-44621de09158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:57.040621 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e3ac9-ca5f-4be4-86bb-44621de09158 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:57.051883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1117/2255] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:22:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:22:57.815503 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95c38d-c875-4352-ae51-8df56f4218f0 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:57.815503 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95c38d-c875-4352-ae51-8df56f4218f0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:57.816047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95c38d-c875-4352-ae51-8df56f4218f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:57.860040 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-ea95c38d-c875-4352-ae51-8df56f4218f0 None None] MFA Rules not processed for user `cee2a53cb70b4281bb49e39d70abfaa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:22:57.862203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ea95c38d-c875-4352-ae51-8df56f4218f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:57.954134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1139/2256] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:22:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:22:57.958058 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e3ac9-ca5f-4be4-86bb-44621de09158 service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:57.959544 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-162e3ac9-ca5f-4be4-86bb-44621de09158 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:22:58.047729 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e3ac9-ca5f-4be4-86bb-44621de09158 service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:58.053226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df3e14-56b2-4949-973e-8f065ff249e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:58.054298 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df3e14-56b2-4949-973e-8f065ff249e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:58.054636 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df3e14-56b2-4949-973e-8f065ff249e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:58.055003 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df3e14-56b2-4949-973e-8f065ff249e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:58.061709 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df3e14-56b2-4949-973e-8f065ff249e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:58.061709 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df3e14-56b2-4949-973e-8f065ff249e0 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:58.207711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1118/2257] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:22:57 2022] POST /identity/v3/projects => generated 385 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:22:58.209495 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95c38d-c875-4352-ae51-8df56f4218f0 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:58.235230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95c38d-c875-4352-ae51-8df56f4218f0 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:58.316129 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34947535-89dc-4a9a-b305-4dcf32fc9683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:58.316813 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34947535-89dc-4a9a-b305-4dcf32fc9683 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:58.317102 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34947535-89dc-4a9a-b305-4dcf32fc9683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:58.317382 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34947535-89dc-4a9a-b305-4dcf32fc9683 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:58.318082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34947535-89dc-4a9a-b305-4dcf32fc9683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:58.320065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34947535-89dc-4a9a-b305-4dcf32fc9683 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:58.450480 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1140/2258] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:22:58 2022] POST /identity/v3/users => generated 299 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:22:58.455625 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df3e14-56b2-4949-973e-8f065ff249e0 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:58.469690 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df3e14-56b2-4949-973e-8f065ff249e0 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:58.474538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5910ac-e377-4ea1-bc9d-a90d1c421f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:58.475349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5910ac-e377-4ea1-bc9d-a90d1c421f92 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:58.476165 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5910ac-e377-4ea1-bc9d-a90d1c421f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:58.476165 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5910ac-e377-4ea1-bc9d-a90d1c421f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:58.476744 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5910ac-e377-4ea1-bc9d-a90d1c421f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:58.478701 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5910ac-e377-4ea1-bc9d-a90d1c421f92 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:58.506038 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1119/2259] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:22:58.507992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34947535-89dc-4a9a-b305-4dcf32fc9683 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:58.521728 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34947535-89dc-4a9a-b305-4dcf32fc9683 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:58.528681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09083278-c4c3-487b-a97c-0369fad75dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:58.531155 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09083278-c4c3-487b-a97c-0369fad75dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:58.533748 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09083278-c4c3-487b-a97c-0369fad75dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:58.533748 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09083278-c4c3-487b-a97c-0369fad75dc4 admin admin] PATH_INFO: `/v3/projects/7e32b7fdc90b409e8479835137e2cbf9/users/c1a357e1dc5f4f3aaea970692bbd4bae/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:58.550688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09083278-c4c3-487b-a97c-0369fad75dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e32b7fdc90b409e8479835137e2cbf9, user_id=c1a357e1dc5f4f3aaea970692bbd4bae, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:58.553976 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09083278-c4c3-487b-a97c-0369fad75dc4 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:58.627387 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1141/2260] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:22:58 2022] PUT /identity/v3/projects/7e32b7fdc90b409e8479835137e2cbf9/users/c1a357e1dc5f4f3aaea970692bbd4bae/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:58.631729 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5910ac-e377-4ea1-bc9d-a90d1c421f92 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:58.648788 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5910ac-e377-4ea1-bc9d-a90d1c421f92 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:58.715382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15248fa2-62ad-4fa9-a24c-3bcab3e44ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:58.716222 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15248fa2-62ad-4fa9-a24c-3bcab3e44ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:58.716583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15248fa2-62ad-4fa9-a24c-3bcab3e44ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:58.717068 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15248fa2-62ad-4fa9-a24c-3bcab3e44ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:58.717794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15248fa2-62ad-4fa9-a24c-3bcab3e44ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:58.719464 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15248fa2-62ad-4fa9-a24c-3bcab3e44ab2 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:58.729555 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1120/2261] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:22:58.734585 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09083278-c4c3-487b-a97c-0369fad75dc4 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:22:58.745852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09083278-c4c3-487b-a97c-0369fad75dc4 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:22:58.751047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd7f35-ea2c-45e7-acdf-18dd816947b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:22:58.751941 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd7f35-ea2c-45e7-acdf-18dd816947b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:58.752225 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd7f35-ea2c-45e7-acdf-18dd816947b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:58.760518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd7f35-ea2c-45e7-acdf-18dd816947b7 admin admin] PATH_INFO: `/v3/projects/7e32b7fdc90b409e8479835137e2cbf9/users/c1a357e1dc5f4f3aaea970692bbd4bae/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:58.760518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd7f35-ea2c-45e7-acdf-18dd816947b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e32b7fdc90b409e8479835137e2cbf9, user_id=c1a357e1dc5f4f3aaea970692bbd4bae, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:22:58.760518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd7f35-ea2c-45e7-acdf-18dd816947b7 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:22:58.772276 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1142/2262] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:22:58 2022] PUT /identity/v3/projects/7e32b7fdc90b409e8479835137e2cbf9/users/c1a357e1dc5f4f3aaea970692bbd4bae/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:22:59.871545 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f274e2f-becc-4745-a0c1-4165c6f12d23 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:59.873044 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f274e2f-becc-4745-a0c1-4165c6f12d23 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:59.874479 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f274e2f-becc-4745-a0c1-4165c6f12d23 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:22:59.878612 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1121/2263] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 10 21:22:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:22:59.885577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6424b11-6a44-48d4-944a-327eb0e894d0 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:22:59.887275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6424b11-6a44-48d4-944a-327eb0e894d0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:22:59.887913 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6424b11-6a44-48d4-944a-327eb0e894d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:00.014353 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b6424b11-6a44-48d4-944a-327eb0e894d0 None None] MFA Rules not processed for user `c4c16a3b07c64a22bfc3df2a5a90c3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:23:00.014353 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b6424b11-6a44-48d4-944a-327eb0e894d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:00.109560 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1143/2264] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 10 21:22:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:23:00.130315 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f274e2f-becc-4745-a0c1-4165c6f12d23 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:00.130315 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-2f274e2f-becc-4745-a0c1-4165c6f12d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:00.317429 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f274e2f-becc-4745-a0c1-4165c6f12d23 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:00.325821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfe02b-c2bc-49a6-b336-3ceccd9139ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2b6514779d42fa81d34351607dea27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:00.326685 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfe02b-c2bc-49a6-b336-3ceccd9139ea service glance] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:00.327134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfe02b-c2bc-49a6-b336-3ceccd9139ea service glance] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:00.327586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfe02b-c2bc-49a6-b336-3ceccd9139ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:00.343096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfe02b-c2bc-49a6-b336-3ceccd9139ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:00.344598 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfe02b-c2bc-49a6-b336-3ceccd9139ea service glance] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:00.360346 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1122/2265] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:23:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:23:00.673250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a794b-9613-4068-8217-19a9994eb860 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:00.675056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a794b-9613-4068-8217-19a9994eb860 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:00.675056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a794b-9613-4068-8217-19a9994eb860 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:00.677137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1144/2266] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 10 21:23:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:23:00.682253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70ce33-a1e1-4229-820c-eee220e4d3b5 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:00.682574 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70ce33-a1e1-4229-820c-eee220e4d3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:00.682849 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70ce33-a1e1-4229-820c-eee220e4d3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:00.728636 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-db70ce33-a1e1-4229-820c-eee220e4d3b5 None None] MFA Rules not processed for user `2fa7da0ccf954be1a582411cdc617b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:23:00.738332 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-db70ce33-a1e1-4229-820c-eee220e4d3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:00.894172 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1123/2267] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 10 21:23:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:23:00.923202 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a794b-9613-4068-8217-19a9994eb860 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:00.925610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2d2a794b-9613-4068-8217-19a9994eb860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:00.957276 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a794b-9613-4068-8217-19a9994eb860 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:00.961107 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fba7a5-1a28-43c2-ba9f-13a108fe9239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:00.961770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fba7a5-1a28-43c2-ba9f-13a108fe9239 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:00.962108 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fba7a5-1a28-43c2-ba9f-13a108fe9239 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:00.962342 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fba7a5-1a28-43c2-ba9f-13a108fe9239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:00.980498 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fba7a5-1a28-43c2-ba9f-13a108fe9239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:00.982239 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fba7a5-1a28-43c2-ba9f-13a108fe9239 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:01.006865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1145/2268] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:23:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:23:01.189065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba94183-aeb8-46ef-ad51-1139f900793c None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:01.189391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba94183-aeb8-46ef-ad51-1139f900793c None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:01.189666 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba94183-aeb8-46ef-ad51-1139f900793c None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:01.191058 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1124/2269] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 10 21:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:23:01.201130 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410c3e5-e19c-4889-b453-2c319bdec67a None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:01.202029 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410c3e5-e19c-4889-b453-2c319bdec67a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:01.202487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410c3e5-e19c-4889-b453-2c319bdec67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:01.231970 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-0410c3e5-e19c-4889-b453-2c319bdec67a None None] MFA Rules not processed for user `c4c16a3b07c64a22bfc3df2a5a90c3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:23:01.234113 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0410c3e5-e19c-4889-b453-2c319bdec67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:01.245176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1146/2270] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 10 21:23:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:23:01.310101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba94183-aeb8-46ef-ad51-1139f900793c None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:01.332136 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba94183-aeb8-46ef-ad51-1139f900793c None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:01.336259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706ecf6-87a5-48fd-8eea-788e89d82265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:01.336908 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706ecf6-87a5-48fd-8eea-788e89d82265 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:01.337191 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706ecf6-87a5-48fd-8eea-788e89d82265 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:01.337650 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706ecf6-87a5-48fd-8eea-788e89d82265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:01.362311 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706ecf6-87a5-48fd-8eea-788e89d82265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:01.364195 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706ecf6-87a5-48fd-8eea-788e89d82265 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:01.396216 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1125/2271] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:23:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:23:01.722883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410c3e5-e19c-4889-b453-2c319bdec67a None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:01.812729 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410c3e5-e19c-4889-b453-2c319bdec67a None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:01.823323 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db90e8-2084-45d5-afee-6a44b3e87a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:01.824338 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db90e8-2084-45d5-afee-6a44b3e87a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:01.825007 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db90e8-2084-45d5-afee-6a44b3e87a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:01.825307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db90e8-2084-45d5-afee-6a44b3e87a28 admin admin] PATH_INFO: `/v3/users/a74f11c1224e45388bec4f5927e6a43b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:01.828771 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db90e8-2084-45d5-afee-6a44b3e87a28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a74f11c1224e45388bec4f5927e6a43b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:01.833777 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db90e8-2084-45d5-afee-6a44b3e87a28 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:02.034230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b6db90e8-2084-45d5-afee-6a44b3e87a28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a74f11c1224e45388bec4f5927e6a43b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:02.035046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b6db90e8-2084-45d5-afee-6a44b3e87a28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a74f11c1224e45388bec4f5927e6a43b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:02.035673 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b6db90e8-2084-45d5-afee-6a44b3e87a28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a74f11c1224e45388bec4f5927e6a43b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:02.062272 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b6db90e8-2084-45d5-afee-6a44b3e87a28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a74f11c1224e45388bec4f5927e6a43b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:02.071526 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b6db90e8-2084-45d5-afee-6a44b3e87a28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a74f11c1224e45388bec4f5927e6a43b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:02.213495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7cf12-f394-46c8-80f2-0a90dc699691 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:02.214451 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7cf12-f394-46c8-80f2-0a90dc699691 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:02.214901 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7cf12-f394-46c8-80f2-0a90dc699691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:02.216572 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1147/2272] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:23:01 2022] DELETE /identity/v3/users/a74f11c1224e45388bec4f5927e6a43b => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:23:02.240231 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-afd7cf12-f394-46c8-80f2-0a90dc699691 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:23:02.242291 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-afd7cf12-f394-46c8-80f2-0a90dc699691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:02.325800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1126/2273] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:23:02.342696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db90e8-2084-45d5-afee-6a44b3e87a28 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:02.345236 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b6db90e8-2084-45d5-afee-6a44b3e87a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:02.446775 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db90e8-2084-45d5-afee-6a44b3e87a28 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:02.453809 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e84cd-5723-44f1-81f6-94d5db9624e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:02.454920 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e84cd-5723-44f1-81f6-94d5db9624e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:02.455209 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e84cd-5723-44f1-81f6-94d5db9624e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:02.455487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e84cd-5723-44f1-81f6-94d5db9624e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:02.472355 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e84cd-5723-44f1-81f6-94d5db9624e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:02.473943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e84cd-5723-44f1-81f6-94d5db9624e5 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:02.487618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1148/2274] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:23:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:23:03.537643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7cf12-f394-46c8-80f2-0a90dc699691 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:03.540006 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-afd7cf12-f394-46c8-80f2-0a90dc699691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:03.565727 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7cf12-f394-46c8-80f2-0a90dc699691 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:03.579420 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988ec84-c422-4333-81b3-f5efe7c2c637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:03.583601 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988ec84-c422-4333-81b3-f5efe7c2c637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:03.584237 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988ec84-c422-4333-81b3-f5efe7c2c637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:03.584382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988ec84-c422-4333-81b3-f5efe7c2c637 admin admin] PATH_INFO: `/v3/projects/a21d64ebb9f844ebb1398e83dac91403` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:03.587928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988ec84-c422-4333-81b3-f5efe7c2c637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a21d64ebb9f844ebb1398e83dac91403)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:03.589988 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988ec84-c422-4333-81b3-f5efe7c2c637 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:03.777838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7988ec84-c422-4333-81b3-f5efe7c2c637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21d64ebb9f844ebb1398e83dac91403', 'request_id': 'req-7988ec84-c422-4333-81b3-f5efe7c2c637'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:03.871838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7988ec84-c422-4333-81b3-f5efe7c2c637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21d64ebb9f844ebb1398e83dac91403', 'request_id': 'req-7988ec84-c422-4333-81b3-f5efe7c2c637'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:03.879351 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7988ec84-c422-4333-81b3-f5efe7c2c637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21d64ebb9f844ebb1398e83dac91403', 'request_id': 'req-7988ec84-c422-4333-81b3-f5efe7c2c637'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:03.893384 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7988ec84-c422-4333-81b3-f5efe7c2c637 admin admin] The token cache is being invalidate because project a21d64ebb9f844ebb1398e83dac91403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:23:03.893930 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7988ec84-c422-4333-81b3-f5efe7c2c637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:03.894824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7988ec84-c422-4333-81b3-f5efe7c2c637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:03.896475 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1127/2275] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:23:03 2022] DELETE /identity/v3/projects/a21d64ebb9f844ebb1398e83dac91403 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:23:03.904158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e84cd-5723-44f1-81f6-94d5db9624e5 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:03.913617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e84cd-5723-44f1-81f6-94d5db9624e5 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:04.051791 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4d8b8-cd01-4e7a-89a5-e9e801b31722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:04.052768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4d8b8-cd01-4e7a-89a5-e9e801b31722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:04.053095 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4d8b8-cd01-4e7a-89a5-e9e801b31722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:04.053372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4d8b8-cd01-4e7a-89a5-e9e801b31722 admin admin] PATH_INFO: `/v3/users/372a2339a9774dc598db9032ac6e1e4f` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:04.054650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4d8b8-cd01-4e7a-89a5-e9e801b31722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=372a2339a9774dc598db9032ac6e1e4f)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:04.056605 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4d8b8-cd01-4e7a-89a5-e9e801b31722 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:04.279121 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-adc4d8b8-cd01-4e7a-89a5-e9e801b31722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '372a2339a9774dc598db9032ac6e1e4f'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:04.279873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-adc4d8b8-cd01-4e7a-89a5-e9e801b31722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '372a2339a9774dc598db9032ac6e1e4f'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:04.280581 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-adc4d8b8-cd01-4e7a-89a5-e9e801b31722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '372a2339a9774dc598db9032ac6e1e4f'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:04.305098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-adc4d8b8-cd01-4e7a-89a5-e9e801b31722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '372a2339a9774dc598db9032ac6e1e4f'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:04.315897 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-adc4d8b8-cd01-4e7a-89a5-e9e801b31722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '372a2339a9774dc598db9032ac6e1e4f'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:04.445085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1149/2276] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:23:03 2022] DELETE /identity/v3/users/372a2339a9774dc598db9032ac6e1e4f => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:23:04.632586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988ec84-c422-4333-81b3-f5efe7c2c637 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:04.633766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-7988ec84-c422-4333-81b3-f5efe7c2c637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:04.663086 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988ec84-c422-4333-81b3-f5efe7c2c637 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:04.796329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4feeca-1334-4160-ba5a-64b5caadc20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:04.797307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4feeca-1334-4160-ba5a-64b5caadc20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:04.797599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4feeca-1334-4160-ba5a-64b5caadc20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:04.797883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4feeca-1334-4160-ba5a-64b5caadc20a admin admin] PATH_INFO: `/v3/users/76a9648345304db88a007eb8b604c418` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:04.808122 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4feeca-1334-4160-ba5a-64b5caadc20a admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a9648345304db88a007eb8b604c418)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:04.811032 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4feeca-1334-4160-ba5a-64b5caadc20a admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:05.071995 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-0e4feeca-1334-4160-ba5a-64b5caadc20a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a9648345304db88a007eb8b604c418'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:05.073033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-0e4feeca-1334-4160-ba5a-64b5caadc20a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a9648345304db88a007eb8b604c418'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:05.087499 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-0e4feeca-1334-4160-ba5a-64b5caadc20a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a9648345304db88a007eb8b604c418'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:05.091610 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-0e4feeca-1334-4160-ba5a-64b5caadc20a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a9648345304db88a007eb8b604c418'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:05.095707 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-0e4feeca-1334-4160-ba5a-64b5caadc20a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a9648345304db88a007eb8b604c418'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:05.168798 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4d8b8-cd01-4e7a-89a5-e9e801b31722 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:05.171708 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-adc4d8b8-cd01-4e7a-89a5-e9e801b31722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:05.183643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1128/2277] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:23:04 2022] DELETE /identity/v3/users/76a9648345304db88a007eb8b604c418 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:23:05.189258 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb212d5-2b56-402b-a42f-c24d51b7ecbd None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:05.189567 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb212d5-2b56-402b-a42f-c24d51b7ecbd None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:05.189856 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb212d5-2b56-402b-a42f-c24d51b7ecbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:05.214006 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4d8b8-cd01-4e7a-89a5-e9e801b31722 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:05.230182 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-fcb212d5-2b56-402b-a42f-c24d51b7ecbd None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:23:05.231987 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-fcb212d5-2b56-402b-a42f-c24d51b7ecbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:05.348337 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b8647-86c2-4827-8c32-2d8abba2ba15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:05.349229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8647-86c2-4827-8c32-2d8abba2ba15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:05.350716 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8647-86c2-4827-8c32-2d8abba2ba15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:05.351006 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8647-86c2-4827-8c32-2d8abba2ba15 admin admin] PATH_INFO: `/v3/projects/7b1b06e0dc85427f84e0643b0e0ed0cf` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:05.353411 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b8647-86c2-4827-8c32-2d8abba2ba15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b1b06e0dc85427f84e0643b0e0ed0cf)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:05.355724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b8647-86c2-4827-8c32-2d8abba2ba15 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:05.363294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1129/2278] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:23:05.370029 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb212d5-2b56-402b-a42f-c24d51b7ecbd None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:05.371529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-fcb212d5-2b56-402b-a42f-c24d51b7ecbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:05.463409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ae7b8647-86c2-4827-8c32-2d8abba2ba15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b1b06e0dc85427f84e0643b0e0ed0cf', 'request_id': 'req-ae7b8647-86c2-4827-8c32-2d8abba2ba15'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:05.477155 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb212d5-2b56-402b-a42f-c24d51b7ecbd None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:05.539805 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ae7b8647-86c2-4827-8c32-2d8abba2ba15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b1b06e0dc85427f84e0643b0e0ed0cf', 'request_id': 'req-ae7b8647-86c2-4827-8c32-2d8abba2ba15'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:05.550741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ae7b8647-86c2-4827-8c32-2d8abba2ba15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b1b06e0dc85427f84e0643b0e0ed0cf', 'request_id': 'req-ae7b8647-86c2-4827-8c32-2d8abba2ba15'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:05.562336 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd521aa-a7cb-40c7-a82b-27db072c5da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:05.563178 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd521aa-a7cb-40c7-a82b-27db072c5da1 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:05.563473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd521aa-a7cb-40c7-a82b-27db072c5da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:05.563754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd521aa-a7cb-40c7-a82b-27db072c5da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:05.569281 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ae7b8647-86c2-4827-8c32-2d8abba2ba15 admin admin] The token cache is being invalidate because project 7b1b06e0dc85427f84e0643b0e0ed0cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:23:05.569860 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ae7b8647-86c2-4827-8c32-2d8abba2ba15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:05.571335 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ae7b8647-86c2-4827-8c32-2d8abba2ba15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:05.573511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1150/2279] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:23:05 2022] DELETE /identity/v3/projects/7b1b06e0dc85427f84e0643b0e0ed0cf => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:23:05.578904 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b8647-86c2-4827-8c32-2d8abba2ba15 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:05.580609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ae7b8647-86c2-4827-8c32-2d8abba2ba15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:05.665960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd521aa-a7cb-40c7-a82b-27db072c5da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:05.668083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd521aa-a7cb-40c7-a82b-27db072c5da1 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:05.683457 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1130/2280] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:23:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:23:05.718593 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b8647-86c2-4827-8c32-2d8abba2ba15 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:05.735248 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdc1db-d31a-4cad-8408-e2d8c5c4bba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:05.736221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdc1db-d31a-4cad-8408-e2d8c5c4bba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:05.736635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdc1db-d31a-4cad-8408-e2d8c5c4bba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:05.736814 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdc1db-d31a-4cad-8408-e2d8c5c4bba1 admin admin] PATH_INFO: `/v3/users/cd0b86115cb7422c8647679009e03fb8` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:05.738558 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fdc1db-d31a-4cad-8408-e2d8c5c4bba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd0b86115cb7422c8647679009e03fb8)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:05.740480 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fdc1db-d31a-4cad-8408-e2d8c5c4bba1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:05.959388 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e6fdc1db-d31a-4cad-8408-e2d8c5c4bba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd0b86115cb7422c8647679009e03fb8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:05.960543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e6fdc1db-d31a-4cad-8408-e2d8c5c4bba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd0b86115cb7422c8647679009e03fb8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:05.963786 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e6fdc1db-d31a-4cad-8408-e2d8c5c4bba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd0b86115cb7422c8647679009e03fb8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:05.990243 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e6fdc1db-d31a-4cad-8408-e2d8c5c4bba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd0b86115cb7422c8647679009e03fb8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:05.999811 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e6fdc1db-d31a-4cad-8408-e2d8c5c4bba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd0b86115cb7422c8647679009e03fb8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:06.091819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1151/2281] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:23:05 2022] DELETE /identity/v3/users/cd0b86115cb7422c8647679009e03fb8 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:23:06.603850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd521aa-a7cb-40c7-a82b-27db072c5da1 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:06.605527 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-2cd521aa-a7cb-40c7-a82b-27db072c5da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:06.649686 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd521aa-a7cb-40c7-a82b-27db072c5da1 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:06.766989 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d6b67-2b3c-4d53-b6c7-9b8cda4f768f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:06.769329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d6b67-2b3c-4d53-b6c7-9b8cda4f768f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:06.769781 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d6b67-2b3c-4d53-b6c7-9b8cda4f768f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:06.770807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d6b67-2b3c-4d53-b6c7-9b8cda4f768f admin admin] PATH_INFO: `/v3/projects/1f67ba024fe746e48cc30d2803fbf2c8` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:06.774358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d6b67-2b3c-4d53-b6c7-9b8cda4f768f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f67ba024fe746e48cc30d2803fbf2c8)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:06.781602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d6b67-2b3c-4d53-b6c7-9b8cda4f768f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:06.956060 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-392d6b67-2b3c-4d53-b6c7-9b8cda4f768f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f67ba024fe746e48cc30d2803fbf2c8', 'request_id': 'req-392d6b67-2b3c-4d53-b6c7-9b8cda4f768f'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:06.987976 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdc1db-d31a-4cad-8408-e2d8c5c4bba1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:06.995323 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e6fdc1db-d31a-4cad-8408-e2d8c5c4bba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:07.012218 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdc1db-d31a-4cad-8408-e2d8c5c4bba1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:07.038956 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-392d6b67-2b3c-4d53-b6c7-9b8cda4f768f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f67ba024fe746e48cc30d2803fbf2c8', 'request_id': 'req-392d6b67-2b3c-4d53-b6c7-9b8cda4f768f'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:07.050036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-392d6b67-2b3c-4d53-b6c7-9b8cda4f768f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f67ba024fe746e48cc30d2803fbf2c8', 'request_id': 'req-392d6b67-2b3c-4d53-b6c7-9b8cda4f768f'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:07.068512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-392d6b67-2b3c-4d53-b6c7-9b8cda4f768f admin admin] The token cache is being invalidate because project 1f67ba024fe746e48cc30d2803fbf2c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:23:07.068816 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-392d6b67-2b3c-4d53-b6c7-9b8cda4f768f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:07.069490 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-392d6b67-2b3c-4d53-b6c7-9b8cda4f768f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:07.081251 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1131/2282] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:23:06 2022] DELETE /identity/v3/projects/1f67ba024fe746e48cc30d2803fbf2c8 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:23:07.235662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4c835-28cb-4292-b632-bb9497a7d8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:07.239555 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4c835-28cb-4292-b632-bb9497a7d8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:07.239555 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4c835-28cb-4292-b632-bb9497a7d8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:07.239555 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4c835-28cb-4292-b632-bb9497a7d8c8 admin admin] PATH_INFO: `/v3/projects/aabdc29aa753410aaf7c11021f212ec0` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:07.239555 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4c835-28cb-4292-b632-bb9497a7d8c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aabdc29aa753410aaf7c11021f212ec0)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:07.241336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4c835-28cb-4292-b632-bb9497a7d8c8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:07.307872 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33996375-ac05-4fa0-a3eb-6412658550f0 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:07.308607 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33996375-ac05-4fa0-a3eb-6412658550f0 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:07.309061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33996375-ac05-4fa0-a3eb-6412658550f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:07.393179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-33996375-ac05-4fa0-a3eb-6412658550f0 None None] MFA Rules not processed for user `c0fc3052af194b48b7ce036ff605ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:23:07.394232 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-33996375-ac05-4fa0-a3eb-6412658550f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:07.402866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-28c4c835-28cb-4292-b632-bb9497a7d8c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aabdc29aa753410aaf7c11021f212ec0', 'request_id': 'req-28c4c835-28cb-4292-b632-bb9497a7d8c8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:07.511685 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1132/2283] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 10 21:23:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:23:07.525454 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33996375-ac05-4fa0-a3eb-6412658550f0 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:07.527965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-28c4c835-28cb-4292-b632-bb9497a7d8c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aabdc29aa753410aaf7c11021f212ec0', 'request_id': 'req-28c4c835-28cb-4292-b632-bb9497a7d8c8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:07.528606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-33996375-ac05-4fa0-a3eb-6412658550f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:07.535995 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-28c4c835-28cb-4292-b632-bb9497a7d8c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aabdc29aa753410aaf7c11021f212ec0', 'request_id': 'req-28c4c835-28cb-4292-b632-bb9497a7d8c8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:07.570410 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-28c4c835-28cb-4292-b632-bb9497a7d8c8 admin admin] The token cache is being invalidate because project aabdc29aa753410aaf7c11021f212ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:23:07.573454 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-28c4c835-28cb-4292-b632-bb9497a7d8c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:07.576097 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-28c4c835-28cb-4292-b632-bb9497a7d8c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:07.580356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1152/2284] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:23:06 2022] DELETE /identity/v3/projects/aabdc29aa753410aaf7c11021f212ec0 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:23:07.596082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138771e8-5626-400f-a1ae-f74b106c9f5b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:07.596388 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138771e8-5626-400f-a1ae-f74b106c9f5b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:07.596677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138771e8-5626-400f-a1ae-f74b106c9f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:07.643075 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-138771e8-5626-400f-a1ae-f74b106c9f5b None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:23:07.645407 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-138771e8-5626-400f-a1ae-f74b106c9f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:07.730224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33996375-ac05-4fa0-a3eb-6412658550f0 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:07.737244 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ed043-7377-4c11-8c2e-8237debabd97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76040882d4374087bb7458fd8b5c1d8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:07.738038 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ed043-7377-4c11-8c2e-8237debabd97 service swift] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:07.738510 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ed043-7377-4c11-8c2e-8237debabd97 service swift] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:07.739036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ed043-7377-4c11-8c2e-8237debabd97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:07.741678 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-272ed043-7377-4c11-8c2e-8237debabd97 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:07.744522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1153/2285] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:23:07.754563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1d85f-ac71-46b7-8b8a-6f20ea866c4f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:07.758681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1d85f-ac71-46b7-8b8a-6f20ea866c4f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:07.758681 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1d85f-ac71-46b7-8b8a-6f20ea866c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:07.761134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ed043-7377-4c11-8c2e-8237debabd97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:07.764280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ed043-7377-4c11-8c2e-8237debabd97 service swift] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:07.774071 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1133/2286] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 10 21:23:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 21:23:07.778786 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-11e1d85f-ac71-46b7-8b8a-6f20ea866c4f None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:23:07.780023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-11e1d85f-ac71-46b7-8b8a-6f20ea866c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:07.791564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1154/2287] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:23:07.794517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ed043-7377-4c11-8c2e-8237debabd97 service swift] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:07.806795 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ed043-7377-4c11-8c2e-8237debabd97 service swift] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:07.812097 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93224968-a607-45b7-bea7-97301ba6664c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:07.813043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93224968-a607-45b7-bea7-97301ba6664c admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:07.815656 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93224968-a607-45b7-bea7-97301ba6664c admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:07.815656 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93224968-a607-45b7-bea7-97301ba6664c admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:07.815656 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93224968-a607-45b7-bea7-97301ba6664c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:23:07.815656 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93224968-a607-45b7-bea7-97301ba6664c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:07.816938 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93224968-a607-45b7-bea7-97301ba6664c admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:07.844134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1d85f-ac71-46b7-8b8a-6f20ea866c4f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:07.848876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1134/2288] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:23:07.852791 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1d85f-ac71-46b7-8b8a-6f20ea866c4f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:07.874262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4d52e-12fa-48f0-b40f-925bb6808ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:07.874262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4d52e-12fa-48f0-b40f-925bb6808ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:07.874262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4d52e-12fa-48f0-b40f-925bb6808ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:07.875063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4d52e-12fa-48f0-b40f-925bb6808ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:07.875839 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4d52e-12fa-48f0-b40f-925bb6808ba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:07.875975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454923da-c794-4669-ac70-efad490c1759 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:07.876176 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454923da-c794-4669-ac70-efad490c1759 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:07.876493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454923da-c794-4669-ac70-efad490c1759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:07.878276 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4d52e-12fa-48f0-b40f-925bb6808ba1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:07.939462 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-454923da-c794-4669-ac70-efad490c1759 None None] MFA Rules not processed for user `c1a357e1dc5f4f3aaea970692bbd4bae`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:23:07.942056 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-454923da-c794-4669-ac70-efad490c1759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:07.966849 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1155/2289] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:23:07 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:23:07.972134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4d52e-12fa-48f0-b40f-925bb6808ba1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:08.087692 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4d52e-12fa-48f0-b40f-925bb6808ba1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:08.087692 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eed31f-c5fa-4f9c-a1cc-51195e2d7afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:08.088963 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed31f-c5fa-4f9c-a1cc-51195e2d7afd admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:08.089472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed31f-c5fa-4f9c-a1cc-51195e2d7afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:08.089749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed31f-c5fa-4f9c-a1cc-51195e2d7afd admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:08.090621 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eed31f-c5fa-4f9c-a1cc-51195e2d7afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:08.094345 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eed31f-c5fa-4f9c-a1cc-51195e2d7afd admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:08.132010 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1135/2290] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:23:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:23:08.148587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454923da-c794-4669-ac70-efad490c1759 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:08.151304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-454923da-c794-4669-ac70-efad490c1759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:08.220555 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1156/2291] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:23:07 2022] POST /identity/v3/users => generated 291 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:23:08.224423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454923da-c794-4669-ac70-efad490c1759 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:08.225011 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eed31f-c5fa-4f9c-a1cc-51195e2d7afd admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:08.239455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eed31f-c5fa-4f9c-a1cc-51195e2d7afd admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:08.257100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0bcfe-df60-4b24-95b4-97882b4c4c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:08.258099 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0bcfe-df60-4b24-95b4-97882b4c4c77 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:08.258566 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0bcfe-df60-4b24-95b4-97882b4c4c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:08.259002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0bcfe-df60-4b24-95b4-97882b4c4c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:08.259897 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0bcfe-df60-4b24-95b4-97882b4c4c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:08.261917 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0bcfe-df60-4b24-95b4-97882b4c4c77 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:08.275590 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1157/2292] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:23:08.279652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0bcfe-df60-4b24-95b4-97882b4c4c77 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:08.290650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0bcfe-df60-4b24-95b4-97882b4c4c77 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:08.292436 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a9c32-60b5-4288-9be8-85ff166ad379 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2b6514779d42fa81d34351607dea27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:08.293243 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a9c32-60b5-4288-9be8-85ff166ad379 service glance] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:08.293530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a9c32-60b5-4288-9be8-85ff166ad379 service glance] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:08.293830 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a9c32-60b5-4288-9be8-85ff166ad379 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:08.296476 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-218a9c32-60b5-4288-9be8-85ff166ad379 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:08.297752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639aca2-e580-452d-ba5c-65e3675aa146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:08.298777 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639aca2-e580-452d-ba5c-65e3675aa146 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:08.299319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639aca2-e580-452d-ba5c-65e3675aa146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:08.299881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639aca2-e580-452d-ba5c-65e3675aa146 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:08.300912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639aca2-e580-452d-ba5c-65e3675aa146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:08.302857 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639aca2-e580-452d-ba5c-65e3675aa146 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:08.314654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1158/2293] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:23:08.318485 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639aca2-e580-452d-ba5c-65e3675aa146 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:08.329487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639aca2-e580-452d-ba5c-65e3675aa146 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:08.335028 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5dba4-45a6-4c31-a825-3ef9bad1e549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:08.335917 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5dba4-45a6-4c31-a825-3ef9bad1e549 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:08.336211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5dba4-45a6-4c31-a825-3ef9bad1e549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:08.336489 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5dba4-45a6-4c31-a825-3ef9bad1e549 admin admin] PATH_INFO: `/v3/projects/ca1478200123452d80131afb7f7ab6e3/users/46ff4d8da5764a78aa93c34e7cc6fbaf/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:08.352599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5dba4-45a6-4c31-a825-3ef9bad1e549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1478200123452d80131afb7f7ab6e3, user_id=46ff4d8da5764a78aa93c34e7cc6fbaf, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:08.355295 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5dba4-45a6-4c31-a825-3ef9bad1e549 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:08.363239 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a9c32-60b5-4288-9be8-85ff166ad379 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:08.364681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a9c32-60b5-4288-9be8-85ff166ad379 service glance] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:08.375381 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1136/2294] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:23:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:23:08.413726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1159/2295] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:23:08 2022] PUT /identity/v3/projects/ca1478200123452d80131afb7f7ab6e3/users/46ff4d8da5764a78aa93c34e7cc6fbaf/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:23:08.429948 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a1879-c196-41d6-ac36-9a2af038efb5 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:08.430382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a1879-c196-41d6-ac36-9a2af038efb5 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:08.430746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a1879-c196-41d6-ac36-9a2af038efb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:08.478492 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-5a6a1879-c196-41d6-ac36-9a2af038efb5 None None] MFA Rules not processed for user `46ff4d8da5764a78aa93c34e7cc6fbaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:23:08.479716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-5a6a1879-c196-41d6-ac36-9a2af038efb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:08.605984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1137/2296] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:23:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:23:08.619173 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5dba4-45a6-4c31-a825-3ef9bad1e549 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:08.621125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-19e5dba4-45a6-4c31-a825-3ef9bad1e549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:08.663599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb6e74-7651-4eca-ac0d-ef7497cc0158 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:08.663968 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb6e74-7651-4eca-ac0d-ef7497cc0158 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:08.664239 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb6e74-7651-4eca-ac0d-ef7497cc0158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:08.686933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-8deb6e74-7651-4eca-ac0d-ef7497cc0158 None None] MFA Rules not processed for user `c0fc3052af194b48b7ce036ff605ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:23:08.688366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-8deb6e74-7651-4eca-ac0d-ef7497cc0158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:08.750189 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5dba4-45a6-4c31-a825-3ef9bad1e549 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:08.764557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309ffd4-6174-43a7-9c75-056e22ece9e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:08.765509 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309ffd4-6174-43a7-9c75-056e22ece9e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:08.765792 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309ffd4-6174-43a7-9c75-056e22ece9e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:08.766142 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309ffd4-6174-43a7-9c75-056e22ece9e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:08.785801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309ffd4-6174-43a7-9c75-056e22ece9e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:08.787378 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309ffd4-6174-43a7-9c75-056e22ece9e6 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:08.807696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1160/2297] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:23:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:23:08.846486 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309ffd4-6174-43a7-9c75-056e22ece9e6 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:08.885306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1138/2298] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 10 21:23:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:23:08.935080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb6e74-7651-4eca-ac0d-ef7497cc0158 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:08.936800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-8deb6e74-7651-4eca-ac0d-ef7497cc0158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:08.992317 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309ffd4-6174-43a7-9c75-056e22ece9e6 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:09.012574 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d4e4d-2833-48ae-b244-a7165e722932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:09.015103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d4e4d-2833-48ae-b244-a7165e722932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:09.016884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d4e4d-2833-48ae-b244-a7165e722932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:09.017259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d4e4d-2833-48ae-b244-a7165e722932 admin admin] PATH_INFO: `/v3/users/46ff4d8da5764a78aa93c34e7cc6fbaf` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:09.020636 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d4e4d-2833-48ae-b244-a7165e722932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ff4d8da5764a78aa93c34e7cc6fbaf)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:09.025478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d4e4d-2833-48ae-b244-a7165e722932 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:09.094213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb6e74-7651-4eca-ac0d-ef7497cc0158 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:09.101037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c832651-41f9-43ab-9ce8-00a37cb44aa8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76040882d4374087bb7458fd8b5c1d8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:09.101912 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c832651-41f9-43ab-9ce8-00a37cb44aa8 service swift] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:09.102234 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c832651-41f9-43ab-9ce8-00a37cb44aa8 service swift] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:09.102767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c832651-41f9-43ab-9ce8-00a37cb44aa8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:09.114707 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c832651-41f9-43ab-9ce8-00a37cb44aa8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:09.117057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c832651-41f9-43ab-9ce8-00a37cb44aa8 service swift] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:09.133729 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1139/2299] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 10 21:23:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 21:23:09.308588 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-303d4e4d-2833-48ae-b244-a7165e722932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ff4d8da5764a78aa93c34e7cc6fbaf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:09.311626 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-303d4e4d-2833-48ae-b244-a7165e722932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ff4d8da5764a78aa93c34e7cc6fbaf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:09.313902 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-303d4e4d-2833-48ae-b244-a7165e722932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ff4d8da5764a78aa93c34e7cc6fbaf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:09.371627 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-303d4e4d-2833-48ae-b244-a7165e722932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ff4d8da5764a78aa93c34e7cc6fbaf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:09.397621 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-303d4e4d-2833-48ae-b244-a7165e722932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ff4d8da5764a78aa93c34e7cc6fbaf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:09.517484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1161/2300] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:23:08 2022] DELETE /identity/v3/users/46ff4d8da5764a78aa93c34e7cc6fbaf => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:23:09.523311 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3ef16-a678-4546-bce2-c879a3b93939 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:09.523948 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3ef16-a678-4546-bce2-c879a3b93939 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:09.524440 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3ef16-a678-4546-bce2-c879a3b93939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:09.583205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-b5a3ef16-a678-4546-bce2-c879a3b93939 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:23:09.584747 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-b5a3ef16-a678-4546-bce2-c879a3b93939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:09.736213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1140/2301] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:23:09.754834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d4e4d-2833-48ae-b244-a7165e722932 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:09.756680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-303d4e4d-2833-48ae-b244-a7165e722932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:09.913715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d4e4d-2833-48ae-b244-a7165e722932 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:09.922931 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a93ba9-9b55-413e-b301-986f87b34de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:09.926474 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a93ba9-9b55-413e-b301-986f87b34de8 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:09.926474 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a93ba9-9b55-413e-b301-986f87b34de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:09.926474 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a93ba9-9b55-413e-b301-986f87b34de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:09.945035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a93ba9-9b55-413e-b301-986f87b34de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:09.949144 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a93ba9-9b55-413e-b301-986f87b34de8 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:09.972648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1162/2302] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:23:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:23:11.142945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3ef16-a678-4546-bce2-c879a3b93939 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:11.149342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-b5a3ef16-a678-4546-bce2-c879a3b93939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:11.216959 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3ef16-a678-4546-bce2-c879a3b93939 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:11.241472 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442741e-dee9-48b6-b6aa-1b26911ba3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:11.242383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442741e-dee9-48b6-b6aa-1b26911ba3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:11.242726 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442741e-dee9-48b6-b6aa-1b26911ba3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:11.247247 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442741e-dee9-48b6-b6aa-1b26911ba3ee admin admin] PATH_INFO: `/v3/projects/ca1478200123452d80131afb7f7ab6e3` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:11.252000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442741e-dee9-48b6-b6aa-1b26911ba3ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1478200123452d80131afb7f7ab6e3)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:11.258876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442741e-dee9-48b6-b6aa-1b26911ba3ee admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:11.445964 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e442741e-dee9-48b6-b6aa-1b26911ba3ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1478200123452d80131afb7f7ab6e3', 'request_id': 'req-e442741e-dee9-48b6-b6aa-1b26911ba3ee'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:11.520028 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e442741e-dee9-48b6-b6aa-1b26911ba3ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1478200123452d80131afb7f7ab6e3', 'request_id': 'req-e442741e-dee9-48b6-b6aa-1b26911ba3ee'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:11.532750 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e442741e-dee9-48b6-b6aa-1b26911ba3ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1478200123452d80131afb7f7ab6e3', 'request_id': 'req-e442741e-dee9-48b6-b6aa-1b26911ba3ee'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:11.565414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e442741e-dee9-48b6-b6aa-1b26911ba3ee admin admin] The token cache is being invalidate because project ca1478200123452d80131afb7f7ab6e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:23:11.565849 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e442741e-dee9-48b6-b6aa-1b26911ba3ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:11.568792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e442741e-dee9-48b6-b6aa-1b26911ba3ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:23:11.586647 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1141/2303] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:23:11 2022] DELETE /identity/v3/projects/ca1478200123452d80131afb7f7ab6e3 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:23:22.007505 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a7fc7-76fc-4e5a-b7c4-32803a85d734 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:22.008149 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a7fc7-76fc-4e5a-b7c4-32803a85d734 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:22.008149 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a7fc7-76fc-4e5a-b7c4-32803a85d734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:22.025839 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-961a7fc7-76fc-4e5a-b7c4-32803a85d734 None None] MFA Rules not processed for user `cee2a53cb70b4281bb49e39d70abfaa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:23:22.027079 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-961a7fc7-76fc-4e5a-b7c4-32803a85d734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:22.083781 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1163/2304] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:23:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:23:24.065343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442741e-dee9-48b6-b6aa-1b26911ba3ee admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:24.066782 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e442741e-dee9-48b6-b6aa-1b26911ba3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:24.157356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442741e-dee9-48b6-b6aa-1b26911ba3ee admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:24.162612 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7aef2-21e0-4471-b8ec-456f1c841f68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a13ad1e10ff44c4b870b45b7416b70f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:24.163259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7aef2-21e0-4471-b8ec-456f1c841f68 service placement] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:24.163542 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7aef2-21e0-4471-b8ec-456f1c841f68 service placement] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:24.163825 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7aef2-21e0-4471-b8ec-456f1c841f68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:24.165588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-61b7aef2-21e0-4471-b8ec-456f1c841f68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:24.178151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7aef2-21e0-4471-b8ec-456f1c841f68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:24.179770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7aef2-21e0-4471-b8ec-456f1c841f68 service placement] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:24.190343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1142/2305] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:23:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:23:25.611940 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfc40a-0440-4174-b263-9563ab20a0a9 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:25.612427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfc40a-0440-4174-b263-9563ab20a0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:25.612530 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfc40a-0440-4174-b263-9563ab20a0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:25.629982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b6dfc40a-0440-4174-b263-9563ab20a0a9 None None] MFA Rules not processed for user `c0fc3052af194b48b7ce036ff605ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:23:25.631222 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b6dfc40a-0440-4174-b263-9563ab20a0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:25.688958 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1164/2306] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 10 21:23:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:23:25.708373 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7aef2-21e0-4471-b8ec-456f1c841f68 service placement] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:25.709783 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-61b7aef2-21e0-4471-b8ec-456f1c841f68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:25.778599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7aef2-21e0-4471-b8ec-456f1c841f68 service placement] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:25.784347 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5b7ed-036b-4034-aa71-f505575f063c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76040882d4374087bb7458fd8b5c1d8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:25.784999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5b7ed-036b-4034-aa71-f505575f063c service swift] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:25.786413 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5b7ed-036b-4034-aa71-f505575f063c service swift] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:25.786413 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5b7ed-036b-4034-aa71-f505575f063c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:25.794890 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5b7ed-036b-4034-aa71-f505575f063c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:25.796506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5b7ed-036b-4034-aa71-f505575f063c service swift] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:25.804671 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1143/2307] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 10 21:23:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 21:23:43.104936 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cc922-ad43-4854-83ba-2bd996029af0 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:43.105461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cc922-ad43-4854-83ba-2bd996029af0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:43.105567 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cc922-ad43-4854-83ba-2bd996029af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:43.123340 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8d0cc922-ad43-4854-83ba-2bd996029af0 None None] MFA Rules not processed for user `c0fc3052af194b48b7ce036ff605ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:23:43.124544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8d0cc922-ad43-4854-83ba-2bd996029af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:43.132622 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1165/2308] 10.222.0.25 () {58 vars in 967 bytes} [Tue May 10 21:23:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:23:43.156465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5b7ed-036b-4034-aa71-f505575f063c service swift] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:43.167576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5b7ed-036b-4034-aa71-f505575f063c service swift] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:43.172676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be6419-33b2-4a90-a368-6a3985767f8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76040882d4374087bb7458fd8b5c1d8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:43.173330 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be6419-33b2-4a90-a368-6a3985767f8d service swift] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:43.173618 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be6419-33b2-4a90-a368-6a3985767f8d service swift] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:43.173900 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be6419-33b2-4a90-a368-6a3985767f8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:43.183114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be6419-33b2-4a90-a368-6a3985767f8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:43.184738 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be6419-33b2-4a90-a368-6a3985767f8d service swift] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:43.193428 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1144/2309] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 10 21:23:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 21:23:57.967753 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cc922-ad43-4854-83ba-2bd996029af0 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:57.969291 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8d0cc922-ad43-4854-83ba-2bd996029af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:58.025852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cc922-ad43-4854-83ba-2bd996029af0 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:58.029385 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0fb44-6f09-415b-916b-2c46da6ed7a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:58.030069 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0fb44-6f09-415b-916b-2c46da6ed7a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:58.030352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0fb44-6f09-415b-916b-2c46da6ed7a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:58.030667 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0fb44-6f09-415b-916b-2c46da6ed7a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:58.032469 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-aeb0fb44-6f09-415b-916b-2c46da6ed7a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:58.093958 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0fb44-6f09-415b-916b-2c46da6ed7a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:58.095422 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0fb44-6f09-415b-916b-2c46da6ed7a2 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:58.106073 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1166/2310] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:23:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:24:13.968344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128418e-2935-4963-8670-bc649f5b99b4 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:24:13.968883 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128418e-2935-4963-8670-bc649f5b99b4 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:24:13.969036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128418e-2935-4963-8670-bc649f5b99b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:24:13.987054 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-e128418e-2935-4963-8670-bc649f5b99b4 None None] MFA Rules not processed for user `02af0eded57547f489be63cd6dc09399`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:24:13.988243 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e128418e-2935-4963-8670-bc649f5b99b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:24:14.042961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1145/2311] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:24:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:24:18.691930 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba385d-3fd7-4ac3-bada-24247a1e0657 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:24:18.692579 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba385d-3fd7-4ac3-bada-24247a1e0657 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:24:18.692868 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba385d-3fd7-4ac3-bada-24247a1e0657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:24:18.711224 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-07ba385d-3fd7-4ac3-bada-24247a1e0657 None None] MFA Rules not processed for user `ca39678abe6e476283f94c675d4ea369`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:24:18.712432 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-07ba385d-3fd7-4ac3-bada-24247a1e0657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:24:18.765954 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1167/2312] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:24:38.040580 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b3a3e-8884-45a2-9e86-4d6e0f19928d None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:24:38.041074 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b3a3e-8884-45a2-9e86-4d6e0f19928d None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:24:38.041193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b3a3e-8884-45a2-9e86-4d6e0f19928d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:24:38.059321 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-6e3b3a3e-8884-45a2-9e86-4d6e0f19928d None None] MFA Rules not processed for user `d2267b0c3311480eb8d1f54df5296c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:24:38.060505 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-6e3b3a3e-8884-45a2-9e86-4d6e0f19928d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:24:38.113241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1146/2313] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:24:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:25:11.995028 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5229a-2281-4273-b4b3-21d67a7f1d6c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:11.995534 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5229a-2281-4273-b4b3-21d67a7f1d6c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:11.995675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5229a-2281-4273-b4b3-21d67a7f1d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:12.013768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-3ec5229a-2281-4273-b4b3-21d67a7f1d6c None None] MFA Rules not processed for user `05eb9dfc751a4b44a8d4d7a03138f0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:25:12.015079 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3ec5229a-2281-4273-b4b3-21d67a7f1d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:12.069224 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1168/2314] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:25:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:25:12.106284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b3a3e-8884-45a2-9e86-4d6e0f19928d None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:12.107442 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-6e3b3a3e-8884-45a2-9e86-4d6e0f19928d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:12.170537 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b3a3e-8884-45a2-9e86-4d6e0f19928d None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:12.174014 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810355c0-a6dd-441c-8927-bf3aabb42b30 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2b6514779d42fa81d34351607dea27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:12.174848 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810355c0-a6dd-441c-8927-bf3aabb42b30 service glance] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:12.175146 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810355c0-a6dd-441c-8927-bf3aabb42b30 service glance] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:12.175517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810355c0-a6dd-441c-8927-bf3aabb42b30 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:12.177871 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-810355c0-a6dd-441c-8927-bf3aabb42b30 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:12.247367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810355c0-a6dd-441c-8927-bf3aabb42b30 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:12.248796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810355c0-a6dd-441c-8927-bf3aabb42b30 service glance] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:12.260311 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1147/2315] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:25:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:13.107868 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5229a-2281-4273-b4b3-21d67a7f1d6c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:13.109328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3ec5229a-2281-4273-b4b3-21d67a7f1d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:13.123047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5229a-2281-4273-b4b3-21d67a7f1d6c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:13.126830 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b3dce-a7a6-45b7-8497-52cb8f2b259b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:13.131169 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b3dce-a7a6-45b7-8497-52cb8f2b259b service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:13.131736 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b3dce-a7a6-45b7-8497-52cb8f2b259b service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:13.132030 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b3dce-a7a6-45b7-8497-52cb8f2b259b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:13.134371 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-556b3dce-a7a6-45b7-8497-52cb8f2b259b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:13.151710 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b3dce-a7a6-45b7-8497-52cb8f2b259b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:13.153320 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b3dce-a7a6-45b7-8497-52cb8f2b259b service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:13.165886 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1169/2316] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:25:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:24.761972 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810355c0-a6dd-441c-8927-bf3aabb42b30 service glance] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:24.763420 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-810355c0-a6dd-441c-8927-bf3aabb42b30 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:24.777832 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810355c0-a6dd-441c-8927-bf3aabb42b30 service glance] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:24.783613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dd9ab-bad4-4535-a3ab-2269568d83de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:24.784254 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dd9ab-bad4-4535-a3ab-2269568d83de service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:24.784557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dd9ab-bad4-4535-a3ab-2269568d83de service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:24.784830 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dd9ab-bad4-4535-a3ab-2269568d83de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:24.786608 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-b67dd9ab-bad4-4535-a3ab-2269568d83de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:24.797853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67dd9ab-bad4-4535-a3ab-2269568d83de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:24.799449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67dd9ab-bad4-4535-a3ab-2269568d83de service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:24.808745 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1148/2317] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:25:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:25.064860 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b3dce-a7a6-45b7-8497-52cb8f2b259b service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:25.074089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b3dce-a7a6-45b7-8497-52cb8f2b259b service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:25.077707 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52391f3d-e735-4325-9f61-a7e0bddca000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:25.078336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52391f3d-e735-4325-9f61-a7e0bddca000 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:25.078769 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52391f3d-e735-4325-9f61-a7e0bddca000 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:25.079278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52391f3d-e735-4325-9f61-a7e0bddca000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:25.081786 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-52391f3d-e735-4325-9f61-a7e0bddca000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:25.144760 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52391f3d-e735-4325-9f61-a7e0bddca000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:25.146211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52391f3d-e735-4325-9f61-a7e0bddca000 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:25.156684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1170/2318] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:25:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:28.045687 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dd9ab-bad4-4535-a3ab-2269568d83de service nova] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:28.055585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dd9ab-bad4-4535-a3ab-2269568d83de service nova] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:28.059322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03957e-c70b-4b67-82ee-1dbe95010aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:28.060083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03957e-c70b-4b67-82ee-1dbe95010aef service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:28.060532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03957e-c70b-4b67-82ee-1dbe95010aef service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:28.060955 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03957e-c70b-4b67-82ee-1dbe95010aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:28.064593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-5c03957e-c70b-4b67-82ee-1dbe95010aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:28.077040 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03957e-c70b-4b67-82ee-1dbe95010aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:28.078679 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03957e-c70b-4b67-82ee-1dbe95010aef service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:28.088634 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1149/2319] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:25:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:29.332348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52391f3d-e735-4325-9f61-a7e0bddca000 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:29.333795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-52391f3d-e735-4325-9f61-a7e0bddca000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:29.346620 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52391f3d-e735-4325-9f61-a7e0bddca000 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:29.351897 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6f6d8-dbb0-43fb-b6ad-4a33ec5b2df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:29.352776 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6f6d8-dbb0-43fb-b6ad-4a33ec5b2df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:29.353060 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6f6d8-dbb0-43fb-b6ad-4a33ec5b2df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:29.353336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6f6d8-dbb0-43fb-b6ad-4a33ec5b2df1 admin admin] PATH_INFO: `/v3/users/02af0eded57547f489be63cd6dc09399` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:29.354594 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6f6d8-dbb0-43fb-b6ad-4a33ec5b2df1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02af0eded57547f489be63cd6dc09399)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:29.356518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6f6d8-dbb0-43fb-b6ad-4a33ec5b2df1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:29.549313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5be6f6d8-dbb0-43fb-b6ad-4a33ec5b2df1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02af0eded57547f489be63cd6dc09399'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:29.549921 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5be6f6d8-dbb0-43fb-b6ad-4a33ec5b2df1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02af0eded57547f489be63cd6dc09399'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:29.550579 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5be6f6d8-dbb0-43fb-b6ad-4a33ec5b2df1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02af0eded57547f489be63cd6dc09399'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:29.562259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5be6f6d8-dbb0-43fb-b6ad-4a33ec5b2df1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02af0eded57547f489be63cd6dc09399'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:29.568849 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5be6f6d8-dbb0-43fb-b6ad-4a33ec5b2df1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02af0eded57547f489be63cd6dc09399'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:29.644603 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1171/2320] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:25:29 2022] DELETE /identity/v3/users/02af0eded57547f489be63cd6dc09399 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:25:29.806669 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03957e-c70b-4b67-82ee-1dbe95010aef service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:29.808102 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-5c03957e-c70b-4b67-82ee-1dbe95010aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:29.864046 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03957e-c70b-4b67-82ee-1dbe95010aef service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:29.897502 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6f6d8-dbb0-43fb-b6ad-4a33ec5b2df1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:29.899201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5be6f6d8-dbb0-43fb-b6ad-4a33ec5b2df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:29.913370 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1de29-4dc9-4030-b7c5-e348a1436845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:29.914094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1de29-4dc9-4030-b7c5-e348a1436845 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:29.914374 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1de29-4dc9-4030-b7c5-e348a1436845 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:29.914823 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1de29-4dc9-4030-b7c5-e348a1436845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:29.916904 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e7f1de29-4dc9-4030-b7c5-e348a1436845 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:29.969621 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6f6d8-dbb0-43fb-b6ad-4a33ec5b2df1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:29.974625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066c676-0ab7-443b-9d13-c96bbfec2f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:29.975698 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066c676-0ab7-443b-9d13-c96bbfec2f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:29.975979 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066c676-0ab7-443b-9d13-c96bbfec2f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:29.976659 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066c676-0ab7-443b-9d13-c96bbfec2f98 admin admin] PATH_INFO: `/v3/projects/78072ca90bf6402b83863597c266a178` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:29.977956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066c676-0ab7-443b-9d13-c96bbfec2f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78072ca90bf6402b83863597c266a178)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:29.979872 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066c676-0ab7-443b-9d13-c96bbfec2f98 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:29.986057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1de29-4dc9-4030-b7c5-e348a1436845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:29.987517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1de29-4dc9-4030-b7c5-e348a1436845 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:29.997179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1150/2321] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:25:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:30.112230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f066c676-0ab7-443b-9d13-c96bbfec2f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78072ca90bf6402b83863597c266a178', 'request_id': 'req-f066c676-0ab7-443b-9d13-c96bbfec2f98'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:30.193014 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f066c676-0ab7-443b-9d13-c96bbfec2f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78072ca90bf6402b83863597c266a178', 'request_id': 'req-f066c676-0ab7-443b-9d13-c96bbfec2f98'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:30.199535 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f066c676-0ab7-443b-9d13-c96bbfec2f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78072ca90bf6402b83863597c266a178', 'request_id': 'req-f066c676-0ab7-443b-9d13-c96bbfec2f98'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:30.211354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f066c676-0ab7-443b-9d13-c96bbfec2f98 admin admin] The token cache is being invalidate because project 78072ca90bf6402b83863597c266a178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:25:30.211705 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f066c676-0ab7-443b-9d13-c96bbfec2f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:30.212360 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f066c676-0ab7-443b-9d13-c96bbfec2f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:30.213977 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1172/2322] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:25:29 2022] DELETE /identity/v3/projects/78072ca90bf6402b83863597c266a178 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:25:30.218954 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bac3c-863a-4b94-aa6a-4f76d806dc01 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:30.219250 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bac3c-863a-4b94-aa6a-4f76d806dc01 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:30.219531 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bac3c-863a-4b94-aa6a-4f76d806dc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:30.237979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-3a7bac3c-863a-4b94-aa6a-4f76d806dc01 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:25:30.239215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-3a7bac3c-863a-4b94-aa6a-4f76d806dc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:30.296741 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1151/2323] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:25:30.304455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf2d7d-2dbc-40fd-b688-3c925cc2b1ab None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:30.304933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf2d7d-2dbc-40fd-b688-3c925cc2b1ab None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:30.305349 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf2d7d-2dbc-40fd-b688-3c925cc2b1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:30.324142 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-08cf2d7d-2dbc-40fd-b688-3c925cc2b1ab None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:25:30.330603 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-08cf2d7d-2dbc-40fd-b688-3c925cc2b1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:30.333311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1173/2324] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:25:30.338069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bac3c-863a-4b94-aa6a-4f76d806dc01 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:30.347548 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bac3c-863a-4b94-aa6a-4f76d806dc01 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:30.352248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8c155-1da3-4186-ad6b-dc82f24892c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:30.359303 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8c155-1da3-4186-ad6b-dc82f24892c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:30.359303 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8c155-1da3-4186-ad6b-dc82f24892c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:30.359303 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8c155-1da3-4186-ad6b-dc82f24892c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:30.359303 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8c155-1da3-4186-ad6b-dc82f24892c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:25:30.359303 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8c155-1da3-4186-ad6b-dc82f24892c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:30.359303 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8c155-1da3-4186-ad6b-dc82f24892c0 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:30.367506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1152/2325] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:25:30.371730 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf2d7d-2dbc-40fd-b688-3c925cc2b1ab None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:30.381068 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf2d7d-2dbc-40fd-b688-3c925cc2b1ab None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:30.386644 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef174cc-2efe-44a8-83e4-0ae24091a963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:30.387293 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef174cc-2efe-44a8-83e4-0ae24091a963 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:30.387580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef174cc-2efe-44a8-83e4-0ae24091a963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:30.387881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef174cc-2efe-44a8-83e4-0ae24091a963 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:30.388577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef174cc-2efe-44a8-83e4-0ae24091a963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:30.390481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef174cc-2efe-44a8-83e4-0ae24091a963 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:30.473578 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1174/2326] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:25:30 2022] POST /identity/v3/projects => generated 403 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:25:30.477579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8c155-1da3-4186-ad6b-dc82f24892c0 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:30.487464 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8c155-1da3-4186-ad6b-dc82f24892c0 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:30.541309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86ce93-2946-4c58-89cb-7b4d5e28a76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:30.541971 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86ce93-2946-4c58-89cb-7b4d5e28a76c admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:30.542256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86ce93-2946-4c58-89cb-7b4d5e28a76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:30.542557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86ce93-2946-4c58-89cb-7b4d5e28a76c admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:30.543243 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86ce93-2946-4c58-89cb-7b4d5e28a76c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:30.545149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86ce93-2946-4c58-89cb-7b4d5e28a76c admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:30.649866 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1153/2327] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:25:30 2022] POST /identity/v3/users => generated 302 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:25:30.653852 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef174cc-2efe-44a8-83e4-0ae24091a963 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:30.663953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef174cc-2efe-44a8-83e4-0ae24091a963 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:30.668754 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f5b1a-d4a0-4d72-883f-9ec323d47634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:30.669400 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f5b1a-d4a0-4d72-883f-9ec323d47634 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:30.669690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f5b1a-d4a0-4d72-883f-9ec323d47634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:30.669963 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f5b1a-d4a0-4d72-883f-9ec323d47634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:30.670751 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f5b1a-d4a0-4d72-883f-9ec323d47634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:30.672374 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f5b1a-d4a0-4d72-883f-9ec323d47634 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:30.682993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1175/2328] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:25:30.686821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86ce93-2946-4c58-89cb-7b4d5e28a76c admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:30.697364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86ce93-2946-4c58-89cb-7b4d5e28a76c admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:30.702043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655de221-6ec5-4c87-9cce-8e18a4ce13f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:30.702726 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655de221-6ec5-4c87-9cce-8e18a4ce13f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:30.703009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655de221-6ec5-4c87-9cce-8e18a4ce13f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:30.703282 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655de221-6ec5-4c87-9cce-8e18a4ce13f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:30.704000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655de221-6ec5-4c87-9cce-8e18a4ce13f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:30.705570 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655de221-6ec5-4c87-9cce-8e18a4ce13f2 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:30.715386 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1154/2329] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:25:30.719350 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f5b1a-d4a0-4d72-883f-9ec323d47634 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:30.728957 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f5b1a-d4a0-4d72-883f-9ec323d47634 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:30.733492 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30971a12-7864-4050-adf2-f39365923983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:30.734357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30971a12-7864-4050-adf2-f39365923983 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:30.734665 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30971a12-7864-4050-adf2-f39365923983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:30.734940 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30971a12-7864-4050-adf2-f39365923983 admin admin] PATH_INFO: `/v3/projects/3ec38ebcd4994af4a014cc06777a463e/users/8a30b9936a2a4353a1b8be3b3c8b7d52/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:30.749608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30971a12-7864-4050-adf2-f39365923983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec38ebcd4994af4a014cc06777a463e, user_id=8a30b9936a2a4353a1b8be3b3c8b7d52, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:30.752271 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30971a12-7864-4050-adf2-f39365923983 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:30.851961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1176/2330] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:25:30 2022] PUT /identity/v3/projects/3ec38ebcd4994af4a014cc06777a463e/users/8a30b9936a2a4353a1b8be3b3c8b7d52/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:25:30.856981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f717-93ca-473f-8bb4-11c6e82b9d77 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:30.857472 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f717-93ca-473f-8bb4-11c6e82b9d77 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:30.858281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f717-93ca-473f-8bb4-11c6e82b9d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:30.879019 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-d3f0f717-93ca-473f-8bb4-11c6e82b9d77 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:25:30.880253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-d3f0f717-93ca-473f-8bb4-11c6e82b9d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:30.946368 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1155/2331] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:25:30.956480 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30971a12-7864-4050-adf2-f39365923983 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:30.958268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-30971a12-7864-4050-adf2-f39365923983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:31.014842 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30971a12-7864-4050-adf2-f39365923983 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:31.018454 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0e71f-eb5e-4e02-8ef5-351f81e60e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:31.019094 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0e71f-eb5e-4e02-8ef5-351f81e60e9e service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:31.019374 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0e71f-eb5e-4e02-8ef5-351f81e60e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:31.019645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0e71f-eb5e-4e02-8ef5-351f81e60e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:31.028945 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0e71f-eb5e-4e02-8ef5-351f81e60e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:31.030362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0e71f-eb5e-4e02-8ef5-351f81e60e9e service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:31.040387 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1177/2332] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:32.674395 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb114d74-226f-41ef-aa5c-371e32988d66 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:32.674958 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb114d74-226f-41ef-aa5c-371e32988d66 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:32.675055 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb114d74-226f-41ef-aa5c-371e32988d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:32.709152 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-cb114d74-226f-41ef-aa5c-371e32988d66 None None] MFA Rules not processed for user `8a30b9936a2a4353a1b8be3b3c8b7d52`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:25:32.711821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-cb114d74-226f-41ef-aa5c-371e32988d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:32.815091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1156/2333] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:25:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:25:32.815663 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0e71f-eb5e-4e02-8ef5-351f81e60e9e service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:32.825624 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0e71f-eb5e-4e02-8ef5-351f81e60e9e service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:32.833506 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b24a99-fa4e-441d-88dd-6fda02a5801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:32.834597 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b24a99-fa4e-441d-88dd-6fda02a5801b admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:32.836757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b24a99-fa4e-441d-88dd-6fda02a5801b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:32.837215 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b24a99-fa4e-441d-88dd-6fda02a5801b admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:32.846714 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b24a99-fa4e-441d-88dd-6fda02a5801b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:32.849632 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b24a99-fa4e-441d-88dd-6fda02a5801b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:32.953289 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1178/2334] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:25:32 2022] POST /identity/v3/projects => generated 405 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:25:32.962713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb114d74-226f-41ef-aa5c-371e32988d66 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:32.968722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb114d74-226f-41ef-aa5c-371e32988d66 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:33.030827 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d6590-c2d9-4166-b8fc-e1f5fadea357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:33.032613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d6590-c2d9-4166-b8fc-e1f5fadea357 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:33.032900 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d6590-c2d9-4166-b8fc-e1f5fadea357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:33.033179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d6590-c2d9-4166-b8fc-e1f5fadea357 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:33.033881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d6590-c2d9-4166-b8fc-e1f5fadea357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:33.035829 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d6590-c2d9-4166-b8fc-e1f5fadea357 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:33.147079 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1157/2335] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:25:32 2022] POST /identity/v3/users => generated 309 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:25:33.149227 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b24a99-fa4e-441d-88dd-6fda02a5801b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:33.161863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b24a99-fa4e-441d-88dd-6fda02a5801b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:33.166676 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6775ff3-bed4-45e0-b950-ad720af37e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:33.167396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6775ff3-bed4-45e0-b950-ad720af37e14 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:33.167680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6775ff3-bed4-45e0-b950-ad720af37e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:33.167956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6775ff3-bed4-45e0-b950-ad720af37e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:33.168726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6775ff3-bed4-45e0-b950-ad720af37e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:33.170425 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6775ff3-bed4-45e0-b950-ad720af37e14 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:33.185076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1179/2336] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:25:33.186226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d6590-c2d9-4166-b8fc-e1f5fadea357 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:33.199385 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d6590-c2d9-4166-b8fc-e1f5fadea357 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:33.211135 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ea8d8-ef87-4aae-8178-87d278f98d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:33.212533 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ea8d8-ef87-4aae-8178-87d278f98d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:33.217398 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ea8d8-ef87-4aae-8178-87d278f98d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:33.217398 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ea8d8-ef87-4aae-8178-87d278f98d1b admin admin] PATH_INFO: `/v3/projects/2243f7933cf54065a5c670b4b7dac46f/users/2ec8d540a2f24534b7886447059f9f22/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:33.233047 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ea8d8-ef87-4aae-8178-87d278f98d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2243f7933cf54065a5c670b4b7dac46f, user_id=2ec8d540a2f24534b7886447059f9f22, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:33.236265 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ea8d8-ef87-4aae-8178-87d278f98d1b admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:33.311533 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1158/2337] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:25:33 2022] PUT /identity/v3/projects/2243f7933cf54065a5c670b4b7dac46f/users/2ec8d540a2f24534b7886447059f9f22/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:25:33.315337 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6775ff3-bed4-45e0-b950-ad720af37e14 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:33.337226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6775ff3-bed4-45e0-b950-ad720af37e14 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:33.453201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0216de-f36c-4800-911f-67963fb40e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:33.454050 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0216de-f36c-4800-911f-67963fb40e0b admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:33.454706 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0216de-f36c-4800-911f-67963fb40e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:33.455075 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0216de-f36c-4800-911f-67963fb40e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:33.455924 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0216de-f36c-4800-911f-67963fb40e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:33.458714 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0216de-f36c-4800-911f-67963fb40e0b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:33.483115 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1180/2338] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:25:33.487380 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ea8d8-ef87-4aae-8178-87d278f98d1b admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:33.503080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ea8d8-ef87-4aae-8178-87d278f98d1b admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:33.513988 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29016881-a9a2-4950-8e00-b838ca0b5c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:33.515334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29016881-a9a2-4950-8e00-b838ca0b5c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:33.515676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29016881-a9a2-4950-8e00-b838ca0b5c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:33.515957 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29016881-a9a2-4950-8e00-b838ca0b5c22 admin admin] PATH_INFO: `/v3/projects/2243f7933cf54065a5c670b4b7dac46f/users/2ec8d540a2f24534b7886447059f9f22/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:33.522522 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29016881-a9a2-4950-8e00-b838ca0b5c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2243f7933cf54065a5c670b4b7dac46f, user_id=2ec8d540a2f24534b7886447059f9f22, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:33.525921 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29016881-a9a2-4950-8e00-b838ca0b5c22 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:33.556523 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1159/2339] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:25:33 2022] PUT /identity/v3/projects/2243f7933cf54065a5c670b4b7dac46f/users/2ec8d540a2f24534b7886447059f9f22/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:25:34.895086 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0216de-f36c-4800-911f-67963fb40e0b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:34.897336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ff0216de-f36c-4800-911f-67963fb40e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:34.986989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0216de-f36c-4800-911f-67963fb40e0b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:35.037826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21f9d1-7f90-4714-8a91-af1e01d819fe None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:35.038370 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21f9d1-7f90-4714-8a91-af1e01d819fe None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:35.038496 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21f9d1-7f90-4714-8a91-af1e01d819fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:35.073523 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-fc21f9d1-7f90-4714-8a91-af1e01d819fe None None] MFA Rules not processed for user `2ec8d540a2f24534b7886447059f9f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:25:35.074916 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-fc21f9d1-7f90-4714-8a91-af1e01d819fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:35.103695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd05fb-3d9f-455b-bd12-d57274c60677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:35.104336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd05fb-3d9f-455b-bd12-d57274c60677 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:35.104624 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd05fb-3d9f-455b-bd12-d57274c60677 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:35.104905 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd05fb-3d9f-455b-bd12-d57274c60677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:35.106993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b7cd05fb-3d9f-455b-bd12-d57274c60677 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:35.122608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd05fb-3d9f-455b-bd12-d57274c60677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:35.124544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd05fb-3d9f-455b-bd12-d57274c60677 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:35.143381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1181/2340] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:25:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:35.190971 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1160/2341] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:25:35 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:25:37.152721 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd05fb-3d9f-455b-bd12-d57274c60677 service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:37.220809 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd05fb-3d9f-455b-bd12-d57274c60677 service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:37.225426 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bf209-e744-43bb-be09-9f8bba95808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:37.227042 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bf209-e744-43bb-be09-9f8bba95808e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:37.227368 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bf209-e744-43bb-be09-9f8bba95808e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:37.227656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bf209-e744-43bb-be09-9f8bba95808e admin admin] PATH_INFO: `/v3/users/8a30b9936a2a4353a1b8be3b3c8b7d52` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:37.228869 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bf209-e744-43bb-be09-9f8bba95808e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a30b9936a2a4353a1b8be3b3c8b7d52)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:37.230795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bf209-e744-43bb-be09-9f8bba95808e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:37.439602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bc0bf209-e744-43bb-be09-9f8bba95808e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a30b9936a2a4353a1b8be3b3c8b7d52'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:37.440563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bc0bf209-e744-43bb-be09-9f8bba95808e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a30b9936a2a4353a1b8be3b3c8b7d52'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:37.441281 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bc0bf209-e744-43bb-be09-9f8bba95808e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a30b9936a2a4353a1b8be3b3c8b7d52'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:37.457231 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bc0bf209-e744-43bb-be09-9f8bba95808e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a30b9936a2a4353a1b8be3b3c8b7d52'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:37.462539 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bc0bf209-e744-43bb-be09-9f8bba95808e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a30b9936a2a4353a1b8be3b3c8b7d52'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:37.535832 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1182/2342] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:25:37 2022] DELETE /identity/v3/users/8a30b9936a2a4353a1b8be3b3c8b7d52 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:25:37.846368 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21f9d1-7f90-4714-8a91-af1e01d819fe None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:37.862413 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21f9d1-7f90-4714-8a91-af1e01d819fe None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:37.927318 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2264c50-cb99-44e8-a1d3-f9fb1d40e417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:37.930161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2264c50-cb99-44e8-a1d3-f9fb1d40e417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:37.930161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2264c50-cb99-44e8-a1d3-f9fb1d40e417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:37.930161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2264c50-cb99-44e8-a1d3-f9fb1d40e417 admin admin] PATH_INFO: `/v3/projects/3ec38ebcd4994af4a014cc06777a463e` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:37.931133 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2264c50-cb99-44e8-a1d3-f9fb1d40e417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ec38ebcd4994af4a014cc06777a463e)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:37.933072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2264c50-cb99-44e8-a1d3-f9fb1d40e417 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:38.079774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e2264c50-cb99-44e8-a1d3-f9fb1d40e417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ec38ebcd4994af4a014cc06777a463e', 'request_id': 'req-e2264c50-cb99-44e8-a1d3-f9fb1d40e417'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:38.359485 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e2264c50-cb99-44e8-a1d3-f9fb1d40e417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ec38ebcd4994af4a014cc06777a463e', 'request_id': 'req-e2264c50-cb99-44e8-a1d3-f9fb1d40e417'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:38.367058 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e2264c50-cb99-44e8-a1d3-f9fb1d40e417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ec38ebcd4994af4a014cc06777a463e', 'request_id': 'req-e2264c50-cb99-44e8-a1d3-f9fb1d40e417'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:38.395295 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e2264c50-cb99-44e8-a1d3-f9fb1d40e417 admin admin] The token cache is being invalidate because project 3ec38ebcd4994af4a014cc06777a463e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:25:38.395637 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e2264c50-cb99-44e8-a1d3-f9fb1d40e417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:38.396774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e2264c50-cb99-44e8-a1d3-f9fb1d40e417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:38.399918 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1161/2343] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:25:37 2022] DELETE /identity/v3/projects/3ec38ebcd4994af4a014cc06777a463e => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:25:38.407263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bf209-e744-43bb-be09-9f8bba95808e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:38.407263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-bc0bf209-e744-43bb-be09-9f8bba95808e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:38.429800 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bf209-e744-43bb-be09-9f8bba95808e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:38.498327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf07c0-9426-40f5-a857-86f200fa07fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:38.499418 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf07c0-9426-40f5-a857-86f200fa07fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:38.499849 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf07c0-9426-40f5-a857-86f200fa07fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:38.500132 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf07c0-9426-40f5-a857-86f200fa07fc admin admin] PATH_INFO: `/v3/users/2ec8d540a2f24534b7886447059f9f22` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:38.501452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf07c0-9426-40f5-a857-86f200fa07fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ec8d540a2f24534b7886447059f9f22)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:38.503417 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf07c0-9426-40f5-a857-86f200fa07fc admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:38.704615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-62bf07c0-9426-40f5-a857-86f200fa07fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ec8d540a2f24534b7886447059f9f22'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:38.705229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-62bf07c0-9426-40f5-a857-86f200fa07fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ec8d540a2f24534b7886447059f9f22'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:38.705909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-62bf07c0-9426-40f5-a857-86f200fa07fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ec8d540a2f24534b7886447059f9f22'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:38.718514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-62bf07c0-9426-40f5-a857-86f200fa07fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ec8d540a2f24534b7886447059f9f22'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:38.725396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-62bf07c0-9426-40f5-a857-86f200fa07fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ec8d540a2f24534b7886447059f9f22'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:38.801521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1183/2344] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:25:38 2022] DELETE /identity/v3/users/2ec8d540a2f24534b7886447059f9f22 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:25:39.064548 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2264c50-cb99-44e8-a1d3-f9fb1d40e417 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:39.066165 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e2264c50-cb99-44e8-a1d3-f9fb1d40e417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:39.088671 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2264c50-cb99-44e8-a1d3-f9fb1d40e417 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:39.133934 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf07c0-9426-40f5-a857-86f200fa07fc admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:39.135912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-62bf07c0-9426-40f5-a857-86f200fa07fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:39.171167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77331ee3-356d-480a-aee0-c0f4a6b7b2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:39.172198 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77331ee3-356d-480a-aee0-c0f4a6b7b2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:39.172486 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77331ee3-356d-480a-aee0-c0f4a6b7b2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:39.172768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77331ee3-356d-480a-aee0-c0f4a6b7b2e7 admin admin] PATH_INFO: `/v3/projects/2243f7933cf54065a5c670b4b7dac46f` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:39.173979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77331ee3-356d-480a-aee0-c0f4a6b7b2e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2243f7933cf54065a5c670b4b7dac46f)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:39.176255 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77331ee3-356d-480a-aee0-c0f4a6b7b2e7 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:39.240180 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf07c0-9426-40f5-a857-86f200fa07fc admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:39.247107 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfb019-24dd-4915-a8fc-32fc02be161b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:39.247717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfb019-24dd-4915-a8fc-32fc02be161b service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:39.248076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfb019-24dd-4915-a8fc-32fc02be161b service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:39.248427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfb019-24dd-4915-a8fc-32fc02be161b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:39.250424 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a8dfb019-24dd-4915-a8fc-32fc02be161b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:39.316373 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfb019-24dd-4915-a8fc-32fc02be161b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:39.318023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfb019-24dd-4915-a8fc-32fc02be161b service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:39.329464 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1184/2345] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:25:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:39.332070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-77331ee3-356d-480a-aee0-c0f4a6b7b2e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2243f7933cf54065a5c670b4b7dac46f', 'request_id': 'req-77331ee3-356d-480a-aee0-c0f4a6b7b2e7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:39.387673 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-77331ee3-356d-480a-aee0-c0f4a6b7b2e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2243f7933cf54065a5c670b4b7dac46f', 'request_id': 'req-77331ee3-356d-480a-aee0-c0f4a6b7b2e7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:39.393966 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-77331ee3-356d-480a-aee0-c0f4a6b7b2e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2243f7933cf54065a5c670b4b7dac46f', 'request_id': 'req-77331ee3-356d-480a-aee0-c0f4a6b7b2e7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:39.406931 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-77331ee3-356d-480a-aee0-c0f4a6b7b2e7 admin admin] The token cache is being invalidate because project 2243f7933cf54065a5c670b4b7dac46f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:25:39.407226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-77331ee3-356d-480a-aee0-c0f4a6b7b2e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:39.408024 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-77331ee3-356d-480a-aee0-c0f4a6b7b2e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:39.409615 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1162/2346] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:25:39 2022] DELETE /identity/v3/projects/2243f7933cf54065a5c670b4b7dac46f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:25:39.415522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808edba-7971-42d0-98d5-fa2e43b6ebde None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:39.420514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808edba-7971-42d0-98d5-fa2e43b6ebde None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:39.420514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808edba-7971-42d0-98d5-fa2e43b6ebde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:39.436938 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-3808edba-7971-42d0-98d5-fa2e43b6ebde None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:25:39.438359 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3808edba-7971-42d0-98d5-fa2e43b6ebde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:39.525959 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1185/2347] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:25:39.533768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652c54c-1ef2-4891-9328-0ccf2de1b1ae None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:39.535079 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652c54c-1ef2-4891-9328-0ccf2de1b1ae None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:39.535079 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652c54c-1ef2-4891-9328-0ccf2de1b1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:39.554393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-d652c54c-1ef2-4891-9328-0ccf2de1b1ae None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:25:39.555896 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-d652c54c-1ef2-4891-9328-0ccf2de1b1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:39.564804 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1163/2348] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:25:39.569082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808edba-7971-42d0-98d5-fa2e43b6ebde None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:39.579740 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808edba-7971-42d0-98d5-fa2e43b6ebde None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:39.584558 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f6d4f-b081-4bdc-bd58-f812386a223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:39.596659 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f6d4f-b081-4bdc-bd58-f812386a223e admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:39.596659 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f6d4f-b081-4bdc-bd58-f812386a223e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:39.596659 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f6d4f-b081-4bdc-bd58-f812386a223e admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:39.596659 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f6d4f-b081-4bdc-bd58-f812386a223e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:25:39.596659 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f6d4f-b081-4bdc-bd58-f812386a223e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:39.596659 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f6d4f-b081-4bdc-bd58-f812386a223e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:39.601242 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1186/2349] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:25:39.605755 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652c54c-1ef2-4891-9328-0ccf2de1b1ae None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:39.614751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652c54c-1ef2-4891-9328-0ccf2de1b1ae None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:39.620416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105effa7-726e-49ef-9c82-c3b1b61befce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:39.625378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105effa7-726e-49ef-9c82-c3b1b61befce admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:39.625378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105effa7-726e-49ef-9c82-c3b1b61befce admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:39.625378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105effa7-726e-49ef-9c82-c3b1b61befce admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:39.625378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105effa7-726e-49ef-9c82-c3b1b61befce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:39.625378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105effa7-726e-49ef-9c82-c3b1b61befce admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:39.709645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1164/2350] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:25:39 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:25:39.714581 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f6d4f-b081-4bdc-bd58-f812386a223e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:39.725471 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f6d4f-b081-4bdc-bd58-f812386a223e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:39.787727 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a29afa-47df-4ec0-82df-03e99a53da8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:39.788408 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a29afa-47df-4ec0-82df-03e99a53da8d admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:39.789456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a29afa-47df-4ec0-82df-03e99a53da8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:39.789738 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a29afa-47df-4ec0-82df-03e99a53da8d admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:39.790663 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a29afa-47df-4ec0-82df-03e99a53da8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:39.792606 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a29afa-47df-4ec0-82df-03e99a53da8d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:39.883560 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1187/2351] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:25:39 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:25:39.885457 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105effa7-726e-49ef-9c82-c3b1b61befce admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:39.895909 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105effa7-726e-49ef-9c82-c3b1b61befce admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:39.901187 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4184a76-ccf8-454d-9ae2-9c7222958a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:39.911858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4184a76-ccf8-454d-9ae2-9c7222958a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:39.911858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4184a76-ccf8-454d-9ae2-9c7222958a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:39.911858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4184a76-ccf8-454d-9ae2-9c7222958a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:39.911858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4184a76-ccf8-454d-9ae2-9c7222958a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:39.911858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4184a76-ccf8-454d-9ae2-9c7222958a7f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:39.916266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1165/2352] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:25:39.920343 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a29afa-47df-4ec0-82df-03e99a53da8d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:39.930754 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a29afa-47df-4ec0-82df-03e99a53da8d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:39.935425 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa30bfc-ae79-49da-ace3-38cf54987ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:39.936085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa30bfc-ae79-49da-ace3-38cf54987ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:39.936403 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa30bfc-ae79-49da-ace3-38cf54987ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:39.936716 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa30bfc-ae79-49da-ace3-38cf54987ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:39.937452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa30bfc-ae79-49da-ace3-38cf54987ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:39.939098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa30bfc-ae79-49da-ace3-38cf54987ed0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:39.949342 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1188/2353] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:25:39.953405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4184a76-ccf8-454d-9ae2-9c7222958a7f admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:39.963673 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4184a76-ccf8-454d-9ae2-9c7222958a7f admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:39.968581 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6a1f8-f8fc-4f90-841a-b64533fb67c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:39.969456 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6a1f8-f8fc-4f90-841a-b64533fb67c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:39.969736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6a1f8-f8fc-4f90-841a-b64533fb67c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:39.970025 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6a1f8-f8fc-4f90-841a-b64533fb67c5 admin admin] PATH_INFO: `/v3/projects/719666e352374963a67ec166fbf0d729/users/d98cc56412e34acfa819f45d5b057f42/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:39.986694 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6a1f8-f8fc-4f90-841a-b64533fb67c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=719666e352374963a67ec166fbf0d729, user_id=d98cc56412e34acfa819f45d5b057f42, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:39.989338 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6a1f8-f8fc-4f90-841a-b64533fb67c5 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:40.067700 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1166/2354] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:25:39 2022] PUT /identity/v3/projects/719666e352374963a67ec166fbf0d729/users/d98cc56412e34acfa819f45d5b057f42/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:25:40.078028 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450f18-e12b-4e90-93e9-eb57b733e13b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:40.079883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450f18-e12b-4e90-93e9-eb57b733e13b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:40.079883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450f18-e12b-4e90-93e9-eb57b733e13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:40.106088 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b6450f18-e12b-4e90-93e9-eb57b733e13b None None] MFA Rules not processed for user `d98cc56412e34acfa819f45d5b057f42`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:25:40.107315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b6450f18-e12b-4e90-93e9-eb57b733e13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:40.169296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1189/2355] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:25:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:25:40.173829 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6a1f8-f8fc-4f90-841a-b64533fb67c5 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:40.234159 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6a1f8-f8fc-4f90-841a-b64533fb67c5 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:40.238981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28d255-924f-44c6-b2c1-d54de210c7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:40.239643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28d255-924f-44c6-b2c1-d54de210c7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:40.239932 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28d255-924f-44c6-b2c1-d54de210c7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:40.240408 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28d255-924f-44c6-b2c1-d54de210c7c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:40.241263 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28d255-924f-44c6-b2c1-d54de210c7c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:40.243829 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28d255-924f-44c6-b2c1-d54de210c7c7 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:40.363616 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1167/2356] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:25:40 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:25:40.364988 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6450f18-e12b-4e90-93e9-eb57b733e13b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:40.376464 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6450f18-e12b-4e90-93e9-eb57b733e13b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:40.434242 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf69112-c323-40a6-b0b2-a2e6420cfb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:40.434929 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf69112-c323-40a6-b0b2-a2e6420cfb4a admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:40.435174 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf69112-c323-40a6-b0b2-a2e6420cfb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:40.435446 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf69112-c323-40a6-b0b2-a2e6420cfb4a admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:40.436198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf69112-c323-40a6-b0b2-a2e6420cfb4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:40.438081 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf69112-c323-40a6-b0b2-a2e6420cfb4a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:40.548341 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1190/2357] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:25:40 2022] POST /identity/v3/users => generated 295 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:25:40.552350 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28d255-924f-44c6-b2c1-d54de210c7c7 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:40.562534 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28d255-924f-44c6-b2c1-d54de210c7c7 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:40.567210 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c631b9-70cb-4463-85cf-99fb550f77f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:40.567868 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c631b9-70cb-4463-85cf-99fb550f77f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:40.568153 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c631b9-70cb-4463-85cf-99fb550f77f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:40.568433 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c631b9-70cb-4463-85cf-99fb550f77f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:40.569191 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c631b9-70cb-4463-85cf-99fb550f77f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:40.570820 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c631b9-70cb-4463-85cf-99fb550f77f3 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:40.581778 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1168/2358] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:25:40.585273 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf69112-c323-40a6-b0b2-a2e6420cfb4a admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:40.595806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf69112-c323-40a6-b0b2-a2e6420cfb4a admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:40.600436 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cfb80-67d4-4d68-a253-7fbb71216689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:40.601991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cfb80-67d4-4d68-a253-7fbb71216689 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:40.602299 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cfb80-67d4-4d68-a253-7fbb71216689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:40.602706 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cfb80-67d4-4d68-a253-7fbb71216689 admin admin] PATH_INFO: `/v3/projects/8bc5526c31a84d9c85be9a6198e1b76d/users/4d0f6f72c38a4dcfbeb78ea6da43b0d0/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:40.617762 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11cfb80-67d4-4d68-a253-7fbb71216689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bc5526c31a84d9c85be9a6198e1b76d, user_id=4d0f6f72c38a4dcfbeb78ea6da43b0d0, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:40.620426 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11cfb80-67d4-4d68-a253-7fbb71216689 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:40.691198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1191/2359] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:25:40 2022] PUT /identity/v3/projects/8bc5526c31a84d9c85be9a6198e1b76d/users/4d0f6f72c38a4dcfbeb78ea6da43b0d0/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:25:40.695699 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c631b9-70cb-4463-85cf-99fb550f77f3 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:40.705766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c631b9-70cb-4463-85cf-99fb550f77f3 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:40.764340 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142c6da-da97-4507-ba47-1c5f305934a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:40.764994 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142c6da-da97-4507-ba47-1c5f305934a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:40.765301 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142c6da-da97-4507-ba47-1c5f305934a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:40.765573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142c6da-da97-4507-ba47-1c5f305934a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:40.766282 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142c6da-da97-4507-ba47-1c5f305934a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:40.767892 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142c6da-da97-4507-ba47-1c5f305934a7 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:40.777495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1169/2360] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:25:40.782030 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cfb80-67d4-4d68-a253-7fbb71216689 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:40.793071 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cfb80-67d4-4d68-a253-7fbb71216689 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:40.797602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5975e-d8c5-4059-99ed-e3eb76308daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:40.798517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5975e-d8c5-4059-99ed-e3eb76308daa admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:40.798803 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5975e-d8c5-4059-99ed-e3eb76308daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:40.799079 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5975e-d8c5-4059-99ed-e3eb76308daa admin admin] PATH_INFO: `/v3/projects/8bc5526c31a84d9c85be9a6198e1b76d/users/4d0f6f72c38a4dcfbeb78ea6da43b0d0/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:40.801111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5975e-d8c5-4059-99ed-e3eb76308daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bc5526c31a84d9c85be9a6198e1b76d, user_id=4d0f6f72c38a4dcfbeb78ea6da43b0d0, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:40.803772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5975e-d8c5-4059-99ed-e3eb76308daa admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:40.815367 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1192/2361] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:25:40 2022] PUT /identity/v3/projects/8bc5526c31a84d9c85be9a6198e1b76d/users/4d0f6f72c38a4dcfbeb78ea6da43b0d0/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:25:40.827153 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26352ef5-1a9a-44a4-9c50-dad3803659c3 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:40.827535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26352ef5-1a9a-44a4-9c50-dad3803659c3 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:40.827919 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26352ef5-1a9a-44a4-9c50-dad3803659c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:40.860132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-26352ef5-1a9a-44a4-9c50-dad3803659c3 None None] MFA Rules not processed for user `4d0f6f72c38a4dcfbeb78ea6da43b0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:25:40.946474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-26352ef5-1a9a-44a4-9c50-dad3803659c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:40.946474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1170/2362] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:25:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:25:40.950803 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5975e-d8c5-4059-99ed-e3eb76308daa admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:40.952745 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-59c5975e-d8c5-4059-99ed-e3eb76308daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:41.021834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5975e-d8c5-4059-99ed-e3eb76308daa admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:41.026201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcaece-6dc4-4787-b453-e3cefd910b6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:41.026865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcaece-6dc4-4787-b453-e3cefd910b6f service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:41.027148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcaece-6dc4-4787-b453-e3cefd910b6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:41.027428 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcaece-6dc4-4787-b453-e3cefd910b6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:41.036561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcaece-6dc4-4787-b453-e3cefd910b6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:41.037978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcaece-6dc4-4787-b453-e3cefd910b6f service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:41.047492 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1193/2363] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:25:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:41.169530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26352ef5-1a9a-44a4-9c50-dad3803659c3 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:41.179926 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26352ef5-1a9a-44a4-9c50-dad3803659c3 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:41.184140 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af842b71-107a-43c5-8881-3b9bf902ffaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:41.185120 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af842b71-107a-43c5-8881-3b9bf902ffaf service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:41.185120 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af842b71-107a-43c5-8881-3b9bf902ffaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:41.185512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af842b71-107a-43c5-8881-3b9bf902ffaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:41.248083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af842b71-107a-43c5-8881-3b9bf902ffaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:41.249515 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af842b71-107a-43c5-8881-3b9bf902ffaf service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:41.258466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1171/2364] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:25:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:41.821994 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcaece-6dc4-4787-b453-e3cefd910b6f service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:41.916158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcaece-6dc4-4787-b453-e3cefd910b6f service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:41.922599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e486e-ddaf-484f-9198-dcd3bd530c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:41.923829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e486e-ddaf-484f-9198-dcd3bd530c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:41.924484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e486e-ddaf-484f-9198-dcd3bd530c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:41.925421 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e486e-ddaf-484f-9198-dcd3bd530c49 admin admin] PATH_INFO: `/v3/users/d98cc56412e34acfa819f45d5b057f42` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:41.927181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e486e-ddaf-484f-9198-dcd3bd530c49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d98cc56412e34acfa819f45d5b057f42)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:41.930650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e486e-ddaf-484f-9198-dcd3bd530c49 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:42.150855 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-889e486e-ddaf-484f-9198-dcd3bd530c49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd98cc56412e34acfa819f45d5b057f42'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:42.151547 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-889e486e-ddaf-484f-9198-dcd3bd530c49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd98cc56412e34acfa819f45d5b057f42'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:42.152291 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-889e486e-ddaf-484f-9198-dcd3bd530c49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd98cc56412e34acfa819f45d5b057f42'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:42.165845 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-889e486e-ddaf-484f-9198-dcd3bd530c49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd98cc56412e34acfa819f45d5b057f42'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:42.176690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-889e486e-ddaf-484f-9198-dcd3bd530c49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd98cc56412e34acfa819f45d5b057f42'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:42.261159 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1194/2365] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:25:41 2022] DELETE /identity/v3/users/d98cc56412e34acfa819f45d5b057f42 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:25:42.262966 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930913a7-6d99-407b-ad2e-a5eb4efc9e82 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:42.263427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930913a7-6d99-407b-ad2e-a5eb4efc9e82 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:42.263510 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930913a7-6d99-407b-ad2e-a5eb4efc9e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:42.287706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-930913a7-6d99-407b-ad2e-a5eb4efc9e82 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:25:42.289189 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-930913a7-6d99-407b-ad2e-a5eb4efc9e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:42.364629 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1172/2366] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:25:42.374382 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e486e-ddaf-484f-9198-dcd3bd530c49 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:42.376023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-889e486e-ddaf-484f-9198-dcd3bd530c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:42.433841 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e486e-ddaf-484f-9198-dcd3bd530c49 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:42.437533 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c095242-8b5f-47eb-b736-c298210a1475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:42.438413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c095242-8b5f-47eb-b736-c298210a1475 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:42.438828 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c095242-8b5f-47eb-b736-c298210a1475 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:42.439205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c095242-8b5f-47eb-b736-c298210a1475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:42.449572 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c095242-8b5f-47eb-b736-c298210a1475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:42.451062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c095242-8b5f-47eb-b736-c298210a1475 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:42.463404 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1195/2367] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:42.744999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d1745-61c9-40a6-9789-7e26b46bfe5d None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:42.745296 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d1745-61c9-40a6-9789-7e26b46bfe5d None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:42.745577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d1745-61c9-40a6-9789-7e26b46bfe5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:42.766199 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-d30d1745-61c9-40a6-9789-7e26b46bfe5d None None] MFA Rules not processed for user `c0fc3052af194b48b7ce036ff605ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:25:42.768403 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-d30d1745-61c9-40a6-9789-7e26b46bfe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:42.828282 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1173/2368] 10.222.0.25 () {58 vars in 967 bytes} [Tue May 10 21:25:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:25:42.910566 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c095242-8b5f-47eb-b736-c298210a1475 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:42.912085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4c095242-8b5f-47eb-b736-c298210a1475 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:42.927432 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c095242-8b5f-47eb-b736-c298210a1475 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:42.933919 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bd0bb-131c-4bce-8f30-2561ba96ff5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:42.934901 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bd0bb-131c-4bce-8f30-2561ba96ff5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:42.935251 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bd0bb-131c-4bce-8f30-2561ba96ff5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:42.935466 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bd0bb-131c-4bce-8f30-2561ba96ff5e admin admin] PATH_INFO: `/v3/projects/719666e352374963a67ec166fbf0d729` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:42.936735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396bd0bb-131c-4bce-8f30-2561ba96ff5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=719666e352374963a67ec166fbf0d729)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:42.938748 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396bd0bb-131c-4bce-8f30-2561ba96ff5e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:42.998019 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d1745-61c9-40a6-9789-7e26b46bfe5d None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:42.999585 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-d30d1745-61c9-40a6-9789-7e26b46bfe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:43.068600 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-396bd0bb-131c-4bce-8f30-2561ba96ff5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '719666e352374963a67ec166fbf0d729', 'request_id': 'req-396bd0bb-131c-4bce-8f30-2561ba96ff5e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:43.069629 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d1745-61c9-40a6-9789-7e26b46bfe5d None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:43.129244 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48824e2b-05c0-4a12-9a2f-3133a3c699eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76040882d4374087bb7458fd8b5c1d8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:43.130060 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48824e2b-05c0-4a12-9a2f-3133a3c699eb service swift] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:43.130481 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48824e2b-05c0-4a12-9a2f-3133a3c699eb service swift] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:43.130863 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48824e2b-05c0-4a12-9a2f-3133a3c699eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:43.136667 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-396bd0bb-131c-4bce-8f30-2561ba96ff5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '719666e352374963a67ec166fbf0d729', 'request_id': 'req-396bd0bb-131c-4bce-8f30-2561ba96ff5e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:43.146178 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-396bd0bb-131c-4bce-8f30-2561ba96ff5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '719666e352374963a67ec166fbf0d729', 'request_id': 'req-396bd0bb-131c-4bce-8f30-2561ba96ff5e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:43.156223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-396bd0bb-131c-4bce-8f30-2561ba96ff5e admin admin] The token cache is being invalidate because project 719666e352374963a67ec166fbf0d729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:25:43.156521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-396bd0bb-131c-4bce-8f30-2561ba96ff5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:43.157181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-396bd0bb-131c-4bce-8f30-2561ba96ff5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:43.158780 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1196/2369] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:25:42 2022] DELETE /identity/v3/projects/719666e352374963a67ec166fbf0d729 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:25:43.162550 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bd0bb-131c-4bce-8f30-2561ba96ff5e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:43.163894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-396bd0bb-131c-4bce-8f30-2561ba96ff5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:43.194625 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48824e2b-05c0-4a12-9a2f-3133a3c699eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:43.196913 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48824e2b-05c0-4a12-9a2f-3133a3c699eb service swift] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:43.205157 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1174/2370] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 10 21:25:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 21:25:43.238164 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bd0bb-131c-4bce-8f30-2561ba96ff5e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:43.244577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538e082-8d97-4c34-b6af-8e7365896760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:43.245764 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538e082-8d97-4c34-b6af-8e7365896760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:43.250494 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538e082-8d97-4c34-b6af-8e7365896760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:43.251127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538e082-8d97-4c34-b6af-8e7365896760 admin admin] PATH_INFO: `/v3/users/4d0f6f72c38a4dcfbeb78ea6da43b0d0` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:43.252254 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538e082-8d97-4c34-b6af-8e7365896760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d0f6f72c38a4dcfbeb78ea6da43b0d0)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:43.254365 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538e082-8d97-4c34-b6af-8e7365896760 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:43.407818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5538e082-8d97-4c34-b6af-8e7365896760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d0f6f72c38a4dcfbeb78ea6da43b0d0'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:43.408508 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5538e082-8d97-4c34-b6af-8e7365896760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d0f6f72c38a4dcfbeb78ea6da43b0d0'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:43.409301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5538e082-8d97-4c34-b6af-8e7365896760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d0f6f72c38a4dcfbeb78ea6da43b0d0'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:43.422260 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5538e082-8d97-4c34-b6af-8e7365896760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d0f6f72c38a4dcfbeb78ea6da43b0d0'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:43.429412 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5538e082-8d97-4c34-b6af-8e7365896760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d0f6f72c38a4dcfbeb78ea6da43b0d0'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:43.481229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1197/2371] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:25:43 2022] DELETE /identity/v3/users/4d0f6f72c38a4dcfbeb78ea6da43b0d0 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:25:43.935664 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48824e2b-05c0-4a12-9a2f-3133a3c699eb service swift] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:43.952445 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48824e2b-05c0-4a12-9a2f-3133a3c699eb service swift] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:44.024394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67b088-254d-46b3-8e8a-12cfb96a24be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:44.025370 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67b088-254d-46b3-8e8a-12cfb96a24be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:44.025740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67b088-254d-46b3-8e8a-12cfb96a24be admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:44.026076 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67b088-254d-46b3-8e8a-12cfb96a24be admin admin] PATH_INFO: `/v3/projects/8bc5526c31a84d9c85be9a6198e1b76d` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:44.027554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67b088-254d-46b3-8e8a-12cfb96a24be admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bc5526c31a84d9c85be9a6198e1b76d)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:44.029528 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67b088-254d-46b3-8e8a-12cfb96a24be admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:44.188255 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3d67b088-254d-46b3-8e8a-12cfb96a24be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bc5526c31a84d9c85be9a6198e1b76d', 'request_id': 'req-3d67b088-254d-46b3-8e8a-12cfb96a24be'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:44.267960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3d67b088-254d-46b3-8e8a-12cfb96a24be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bc5526c31a84d9c85be9a6198e1b76d', 'request_id': 'req-3d67b088-254d-46b3-8e8a-12cfb96a24be'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:44.274377 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3d67b088-254d-46b3-8e8a-12cfb96a24be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bc5526c31a84d9c85be9a6198e1b76d', 'request_id': 'req-3d67b088-254d-46b3-8e8a-12cfb96a24be'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:44.285834 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3d67b088-254d-46b3-8e8a-12cfb96a24be admin admin] The token cache is being invalidate because project 8bc5526c31a84d9c85be9a6198e1b76d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:25:44.286124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3d67b088-254d-46b3-8e8a-12cfb96a24be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:44.286850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3d67b088-254d-46b3-8e8a-12cfb96a24be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:44.288394 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1175/2372] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:25:43 2022] DELETE /identity/v3/projects/8bc5526c31a84d9c85be9a6198e1b76d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:25:44.294654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece34c1-5da0-49ef-a641-5e50bdcc1f85 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:44.294654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece34c1-5da0-49ef-a641-5e50bdcc1f85 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:44.294654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece34c1-5da0-49ef-a641-5e50bdcc1f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:44.314709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-0ece34c1-5da0-49ef-a641-5e50bdcc1f85 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:25:44.317613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0ece34c1-5da0-49ef-a641-5e50bdcc1f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:44.378591 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1198/2373] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:25:44.388493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac339d-aa1f-40cf-86fb-81274649acd5 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:44.388792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac339d-aa1f-40cf-86fb-81274649acd5 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:44.389070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac339d-aa1f-40cf-86fb-81274649acd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:44.408043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-c7ac339d-aa1f-40cf-86fb-81274649acd5 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:25:44.409289 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-c7ac339d-aa1f-40cf-86fb-81274649acd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:44.418516 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1176/2374] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:25:44.423530 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece34c1-5da0-49ef-a641-5e50bdcc1f85 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:44.437120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece34c1-5da0-49ef-a641-5e50bdcc1f85 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:44.442257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6b119-dd72-4c66-8c9e-3441a18ac280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:44.443136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6b119-dd72-4c66-8c9e-3441a18ac280 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:44.443597 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6b119-dd72-4c66-8c9e-3441a18ac280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:44.444050 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6b119-dd72-4c66-8c9e-3441a18ac280 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:44.445519 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6b119-dd72-4c66-8c9e-3441a18ac280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:25:44.446190 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6b119-dd72-4c66-8c9e-3441a18ac280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:44.448226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6b119-dd72-4c66-8c9e-3441a18ac280 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:44.463316 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1199/2375] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:25:44.467260 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac339d-aa1f-40cf-86fb-81274649acd5 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:44.477322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac339d-aa1f-40cf-86fb-81274649acd5 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:44.484011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88f96b-c654-49a5-bfd8-832145ce2576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:44.484687 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88f96b-c654-49a5-bfd8-832145ce2576 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:44.485596 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88f96b-c654-49a5-bfd8-832145ce2576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:44.485812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88f96b-c654-49a5-bfd8-832145ce2576 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:44.486562 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88f96b-c654-49a5-bfd8-832145ce2576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:44.492761 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88f96b-c654-49a5-bfd8-832145ce2576 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:44.595157 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1177/2376] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:25:44 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:25:44.599422 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6b119-dd72-4c66-8c9e-3441a18ac280 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:44.610859 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6b119-dd72-4c66-8c9e-3441a18ac280 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:44.671446 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd67a2d-d122-4219-be96-69f622bdbfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:44.672118 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd67a2d-d122-4219-be96-69f622bdbfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:44.672403 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd67a2d-d122-4219-be96-69f622bdbfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:44.672680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd67a2d-d122-4219-be96-69f622bdbfb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:44.673385 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd67a2d-d122-4219-be96-69f622bdbfb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:44.675328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd67a2d-d122-4219-be96-69f622bdbfb3 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:44.770667 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1200/2377] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:25:44 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:25:44.771997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88f96b-c654-49a5-bfd8-832145ce2576 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:44.789881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88f96b-c654-49a5-bfd8-832145ce2576 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:44.795607 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d6c8e-f3d3-4966-8416-b7ae42971c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:44.796426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6c8e-f3d3-4966-8416-b7ae42971c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:44.796805 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6c8e-f3d3-4966-8416-b7ae42971c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:44.797197 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6c8e-f3d3-4966-8416-b7ae42971c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:44.798038 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d6c8e-f3d3-4966-8416-b7ae42971c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:44.799742 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d6c8e-f3d3-4966-8416-b7ae42971c8d admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:44.810836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1178/2378] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:25:44.814988 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd67a2d-d122-4219-be96-69f622bdbfb3 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:44.830589 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd67a2d-d122-4219-be96-69f622bdbfb3 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:44.836368 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4690b-8b2f-4b10-9d2e-03435e1420f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:44.839947 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4690b-8b2f-4b10-9d2e-03435e1420f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:44.839947 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4690b-8b2f-4b10-9d2e-03435e1420f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:44.839947 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4690b-8b2f-4b10-9d2e-03435e1420f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:44.842977 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4690b-8b2f-4b10-9d2e-03435e1420f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:44.844647 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4690b-8b2f-4b10-9d2e-03435e1420f1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:44.861894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1201/2379] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:25:44.865786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d6c8e-f3d3-4966-8416-b7ae42971c8d admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:44.878837 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d6c8e-f3d3-4966-8416-b7ae42971c8d admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:44.885647 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80feae60-8f36-4a18-919e-f0d4020a5f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:44.887287 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80feae60-8f36-4a18-919e-f0d4020a5f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:44.887584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80feae60-8f36-4a18-919e-f0d4020a5f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:44.887872 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80feae60-8f36-4a18-919e-f0d4020a5f76 admin admin] PATH_INFO: `/v3/projects/1f8ba34ea041484a95d0b9ef6336c244/users/853fac69f4d64aa7927d106cb0be84b2/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:44.904799 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80feae60-8f36-4a18-919e-f0d4020a5f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8ba34ea041484a95d0b9ef6336c244, user_id=853fac69f4d64aa7927d106cb0be84b2, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:44.907650 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80feae60-8f36-4a18-919e-f0d4020a5f76 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:44.966497 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1179/2380] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:25:44 2022] PUT /identity/v3/projects/1f8ba34ea041484a95d0b9ef6336c244/users/853fac69f4d64aa7927d106cb0be84b2/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:25:44.969867 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696b2e9-732c-476a-b41c-13205c4fbe0d None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:44.970160 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696b2e9-732c-476a-b41c-13205c4fbe0d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:44.970467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696b2e9-732c-476a-b41c-13205c4fbe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:44.999329 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f696b2e9-732c-476a-b41c-13205c4fbe0d None None] MFA Rules not processed for user `853fac69f4d64aa7927d106cb0be84b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:25:45.000544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f696b2e9-732c-476a-b41c-13205c4fbe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:45.077096 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1202/2381] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:25:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:25:45.088793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80feae60-8f36-4a18-919e-f0d4020a5f76 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:45.090911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-80feae60-8f36-4a18-919e-f0d4020a5f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:45.158761 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80feae60-8f36-4a18-919e-f0d4020a5f76 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:45.162355 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4a292-9bf4-4b91-bdab-537f44ae4a8f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2b6514779d42fa81d34351607dea27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:45.163044 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4a292-9bf4-4b91-bdab-537f44ae4a8f service glance] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:45.163356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4a292-9bf4-4b91-bdab-537f44ae4a8f service glance] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:45.163627 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4a292-9bf4-4b91-bdab-537f44ae4a8f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:45.172399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4a292-9bf4-4b91-bdab-537f44ae4a8f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:45.173821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4a292-9bf4-4b91-bdab-537f44ae4a8f service glance] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:45.182536 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1180/2382] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:25:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:45.480891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d764a3f-1721-4cf9-9d1e-70ef65617f42 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:45.482109 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d764a3f-1721-4cf9-9d1e-70ef65617f42 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:45.482688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d764a3f-1721-4cf9-9d1e-70ef65617f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:45.510515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7d764a3f-1721-4cf9-9d1e-70ef65617f42 None None] MFA Rules not processed for user `ca39678abe6e476283f94c675d4ea369`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:25:45.512177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7d764a3f-1721-4cf9-9d1e-70ef65617f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:45.567678 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1203/2383] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:25:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:25:45.890852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4a292-9bf4-4b91-bdab-537f44ae4a8f service glance] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:45.892299 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-77d4a292-9bf4-4b91-bdab-537f44ae4a8f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:45.952672 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4a292-9bf4-4b91-bdab-537f44ae4a8f service glance] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:45.956255 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3b23d-adf6-4a14-9db2-399e3b0ec725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:45.956910 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3b23d-adf6-4a14-9db2-399e3b0ec725 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:45.957206 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3b23d-adf6-4a14-9db2-399e3b0ec725 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:45.957471 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3b23d-adf6-4a14-9db2-399e3b0ec725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:45.959546 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-fcd3b23d-adf6-4a14-9db2-399e3b0ec725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:45.970470 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3b23d-adf6-4a14-9db2-399e3b0ec725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:45.971913 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3b23d-adf6-4a14-9db2-399e3b0ec725 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:45.981524 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1181/2384] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:25:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:46.442999 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d764a3f-1721-4cf9-9d1e-70ef65617f42 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:46.447187 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7d764a3f-1721-4cf9-9d1e-70ef65617f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:46.546521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d764a3f-1721-4cf9-9d1e-70ef65617f42 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:46.555020 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc1058-ece8-49bf-b916-c52c19d2e4de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a13ad1e10ff44c4b870b45b7416b70f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:46.556003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc1058-ece8-49bf-b916-c52c19d2e4de service placement] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:46.557000 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc1058-ece8-49bf-b916-c52c19d2e4de service placement] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:46.557370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc1058-ece8-49bf-b916-c52c19d2e4de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:46.559985 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d7bc1058-ece8-49bf-b916-c52c19d2e4de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:46.575018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc1058-ece8-49bf-b916-c52c19d2e4de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:46.576544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc1058-ece8-49bf-b916-c52c19d2e4de service placement] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:46.589557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1204/2385] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:25:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:54.412605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3b23d-adf6-4a14-9db2-399e3b0ec725 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:54.414691 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-fcd3b23d-adf6-4a14-9db2-399e3b0ec725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:54.484034 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3b23d-adf6-4a14-9db2-399e3b0ec725 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:54.488788 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09f9e1-ffb9-45ae-b865-61aa7db65fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:54.489713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09f9e1-ffb9-45ae-b865-61aa7db65fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:54.489995 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09f9e1-ffb9-45ae-b865-61aa7db65fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:54.490268 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09f9e1-ffb9-45ae-b865-61aa7db65fc6 admin admin] PATH_INFO: `/v3/users/cee2a53cb70b4281bb49e39d70abfaa6` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:54.491505 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09f9e1-ffb9-45ae-b865-61aa7db65fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee2a53cb70b4281bb49e39d70abfaa6)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:54.494170 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09f9e1-ffb9-45ae-b865-61aa7db65fc6 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:54.625071 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-dc09f9e1-ffb9-45ae-b865-61aa7db65fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee2a53cb70b4281bb49e39d70abfaa6'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:54.625758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-dc09f9e1-ffb9-45ae-b865-61aa7db65fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee2a53cb70b4281bb49e39d70abfaa6'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:54.639298 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-dc09f9e1-ffb9-45ae-b865-61aa7db65fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee2a53cb70b4281bb49e39d70abfaa6'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:54.640027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-dc09f9e1-ffb9-45ae-b865-61aa7db65fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee2a53cb70b4281bb49e39d70abfaa6'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:54.647207 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-dc09f9e1-ffb9-45ae-b865-61aa7db65fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee2a53cb70b4281bb49e39d70abfaa6'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:54.736060 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1182/2386] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:25:54 2022] DELETE /identity/v3/users/cee2a53cb70b4281bb49e39d70abfaa6 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:25:54.989138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc1058-ece8-49bf-b916-c52c19d2e4de service placement] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:55.001499 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc1058-ece8-49bf-b916-c52c19d2e4de service placement] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:55.064839 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b4ecd-5f6a-47cf-a072-d79544c329d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:55.065778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b4ecd-5f6a-47cf-a072-d79544c329d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:55.066161 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b4ecd-5f6a-47cf-a072-d79544c329d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:55.066500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b4ecd-5f6a-47cf-a072-d79544c329d8 admin admin] PATH_INFO: `/v3/projects/7858ff72ee9843a493c27f9592a540b0` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:55.067677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b4ecd-5f6a-47cf-a072-d79544c329d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7858ff72ee9843a493c27f9592a540b0)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:55.069586 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b4ecd-5f6a-47cf-a072-d79544c329d8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:55.170539 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-013b4ecd-5f6a-47cf-a072-d79544c329d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7858ff72ee9843a493c27f9592a540b0', 'request_id': 'req-013b4ecd-5f6a-47cf-a072-d79544c329d8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:55.244570 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-013b4ecd-5f6a-47cf-a072-d79544c329d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7858ff72ee9843a493c27f9592a540b0', 'request_id': 'req-013b4ecd-5f6a-47cf-a072-d79544c329d8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:55.250417 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-013b4ecd-5f6a-47cf-a072-d79544c329d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7858ff72ee9843a493c27f9592a540b0', 'request_id': 'req-013b4ecd-5f6a-47cf-a072-d79544c329d8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:55.263808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-013b4ecd-5f6a-47cf-a072-d79544c329d8 admin admin] The token cache is being invalidate because project 7858ff72ee9843a493c27f9592a540b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:25:55.264096 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-013b4ecd-5f6a-47cf-a072-d79544c329d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:55.264776 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-013b4ecd-5f6a-47cf-a072-d79544c329d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:55.266515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1205/2387] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:25:54 2022] DELETE /identity/v3/projects/7858ff72ee9843a493c27f9592a540b0 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:25:55.270661 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09f9e1-ffb9-45ae-b865-61aa7db65fc6 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:55.272055 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-dc09f9e1-ffb9-45ae-b865-61aa7db65fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:55.286102 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09f9e1-ffb9-45ae-b865-61aa7db65fc6 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:55.346608 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d24c0f-faa6-4f66-850f-42da309c81c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:55.347484 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d24c0f-faa6-4f66-850f-42da309c81c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:55.347767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d24c0f-faa6-4f66-850f-42da309c81c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:55.348042 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d24c0f-faa6-4f66-850f-42da309c81c0 admin admin] PATH_INFO: `/v3/users/c1a357e1dc5f4f3aaea970692bbd4bae` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:55.349276 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d24c0f-faa6-4f66-850f-42da309c81c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a357e1dc5f4f3aaea970692bbd4bae)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:55.352336 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d24c0f-faa6-4f66-850f-42da309c81c0 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:55.504833 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e1d24c0f-faa6-4f66-850f-42da309c81c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a357e1dc5f4f3aaea970692bbd4bae'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:55.505508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e1d24c0f-faa6-4f66-850f-42da309c81c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a357e1dc5f4f3aaea970692bbd4bae'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:55.518286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e1d24c0f-faa6-4f66-850f-42da309c81c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a357e1dc5f4f3aaea970692bbd4bae'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:55.518965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e1d24c0f-faa6-4f66-850f-42da309c81c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a357e1dc5f4f3aaea970692bbd4bae'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:55.525626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e1d24c0f-faa6-4f66-850f-42da309c81c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a357e1dc5f4f3aaea970692bbd4bae'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:55.593729 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1183/2388] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:25:55 2022] DELETE /identity/v3/users/c1a357e1dc5f4f3aaea970692bbd4bae => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:25:55.880884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b4ecd-5f6a-47cf-a072-d79544c329d8 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:55.886946 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-013b4ecd-5f6a-47cf-a072-d79544c329d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:55.896032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b4ecd-5f6a-47cf-a072-d79544c329d8 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:55.970382 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46ccd0-ca03-49cf-9824-e392e876707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:55.971284 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46ccd0-ca03-49cf-9824-e392e876707b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:55.971570 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46ccd0-ca03-49cf-9824-e392e876707b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:55.972427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46ccd0-ca03-49cf-9824-e392e876707b admin admin] PATH_INFO: `/v3/projects/7e32b7fdc90b409e8479835137e2cbf9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:55.973675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46ccd0-ca03-49cf-9824-e392e876707b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e32b7fdc90b409e8479835137e2cbf9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:55.975626 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46ccd0-ca03-49cf-9824-e392e876707b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:56.085111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8a46ccd0-ca03-49cf-9824-e392e876707b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e32b7fdc90b409e8479835137e2cbf9', 'request_id': 'req-8a46ccd0-ca03-49cf-9824-e392e876707b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:56.170187 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8a46ccd0-ca03-49cf-9824-e392e876707b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e32b7fdc90b409e8479835137e2cbf9', 'request_id': 'req-8a46ccd0-ca03-49cf-9824-e392e876707b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:56.176023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8a46ccd0-ca03-49cf-9824-e392e876707b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e32b7fdc90b409e8479835137e2cbf9', 'request_id': 'req-8a46ccd0-ca03-49cf-9824-e392e876707b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:56.187912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8a46ccd0-ca03-49cf-9824-e392e876707b admin admin] The token cache is being invalidate because project 7e32b7fdc90b409e8479835137e2cbf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:25:56.188198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8a46ccd0-ca03-49cf-9824-e392e876707b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:56.188826 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8a46ccd0-ca03-49cf-9824-e392e876707b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:25:56.190361 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1206/2389] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:25:55 2022] DELETE /identity/v3/projects/7e32b7fdc90b409e8479835137e2cbf9 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:25:59.620806 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d24c0f-faa6-4f66-850f-42da309c81c0 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:59.622294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e1d24c0f-faa6-4f66-850f-42da309c81c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:59.696100 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d24c0f-faa6-4f66-850f-42da309c81c0 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:59.760745 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41a1c0-2ba9-4b5f-8eb8-bd13a0f3f881 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:59.761406 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41a1c0-2ba9-4b5f-8eb8-bd13a0f3f881 service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:59.761689 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41a1c0-2ba9-4b5f-8eb8-bd13a0f3f881 service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:59.761962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41a1c0-2ba9-4b5f-8eb8-bd13a0f3f881 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:59.763810 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-ca41a1c0-2ba9-4b5f-8eb8-bd13a0f3f881 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:59.775761 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41a1c0-2ba9-4b5f-8eb8-bd13a0f3f881 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:59.777235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41a1c0-2ba9-4b5f-8eb8-bd13a0f3f881 service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:59.787764 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1184/2390] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:25:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:26:01.121258 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de502e-bd86-47c5-9289-082d281386ea None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:01.121258 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de502e-bd86-47c5-9289-082d281386ea None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:01.121775 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de502e-bd86-47c5-9289-082d281386ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:01.140054 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-e4de502e-bd86-47c5-9289-082d281386ea None None] MFA Rules not processed for user `c0fc3052af194b48b7ce036ff605ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:26:01.141260 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e4de502e-bd86-47c5-9289-082d281386ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:01.194263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1207/2391] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 10 21:26:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:26:01.208359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41a1c0-2ba9-4b5f-8eb8-bd13a0f3f881 service nova] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:01.209821 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-ca41a1c0-2ba9-4b5f-8eb8-bd13a0f3f881 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:01.279596 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41a1c0-2ba9-4b5f-8eb8-bd13a0f3f881 service nova] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:01.285110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34755997-097b-4da2-9db4-97fd311c92bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76040882d4374087bb7458fd8b5c1d8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:01.285784 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34755997-097b-4da2-9db4-97fd311c92bb service swift] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:01.286243 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34755997-097b-4da2-9db4-97fd311c92bb service swift] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:01.286495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34755997-097b-4da2-9db4-97fd311c92bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:01.295921 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34755997-097b-4da2-9db4-97fd311c92bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:01.297685 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34755997-097b-4da2-9db4-97fd311c92bb service swift] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:01.313770 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1185/2392] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 10 21:26:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 21:26:03.305712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de502e-bd86-47c5-9289-082d281386ea None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:03.307859 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e4de502e-bd86-47c5-9289-082d281386ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:03.327758 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de502e-bd86-47c5-9289-082d281386ea None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:03.335167 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5c3e9-4b2b-495a-a52b-1d3028af73b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:03.336444 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5c3e9-4b2b-495a-a52b-1d3028af73b1 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:03.337122 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5c3e9-4b2b-495a-a52b-1d3028af73b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:03.337670 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5c3e9-4b2b-495a-a52b-1d3028af73b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:03.339915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b1a5c3e9-4b2b-495a-a52b-1d3028af73b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:03.354968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5c3e9-4b2b-495a-a52b-1d3028af73b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:03.357316 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5c3e9-4b2b-495a-a52b-1d3028af73b1 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:03.384297 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1208/2393] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:26:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:26:06.210662 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34755997-097b-4da2-9db4-97fd311c92bb service swift] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:06.212916 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-34755997-097b-4da2-9db4-97fd311c92bb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:06.283368 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34755997-097b-4da2-9db4-97fd311c92bb service swift] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:06.288212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03bbed-73f7-4385-ade2-a822b22e46b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:06.289906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03bbed-73f7-4385-ade2-a822b22e46b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:06.290331 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03bbed-73f7-4385-ade2-a822b22e46b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:06.290558 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03bbed-73f7-4385-ade2-a822b22e46b3 admin admin] PATH_INFO: `/v3/users/853fac69f4d64aa7927d106cb0be84b2` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:06.291782 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03bbed-73f7-4385-ade2-a822b22e46b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=853fac69f4d64aa7927d106cb0be84b2)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:06.293707 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03bbed-73f7-4385-ade2-a822b22e46b3 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:06.490187 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4f03bbed-73f7-4385-ade2-a822b22e46b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '853fac69f4d64aa7927d106cb0be84b2'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:06.490952 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4f03bbed-73f7-4385-ade2-a822b22e46b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '853fac69f4d64aa7927d106cb0be84b2'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:06.506480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4f03bbed-73f7-4385-ade2-a822b22e46b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '853fac69f4d64aa7927d106cb0be84b2'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:06.507279 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4f03bbed-73f7-4385-ade2-a822b22e46b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '853fac69f4d64aa7927d106cb0be84b2'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:06.519722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4f03bbed-73f7-4385-ade2-a822b22e46b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '853fac69f4d64aa7927d106cb0be84b2'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:06.611392 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1186/2394] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:26:06 2022] DELETE /identity/v3/users/853fac69f4d64aa7927d106cb0be84b2 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:26:06.616011 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368c3a0-c1ae-4c51-b5d0-0b002844e79c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:06.616547 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368c3a0-c1ae-4c51-b5d0-0b002844e79c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:06.616655 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368c3a0-c1ae-4c51-b5d0-0b002844e79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:06.639428 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-c368c3a0-c1ae-4c51-b5d0-0b002844e79c None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:26:06.641179 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c368c3a0-c1ae-4c51-b5d0-0b002844e79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:06.714658 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1209/2395] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:26:06.725804 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03bbed-73f7-4385-ade2-a822b22e46b3 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:06.734193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4f03bbed-73f7-4385-ade2-a822b22e46b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:06.810666 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03bbed-73f7-4385-ade2-a822b22e46b3 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:06.814910 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4516f4c-2f71-4ec5-a51a-ed365767f646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:06.815965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4516f4c-2f71-4ec5-a51a-ed365767f646 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:06.816434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4516f4c-2f71-4ec5-a51a-ed365767f646 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:06.816867 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4516f4c-2f71-4ec5-a51a-ed365767f646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:06.829372 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4516f4c-2f71-4ec5-a51a-ed365767f646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:06.830996 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4516f4c-2f71-4ec5-a51a-ed365767f646 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:06.852347 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1187/2396] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:26:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:26:07.420028 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368c3a0-c1ae-4c51-b5d0-0b002844e79c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:07.422497 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c368c3a0-c1ae-4c51-b5d0-0b002844e79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:07.438051 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368c3a0-c1ae-4c51-b5d0-0b002844e79c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:07.450179 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578b908-d7aa-4f75-90ef-ba44c4edaa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:07.451593 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578b908-d7aa-4f75-90ef-ba44c4edaa5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:07.452498 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578b908-d7aa-4f75-90ef-ba44c4edaa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:07.452941 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578b908-d7aa-4f75-90ef-ba44c4edaa5f admin admin] PATH_INFO: `/v3/projects/1f8ba34ea041484a95d0b9ef6336c244` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:07.457477 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578b908-d7aa-4f75-90ef-ba44c4edaa5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f8ba34ea041484a95d0b9ef6336c244)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:07.460583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578b908-d7aa-4f75-90ef-ba44c4edaa5f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:07.605127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b578b908-d7aa-4f75-90ef-ba44c4edaa5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f8ba34ea041484a95d0b9ef6336c244', 'request_id': 'req-b578b908-d7aa-4f75-90ef-ba44c4edaa5f'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:07.674423 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b578b908-d7aa-4f75-90ef-ba44c4edaa5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f8ba34ea041484a95d0b9ef6336c244', 'request_id': 'req-b578b908-d7aa-4f75-90ef-ba44c4edaa5f'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:07.682267 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b578b908-d7aa-4f75-90ef-ba44c4edaa5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f8ba34ea041484a95d0b9ef6336c244', 'request_id': 'req-b578b908-d7aa-4f75-90ef-ba44c4edaa5f'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:07.697381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b578b908-d7aa-4f75-90ef-ba44c4edaa5f admin admin] The token cache is being invalidate because project 1f8ba34ea041484a95d0b9ef6336c244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:26:07.697682 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b578b908-d7aa-4f75-90ef-ba44c4edaa5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:07.698605 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b578b908-d7aa-4f75-90ef-ba44c4edaa5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:07.700776 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1210/2397] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:26:07 2022] DELETE /identity/v3/projects/1f8ba34ea041484a95d0b9ef6336c244 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:26:07.707681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82bad9-1cb0-4825-b33f-2db59c1a0f32 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:07.712760 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82bad9-1cb0-4825-b33f-2db59c1a0f32 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:07.712760 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82bad9-1cb0-4825-b33f-2db59c1a0f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:07.733982 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-4b82bad9-1cb0-4825-b33f-2db59c1a0f32 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:26:07.736208 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4b82bad9-1cb0-4825-b33f-2db59c1a0f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:07.799101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1188/2398] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:26:07.807991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de446dc-4e2e-4323-982c-487509e05a66 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:07.808292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de446dc-4e2e-4323-982c-487509e05a66 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:07.808577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de446dc-4e2e-4323-982c-487509e05a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:07.827621 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2de446dc-4e2e-4323-982c-487509e05a66 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:26:07.828833 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2de446dc-4e2e-4323-982c-487509e05a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:07.837635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1211/2399] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:26:07.841997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82bad9-1cb0-4825-b33f-2db59c1a0f32 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:07.854506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82bad9-1cb0-4825-b33f-2db59c1a0f32 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:07.858031 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647bb63-aa50-4ad3-a835-46d9c37980a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:07.858926 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647bb63-aa50-4ad3-a835-46d9c37980a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:07.859064 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647bb63-aa50-4ad3-a835-46d9c37980a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:07.859481 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647bb63-aa50-4ad3-a835-46d9c37980a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:07.860020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647bb63-aa50-4ad3-a835-46d9c37980a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:26:07.860324 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647bb63-aa50-4ad3-a835-46d9c37980a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:07.861925 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647bb63-aa50-4ad3-a835-46d9c37980a7 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:07.875004 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1189/2400] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:26:07.879326 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de446dc-4e2e-4323-982c-487509e05a66 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:07.890376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de446dc-4e2e-4323-982c-487509e05a66 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:07.895731 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d3576-27f1-4f0c-abd6-c72280325c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:07.896408 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d3576-27f1-4f0c-abd6-c72280325c6b admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:07.896696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d3576-27f1-4f0c-abd6-c72280325c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:07.896973 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d3576-27f1-4f0c-abd6-c72280325c6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:07.898930 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d3576-27f1-4f0c-abd6-c72280325c6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:07.901449 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d3576-27f1-4f0c-abd6-c72280325c6b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:08.274893 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1212/2401] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:26:07 2022] POST /identity/v3/projects => generated 377 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:26:08.279083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647bb63-aa50-4ad3-a835-46d9c37980a7 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:08.288826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647bb63-aa50-4ad3-a835-46d9c37980a7 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:08.343872 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af3f4a-39a1-4d36-a633-5269416121ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:08.344545 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af3f4a-39a1-4d36-a633-5269416121ba admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:08.344830 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af3f4a-39a1-4d36-a633-5269416121ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:08.345109 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af3f4a-39a1-4d36-a633-5269416121ba admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:08.345792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af3f4a-39a1-4d36-a633-5269416121ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:08.347734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af3f4a-39a1-4d36-a633-5269416121ba admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:08.443590 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1190/2402] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:26:08 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:26:08.446661 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d3576-27f1-4f0c-abd6-c72280325c6b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:08.458505 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d3576-27f1-4f0c-abd6-c72280325c6b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:08.464352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a77ae-85c0-4588-be95-2b614aca6742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:08.466834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a77ae-85c0-4588-be95-2b614aca6742 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:08.466834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a77ae-85c0-4588-be95-2b614aca6742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:08.466834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a77ae-85c0-4588-be95-2b614aca6742 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:08.466834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a77ae-85c0-4588-be95-2b614aca6742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:08.468114 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a77ae-85c0-4588-be95-2b614aca6742 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:08.480152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1213/2403] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:26:08.484538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af3f4a-39a1-4d36-a633-5269416121ba admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:08.495218 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af3f4a-39a1-4d36-a633-5269416121ba admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:08.502606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ab99c-d898-4675-98a6-a334600629d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:08.503182 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ab99c-d898-4675-98a6-a334600629d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:08.503182 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ab99c-d898-4675-98a6-a334600629d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:08.503685 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ab99c-d898-4675-98a6-a334600629d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:08.504263 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ab99c-d898-4675-98a6-a334600629d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:08.505947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ab99c-d898-4675-98a6-a334600629d3 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:08.520555 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1191/2404] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:26:08.527742 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a77ae-85c0-4588-be95-2b614aca6742 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:08.539125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a77ae-85c0-4588-be95-2b614aca6742 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:08.544947 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c736bd-8861-4b4b-8264-a871e77f989b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:08.545957 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c736bd-8861-4b4b-8264-a871e77f989b admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:08.546302 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c736bd-8861-4b4b-8264-a871e77f989b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:08.546675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c736bd-8861-4b4b-8264-a871e77f989b admin admin] PATH_INFO: `/v3/projects/9b00c46c428f404886be4b129d3b4071/users/71a2f300039547c4b677dbaab9d4809a/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:08.565694 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c736bd-8861-4b4b-8264-a871e77f989b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b00c46c428f404886be4b129d3b4071, user_id=71a2f300039547c4b677dbaab9d4809a, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:08.568447 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c736bd-8861-4b4b-8264-a871e77f989b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:08.647192 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1214/2405] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:26:08 2022] PUT /identity/v3/projects/9b00c46c428f404886be4b129d3b4071/users/71a2f300039547c4b677dbaab9d4809a/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:26:08.660172 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c218121-2d02-455a-9106-b4e6f22395ca None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:08.660510 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c218121-2d02-455a-9106-b4e6f22395ca None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:08.660804 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c218121-2d02-455a-9106-b4e6f22395ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:08.693227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-8c218121-2d02-455a-9106-b4e6f22395ca None None] MFA Rules not processed for user `71a2f300039547c4b677dbaab9d4809a`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:26:08.694775 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-8c218121-2d02-455a-9106-b4e6f22395ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:08.775339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1192/2406] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:26:08.791628 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c736bd-8861-4b4b-8264-a871e77f989b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:08.794038 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-62c736bd-8861-4b4b-8264-a871e77f989b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:08.866094 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c736bd-8861-4b4b-8264-a871e77f989b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:08.870082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0ec3c-eb2c-4840-bd68-01457238847e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:08.870786 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0ec3c-eb2c-4840-bd68-01457238847e service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:08.871076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0ec3c-eb2c-4840-bd68-01457238847e service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:08.871359 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0ec3c-eb2c-4840-bd68-01457238847e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:08.881539 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0ec3c-eb2c-4840-bd68-01457238847e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:08.883211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0ec3c-eb2c-4840-bd68-01457238847e service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:08.895015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1215/2407] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:26:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:26:27.881713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a0180-fa29-41fa-874f-00a3ce4ecc93 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:27.885173 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a0180-fa29-41fa-874f-00a3ce4ecc93 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:27.885173 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a0180-fa29-41fa-874f-00a3ce4ecc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:27.900195 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-049a0180-fa29-41fa-874f-00a3ce4ecc93 None None] MFA Rules not processed for user `c0fc3052af194b48b7ce036ff605ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:26:27.901372 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-049a0180-fa29-41fa-874f-00a3ce4ecc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:27.956738 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1193/2408] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 10 21:26:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:26:27.968857 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0ec3c-eb2c-4840-bd68-01457238847e service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:27.970313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-77e0ec3c-eb2c-4840-bd68-01457238847e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:28.040226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0ec3c-eb2c-4840-bd68-01457238847e service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:28.046053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632addb-ab6f-4c8b-b460-55554e11a8e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76040882d4374087bb7458fd8b5c1d8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:28.046709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632addb-ab6f-4c8b-b460-55554e11a8e6 service swift] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:28.046999 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632addb-ab6f-4c8b-b460-55554e11a8e6 service swift] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:28.047276 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632addb-ab6f-4c8b-b460-55554e11a8e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:28.055217 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632addb-ab6f-4c8b-b460-55554e11a8e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:28.056796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632addb-ab6f-4c8b-b460-55554e11a8e6 service swift] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:28.065619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1216/2409] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 10 21:26:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 21:26:33.187401 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a0180-fa29-41fa-874f-00a3ce4ecc93 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:33.281037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a0180-fa29-41fa-874f-00a3ce4ecc93 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:33.285606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec6a4a-2238-473a-aeec-a0dcc11cff9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:33.286505 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec6a4a-2238-473a-aeec-a0dcc11cff9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:33.286791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec6a4a-2238-473a-aeec-a0dcc11cff9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:33.287066 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec6a4a-2238-473a-aeec-a0dcc11cff9c admin admin] PATH_INFO: `/v3/users/71a2f300039547c4b677dbaab9d4809a` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:33.288263 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec6a4a-2238-473a-aeec-a0dcc11cff9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a2f300039547c4b677dbaab9d4809a)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:33.290198 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec6a4a-2238-473a-aeec-a0dcc11cff9c admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:33.494901 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-53ec6a4a-2238-473a-aeec-a0dcc11cff9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a2f300039547c4b677dbaab9d4809a'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:33.495675 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-53ec6a4a-2238-473a-aeec-a0dcc11cff9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a2f300039547c4b677dbaab9d4809a'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:33.510687 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-53ec6a4a-2238-473a-aeec-a0dcc11cff9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a2f300039547c4b677dbaab9d4809a'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:33.511509 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-53ec6a4a-2238-473a-aeec-a0dcc11cff9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a2f300039547c4b677dbaab9d4809a'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:33.520115 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-53ec6a4a-2238-473a-aeec-a0dcc11cff9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a2f300039547c4b677dbaab9d4809a'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:33.591828 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1194/2410] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:26:33 2022] DELETE /identity/v3/users/71a2f300039547c4b677dbaab9d4809a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:26:33.596520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2474f-3b31-4d0e-bd88-9b6607c73bd2 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:33.597611 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2474f-3b31-4d0e-bd88-9b6607c73bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:33.600303 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2474f-3b31-4d0e-bd88-9b6607c73bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:33.617727 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-31e2474f-3b31-4d0e-bd88-9b6607c73bd2 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:26:33.618922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-31e2474f-3b31-4d0e-bd88-9b6607c73bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:33.688807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1217/2411] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:26:33.698309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec6a4a-2238-473a-aeec-a0dcc11cff9c admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:33.699799 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-53ec6a4a-2238-473a-aeec-a0dcc11cff9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:33.754375 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec6a4a-2238-473a-aeec-a0dcc11cff9c admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:33.757975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedbb60-77e0-4b9e-849b-034b6cc6cb1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:33.758642 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedbb60-77e0-4b9e-849b-034b6cc6cb1e service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:33.758926 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedbb60-77e0-4b9e-849b-034b6cc6cb1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:33.759198 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedbb60-77e0-4b9e-849b-034b6cc6cb1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:33.768218 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dedbb60-77e0-4b9e-849b-034b6cc6cb1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:33.769622 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dedbb60-77e0-4b9e-849b-034b6cc6cb1e service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:33.779267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1195/2412] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:26:34.208794 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2474f-3b31-4d0e-bd88-9b6607c73bd2 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:34.210611 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-31e2474f-3b31-4d0e-bd88-9b6607c73bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:34.226992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2474f-3b31-4d0e-bd88-9b6607c73bd2 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:34.232390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec0092-7b11-4408-b4e3-ad98f93ac18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:34.233453 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec0092-7b11-4408-b4e3-ad98f93ac18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:34.233749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec0092-7b11-4408-b4e3-ad98f93ac18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:34.234071 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec0092-7b11-4408-b4e3-ad98f93ac18c admin admin] PATH_INFO: `/v3/projects/9b00c46c428f404886be4b129d3b4071` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:34.235371 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec0092-7b11-4408-b4e3-ad98f93ac18c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b00c46c428f404886be4b129d3b4071)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:34.237441 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec0092-7b11-4408-b4e3-ad98f93ac18c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:34.336113 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1fec0092-7b11-4408-b4e3-ad98f93ac18c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b00c46c428f404886be4b129d3b4071', 'request_id': 'req-1fec0092-7b11-4408-b4e3-ad98f93ac18c'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:34.405250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1fec0092-7b11-4408-b4e3-ad98f93ac18c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b00c46c428f404886be4b129d3b4071', 'request_id': 'req-1fec0092-7b11-4408-b4e3-ad98f93ac18c'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:34.411929 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1fec0092-7b11-4408-b4e3-ad98f93ac18c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b00c46c428f404886be4b129d3b4071', 'request_id': 'req-1fec0092-7b11-4408-b4e3-ad98f93ac18c'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:34.424150 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1fec0092-7b11-4408-b4e3-ad98f93ac18c admin admin] The token cache is being invalidate because project 9b00c46c428f404886be4b129d3b4071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:26:34.424576 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1fec0092-7b11-4408-b4e3-ad98f93ac18c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:34.425246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1fec0092-7b11-4408-b4e3-ad98f93ac18c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:34.426837 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1218/2413] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:26:34 2022] DELETE /identity/v3/projects/9b00c46c428f404886be4b129d3b4071 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:26:34.431698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ae7e5-8152-4007-a85a-c472d9537dbf None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:34.432165 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ae7e5-8152-4007-a85a-c472d9537dbf None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:34.432260 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ae7e5-8152-4007-a85a-c472d9537dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:34.451839 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-b34ae7e5-8152-4007-a85a-c472d9537dbf None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:26:34.452958 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-b34ae7e5-8152-4007-a85a-c472d9537dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:34.528457 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1196/2414] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:26:34.537585 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232904aa-ad5d-45cb-b2cf-879f7ee5760c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:34.538041 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232904aa-ad5d-45cb-b2cf-879f7ee5760c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:34.538394 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232904aa-ad5d-45cb-b2cf-879f7ee5760c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:34.583704 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-232904aa-ad5d-45cb-b2cf-879f7ee5760c None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:26:34.585010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-232904aa-ad5d-45cb-b2cf-879f7ee5760c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:34.594190 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1219/2415] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:26:34.598511 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ae7e5-8152-4007-a85a-c472d9537dbf None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:34.609611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ae7e5-8152-4007-a85a-c472d9537dbf None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:34.614914 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f95af5-0008-4127-99c4-aea7bf726138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:34.616136 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f95af5-0008-4127-99c4-aea7bf726138 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:34.616557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f95af5-0008-4127-99c4-aea7bf726138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:34.616906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f95af5-0008-4127-99c4-aea7bf726138 admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:34.617794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f95af5-0008-4127-99c4-aea7bf726138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:26:34.618274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f95af5-0008-4127-99c4-aea7bf726138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:34.620209 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f95af5-0008-4127-99c4-aea7bf726138 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:34.633866 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1197/2416] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:26:34.638866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232904aa-ad5d-45cb-b2cf-879f7ee5760c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:34.648246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232904aa-ad5d-45cb-b2cf-879f7ee5760c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:34.653648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b12f3b-6903-4aea-9f61-633d42196161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:34.654306 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b12f3b-6903-4aea-9f61-633d42196161 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:34.654618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b12f3b-6903-4aea-9f61-633d42196161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:34.654892 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b12f3b-6903-4aea-9f61-633d42196161 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:34.655597 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b12f3b-6903-4aea-9f61-633d42196161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:34.657648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b12f3b-6903-4aea-9f61-633d42196161 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:34.806091 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1220/2417] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:26:34 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:26:34.815131 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f95af5-0008-4127-99c4-aea7bf726138 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:34.825681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f95af5-0008-4127-99c4-aea7bf726138 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:34.895726 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba9b19-4463-4ef1-93c9-e9c2a8b565ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:34.896934 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9b19-4463-4ef1-93c9-e9c2a8b565ab admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:34.897874 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9b19-4463-4ef1-93c9-e9c2a8b565ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:34.898466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9b19-4463-4ef1-93c9-e9c2a8b565ab admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:34.899582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba9b19-4463-4ef1-93c9-e9c2a8b565ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:34.901602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba9b19-4463-4ef1-93c9-e9c2a8b565ab admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:35.265532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1198/2418] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:26:34 2022] POST /identity/v3/users => generated 287 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:26:35.275496 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b12f3b-6903-4aea-9f61-633d42196161 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:35.278965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b12f3b-6903-4aea-9f61-633d42196161 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:35.283803 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbad73-8b12-4fc1-8c54-d8c2ae2a7d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:35.284478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbad73-8b12-4fc1-8c54-d8c2ae2a7d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:35.284810 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbad73-8b12-4fc1-8c54-d8c2ae2a7d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:35.285096 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbad73-8b12-4fc1-8c54-d8c2ae2a7d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:35.285906 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbad73-8b12-4fc1-8c54-d8c2ae2a7d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:35.287535 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbad73-8b12-4fc1-8c54-d8c2ae2a7d17 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:35.299335 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1221/2419] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:26:35.304097 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba9b19-4463-4ef1-93c9-e9c2a8b565ab admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:35.315060 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba9b19-4463-4ef1-93c9-e9c2a8b565ab admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:35.320060 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728493c8-7137-4360-9a08-945ba7a1f4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:35.320833 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728493c8-7137-4360-9a08-945ba7a1f4ee admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:35.321216 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728493c8-7137-4360-9a08-945ba7a1f4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:35.321563 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728493c8-7137-4360-9a08-945ba7a1f4ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:35.322328 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728493c8-7137-4360-9a08-945ba7a1f4ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:35.323964 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728493c8-7137-4360-9a08-945ba7a1f4ee admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:35.336093 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1199/2420] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:26:35.340243 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbad73-8b12-4fc1-8c54-d8c2ae2a7d17 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:35.350058 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbad73-8b12-4fc1-8c54-d8c2ae2a7d17 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:35.354625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d04b4f-c1af-40d9-aecd-56bdf8262766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:35.355501 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d04b4f-c1af-40d9-aecd-56bdf8262766 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:35.356594 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d04b4f-c1af-40d9-aecd-56bdf8262766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:35.357072 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d04b4f-c1af-40d9-aecd-56bdf8262766 admin admin] PATH_INFO: `/v3/projects/84c8ccec485d4eada07fd5970d3746c1/users/17bbfbb8572648569ac3f30d1fa76582/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:35.372041 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d04b4f-c1af-40d9-aecd-56bdf8262766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c8ccec485d4eada07fd5970d3746c1, user_id=17bbfbb8572648569ac3f30d1fa76582, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:35.375082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d04b4f-c1af-40d9-aecd-56bdf8262766 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:35.431478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1222/2421] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:26:35 2022] PUT /identity/v3/projects/84c8ccec485d4eada07fd5970d3746c1/users/17bbfbb8572648569ac3f30d1fa76582/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:26:35.442784 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812923c-97ab-49b8-9b01-ad0f0e8cd5a4 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:35.443335 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812923c-97ab-49b8-9b01-ad0f0e8cd5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:35.443335 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812923c-97ab-49b8-9b01-ad0f0e8cd5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:35.476871 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-7812923c-97ab-49b8-9b01-ad0f0e8cd5a4 None None] MFA Rules not processed for user `17bbfbb8572648569ac3f30d1fa76582`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:26:35.478154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-7812923c-97ab-49b8-9b01-ad0f0e8cd5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:35.557477 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1200/2422] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:26:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:26:35.572908 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d04b4f-c1af-40d9-aecd-56bdf8262766 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:35.575379 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a4d04b4f-c1af-40d9-aecd-56bdf8262766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:35.641818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d04b4f-c1af-40d9-aecd-56bdf8262766 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:35.646081 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a194453-ecb0-475a-a574-188558891506 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:35.646916 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a194453-ecb0-475a-a574-188558891506 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:35.647273 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a194453-ecb0-475a-a574-188558891506 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:35.647741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a194453-ecb0-475a-a574-188558891506 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:35.658724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a194453-ecb0-475a-a574-188558891506 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:35.660316 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a194453-ecb0-475a-a574-188558891506 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:35.669301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1223/2423] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:26:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:26:35.693333 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812923c-97ab-49b8-9b01-ad0f0e8cd5a4 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:35.765292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812923c-97ab-49b8-9b01-ad0f0e8cd5a4 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:35.770048 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391ad8b-22e9-4d3e-8172-92106b09951b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:35.771130 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391ad8b-22e9-4d3e-8172-92106b09951b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:35.771421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391ad8b-22e9-4d3e-8172-92106b09951b admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:35.771699 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391ad8b-22e9-4d3e-8172-92106b09951b admin admin] PATH_INFO: `/v3/users/17bbfbb8572648569ac3f30d1fa76582` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:35.773003 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391ad8b-22e9-4d3e-8172-92106b09951b admin admin] RBAC: Authorizing `identity:delete_user(user_id=17bbfbb8572648569ac3f30d1fa76582)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:35.774964 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391ad8b-22e9-4d3e-8172-92106b09951b admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:36.016783 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7391ad8b-22e9-4d3e-8172-92106b09951b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17bbfbb8572648569ac3f30d1fa76582'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:36.017432 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7391ad8b-22e9-4d3e-8172-92106b09951b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17bbfbb8572648569ac3f30d1fa76582'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:36.029736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7391ad8b-22e9-4d3e-8172-92106b09951b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17bbfbb8572648569ac3f30d1fa76582'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:36.030372 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7391ad8b-22e9-4d3e-8172-92106b09951b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17bbfbb8572648569ac3f30d1fa76582'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:36.036991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7391ad8b-22e9-4d3e-8172-92106b09951b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17bbfbb8572648569ac3f30d1fa76582'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:36.137600 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1201/2424] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:26:35 2022] DELETE /identity/v3/users/17bbfbb8572648569ac3f30d1fa76582 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:26:36.142090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32a230-f726-40c4-9a00-beb7154da0d6 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:36.142386 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32a230-f726-40c4-9a00-beb7154da0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:36.142700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32a230-f726-40c4-9a00-beb7154da0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:36.159809 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-ee32a230-f726-40c4-9a00-beb7154da0d6 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:26:36.161003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ee32a230-f726-40c4-9a00-beb7154da0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:36.251026 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1224/2425] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:26:36.262961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391ad8b-22e9-4d3e-8172-92106b09951b admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:36.264625 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-7391ad8b-22e9-4d3e-8172-92106b09951b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:36.323329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391ad8b-22e9-4d3e-8172-92106b09951b admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:36.327281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2dd4c-f2ca-4993-bc1b-5484562ae08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:36.327934 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2dd4c-f2ca-4993-bc1b-5484562ae08b service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:36.328222 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2dd4c-f2ca-4993-bc1b-5484562ae08b service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:36.328503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2dd4c-f2ca-4993-bc1b-5484562ae08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:36.337476 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2dd4c-f2ca-4993-bc1b-5484562ae08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:36.344603 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2dd4c-f2ca-4993-bc1b-5484562ae08b service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:36.348299 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1202/2426] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:26:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:26:36.822291 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32a230-f726-40c4-9a00-beb7154da0d6 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:36.823959 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ee32a230-f726-40c4-9a00-beb7154da0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:36.839586 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32a230-f726-40c4-9a00-beb7154da0d6 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:36.857505 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9de61-4b67-4d0c-a109-3031c7ab46a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:36.867581 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9de61-4b67-4d0c-a109-3031c7ab46a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:36.867581 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9de61-4b67-4d0c-a109-3031c7ab46a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:36.867581 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9de61-4b67-4d0c-a109-3031c7ab46a5 admin admin] PATH_INFO: `/v3/projects/84c8ccec485d4eada07fd5970d3746c1` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:36.867581 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9de61-4b67-4d0c-a109-3031c7ab46a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c8ccec485d4eada07fd5970d3746c1)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:36.867581 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9de61-4b67-4d0c-a109-3031c7ab46a5 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:37.268083 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-05c9de61-4b67-4d0c-a109-3031c7ab46a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c8ccec485d4eada07fd5970d3746c1', 'request_id': 'req-05c9de61-4b67-4d0c-a109-3031c7ab46a5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:37.319138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-05c9de61-4b67-4d0c-a109-3031c7ab46a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c8ccec485d4eada07fd5970d3746c1', 'request_id': 'req-05c9de61-4b67-4d0c-a109-3031c7ab46a5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:37.325155 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-05c9de61-4b67-4d0c-a109-3031c7ab46a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c8ccec485d4eada07fd5970d3746c1', 'request_id': 'req-05c9de61-4b67-4d0c-a109-3031c7ab46a5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:37.336290 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-05c9de61-4b67-4d0c-a109-3031c7ab46a5 admin admin] The token cache is being invalidate because project 84c8ccec485d4eada07fd5970d3746c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:26:37.336528 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-05c9de61-4b67-4d0c-a109-3031c7ab46a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:37.337192 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-05c9de61-4b67-4d0c-a109-3031c7ab46a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:37.338774 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1225/2427] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:26:36 2022] DELETE /identity/v3/projects/84c8ccec485d4eada07fd5970d3746c1 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:26:37.344374 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca780431-0ee6-48db-ae73-94e0e8aca0c9 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:37.344861 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca780431-0ee6-48db-ae73-94e0e8aca0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:37.344965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca780431-0ee6-48db-ae73-94e0e8aca0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:37.363626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-ca780431-0ee6-48db-ae73-94e0e8aca0c9 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:26:37.365670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-ca780431-0ee6-48db-ae73-94e0e8aca0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:37.423575 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1203/2428] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:26:37.431347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc43a9-ade9-499d-8155-78ddfbab7669 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:37.431643 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc43a9-ade9-499d-8155-78ddfbab7669 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:37.431928 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc43a9-ade9-499d-8155-78ddfbab7669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:37.451196 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-ecbc43a9-ade9-499d-8155-78ddfbab7669 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:26:37.452391 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ecbc43a9-ade9-499d-8155-78ddfbab7669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:37.460241 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1226/2429] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:26:37.464492 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca780431-0ee6-48db-ae73-94e0e8aca0c9 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:37.476543 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca780431-0ee6-48db-ae73-94e0e8aca0c9 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:37.481572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6204e1c-f48e-4474-ba98-846f3963e41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:37.482234 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6204e1c-f48e-4474-ba98-846f3963e41f admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:37.482565 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6204e1c-f48e-4474-ba98-846f3963e41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:37.482846 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6204e1c-f48e-4474-ba98-846f3963e41f admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:37.483643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6204e1c-f48e-4474-ba98-846f3963e41f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:26:37.483954 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6204e1c-f48e-4474-ba98-846f3963e41f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:37.485548 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6204e1c-f48e-4474-ba98-846f3963e41f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:37.497538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1204/2430] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:26:37.501796 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc43a9-ade9-499d-8155-78ddfbab7669 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:37.511222 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc43a9-ade9-499d-8155-78ddfbab7669 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:37.516563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd1ed2-158b-4e2e-863f-b5bcff3e4188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:37.517213 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd1ed2-158b-4e2e-863f-b5bcff3e4188 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:37.517503 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd1ed2-158b-4e2e-863f-b5bcff3e4188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:37.517920 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd1ed2-158b-4e2e-863f-b5bcff3e4188 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:37.518664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd1ed2-158b-4e2e-863f-b5bcff3e4188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:37.520545 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd1ed2-158b-4e2e-863f-b5bcff3e4188 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:37.595729 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1227/2431] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:26:37 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:26:37.599933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6204e1c-f48e-4474-ba98-846f3963e41f admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:37.610641 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6204e1c-f48e-4474-ba98-846f3963e41f admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:37.666581 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e52eb-7c1f-4b36-9418-6029e0369e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:37.667255 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e52eb-7c1f-4b36-9418-6029e0369e42 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:37.667538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e52eb-7c1f-4b36-9418-6029e0369e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:37.667810 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e52eb-7c1f-4b36-9418-6029e0369e42 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:37.668687 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e52eb-7c1f-4b36-9418-6029e0369e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:37.670633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e52eb-7c1f-4b36-9418-6029e0369e42 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:37.782537 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1205/2432] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:26:37 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:26:37.786548 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd1ed2-158b-4e2e-863f-b5bcff3e4188 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:37.796742 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd1ed2-158b-4e2e-863f-b5bcff3e4188 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:37.801336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51b9ec-ef7a-4377-9171-ad8b187cbdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:37.801993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51b9ec-ef7a-4377-9171-ad8b187cbdf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:37.802283 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51b9ec-ef7a-4377-9171-ad8b187cbdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:37.802603 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51b9ec-ef7a-4377-9171-ad8b187cbdf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:37.803333 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51b9ec-ef7a-4377-9171-ad8b187cbdf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:37.804916 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51b9ec-ef7a-4377-9171-ad8b187cbdf1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:37.816351 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1228/2433] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:26:37.820206 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e52eb-7c1f-4b36-9418-6029e0369e42 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:37.830706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e52eb-7c1f-4b36-9418-6029e0369e42 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:37.835517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46165d-a879-4703-b59e-8899b7e50ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:37.836168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46165d-a879-4703-b59e-8899b7e50ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:37.836450 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46165d-a879-4703-b59e-8899b7e50ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:37.836724 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46165d-a879-4703-b59e-8899b7e50ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:37.837473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46165d-a879-4703-b59e-8899b7e50ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:37.839137 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46165d-a879-4703-b59e-8899b7e50ee8 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:37.849648 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1206/2434] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:26:37.853695 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51b9ec-ef7a-4377-9171-ad8b187cbdf1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:37.863759 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51b9ec-ef7a-4377-9171-ad8b187cbdf1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:37.868347 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4172a3b-d629-4523-9757-822ee388d4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:37.869222 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4172a3b-d629-4523-9757-822ee388d4b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:37.869500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4172a3b-d629-4523-9757-822ee388d4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:37.869769 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4172a3b-d629-4523-9757-822ee388d4b3 admin admin] PATH_INFO: `/v3/projects/147fa1ffc7e9485d9aa67bd2688fee09/users/e093cf07f1e94793bf1aad5b52012e9d/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:37.884289 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4172a3b-d629-4523-9757-822ee388d4b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=147fa1ffc7e9485d9aa67bd2688fee09, user_id=e093cf07f1e94793bf1aad5b52012e9d, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:37.887800 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4172a3b-d629-4523-9757-822ee388d4b3 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:37.971726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1229/2435] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:26:37 2022] PUT /identity/v3/projects/147fa1ffc7e9485d9aa67bd2688fee09/users/e093cf07f1e94793bf1aad5b52012e9d/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:26:37.983665 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b1673-ebab-4ceb-877f-3865b2418dc6 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:37.983961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b1673-ebab-4ceb-877f-3865b2418dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:37.984247 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b1673-ebab-4ceb-877f-3865b2418dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:38.009729 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-686b1673-ebab-4ceb-877f-3865b2418dc6 None None] MFA Rules not processed for user `e093cf07f1e94793bf1aad5b52012e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:26:38.011236 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-686b1673-ebab-4ceb-877f-3865b2418dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:38.074799 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1207/2436] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:26:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:26:38.085474 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4172a3b-d629-4523-9757-822ee388d4b3 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:38.087155 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d4172a3b-d629-4523-9757-822ee388d4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:38.143356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4172a3b-d629-4523-9757-822ee388d4b3 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:38.146958 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd2bb0-b1e0-4ebf-b8e4-d1bd80e28155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:38.147604 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd2bb0-b1e0-4ebf-b8e4-d1bd80e28155 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:38.147891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd2bb0-b1e0-4ebf-b8e4-d1bd80e28155 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:38.148166 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd2bb0-b1e0-4ebf-b8e4-d1bd80e28155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:38.156775 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd2bb0-b1e0-4ebf-b8e4-d1bd80e28155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:38.158181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd2bb0-b1e0-4ebf-b8e4-d1bd80e28155 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:38.167299 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1230/2437] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:26:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:26:45.142928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fda1a-305c-4bf6-93c8-9a8371f55dcb None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:45.143391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fda1a-305c-4bf6-93c8-9a8371f55dcb None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:45.143502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fda1a-305c-4bf6-93c8-9a8371f55dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:45.161795 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-4a2fda1a-305c-4bf6-93c8-9a8371f55dcb None None] MFA Rules not processed for user `c0fc3052af194b48b7ce036ff605ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:26:45.163096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4a2fda1a-305c-4bf6-93c8-9a8371f55dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:45.222517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1208/2438] 10.222.0.25 () {58 vars in 967 bytes} [Tue May 10 21:26:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:26:45.248762 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd2bb0-b1e0-4ebf-b8e4-d1bd80e28155 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:45.250374 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f3fd2bb0-b1e0-4ebf-b8e4-d1bd80e28155 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:45.334711 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd2bb0-b1e0-4ebf-b8e4-d1bd80e28155 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:45.342813 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0934dd8-0673-40b3-8d4b-ebea0a5a2d14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76040882d4374087bb7458fd8b5c1d8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:45.343574 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0934dd8-0673-40b3-8d4b-ebea0a5a2d14 service swift] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:45.343925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0934dd8-0673-40b3-8d4b-ebea0a5a2d14 service swift] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:45.344270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0934dd8-0673-40b3-8d4b-ebea0a5a2d14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:45.353848 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0934dd8-0673-40b3-8d4b-ebea0a5a2d14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:45.355472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0934dd8-0673-40b3-8d4b-ebea0a5a2d14 service swift] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:45.365082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1231/2439] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 10 21:26:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 21:26:50.568311 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fda1a-305c-4bf6-93c8-9a8371f55dcb None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:50.638406 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fda1a-305c-4bf6-93c8-9a8371f55dcb None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:50.643779 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03600f-ec59-4cbb-a9c3-54fc9c679b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:50.644688 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03600f-ec59-4cbb-a9c3-54fc9c679b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:50.644974 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03600f-ec59-4cbb-a9c3-54fc9c679b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:50.645255 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03600f-ec59-4cbb-a9c3-54fc9c679b6e admin admin] PATH_INFO: `/v3/users/e093cf07f1e94793bf1aad5b52012e9d` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:50.646464 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03600f-ec59-4cbb-a9c3-54fc9c679b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e093cf07f1e94793bf1aad5b52012e9d)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:50.648400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03600f-ec59-4cbb-a9c3-54fc9c679b6e admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:50.868158 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6c03600f-ec59-4cbb-a9c3-54fc9c679b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e093cf07f1e94793bf1aad5b52012e9d'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:50.868843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6c03600f-ec59-4cbb-a9c3-54fc9c679b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e093cf07f1e94793bf1aad5b52012e9d'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:50.881950 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6c03600f-ec59-4cbb-a9c3-54fc9c679b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e093cf07f1e94793bf1aad5b52012e9d'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:50.882705 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6c03600f-ec59-4cbb-a9c3-54fc9c679b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e093cf07f1e94793bf1aad5b52012e9d'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:50.890746 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6c03600f-ec59-4cbb-a9c3-54fc9c679b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e093cf07f1e94793bf1aad5b52012e9d'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:50.965715 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1209/2440] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:26:50 2022] DELETE /identity/v3/users/e093cf07f1e94793bf1aad5b52012e9d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:26:50.970972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9d3a6-62ba-474f-b7c3-d2ba9c9e6c11 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:50.971472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9d3a6-62ba-474f-b7c3-d2ba9c9e6c11 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:50.971774 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9d3a6-62ba-474f-b7c3-d2ba9c9e6c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:50.991411 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8fd9d3a6-62ba-474f-b7c3-d2ba9c9e6c11 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:26:50.992899 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8fd9d3a6-62ba-474f-b7c3-d2ba9c9e6c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:51.055158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1232/2441] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:26:51.065205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03600f-ec59-4cbb-a9c3-54fc9c679b6e admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:51.066751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-6c03600f-ec59-4cbb-a9c3-54fc9c679b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:51.126050 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03600f-ec59-4cbb-a9c3-54fc9c679b6e admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:51.129903 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d77c03-884f-4d59-96f0-1e7d7dba43c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:51.130605 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d77c03-884f-4d59-96f0-1e7d7dba43c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:51.130892 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d77c03-884f-4d59-96f0-1e7d7dba43c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:51.131167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d77c03-884f-4d59-96f0-1e7d7dba43c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:51.142291 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d77c03-884f-4d59-96f0-1e7d7dba43c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:51.143848 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d77c03-884f-4d59-96f0-1e7d7dba43c3 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:51.153441 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1210/2442] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:26:51.578110 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9d3a6-62ba-474f-b7c3-d2ba9c9e6c11 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:51.579635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8fd9d3a6-62ba-474f-b7c3-d2ba9c9e6c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:51.591305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9d3a6-62ba-474f-b7c3-d2ba9c9e6c11 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:51.596863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e1e73-ab87-47ee-9c34-6c5dc80a2c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:51.597731 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e1e73-ab87-47ee-9c34-6c5dc80a2c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:51.598083 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e1e73-ab87-47ee-9c34-6c5dc80a2c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:51.598361 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e1e73-ab87-47ee-9c34-6c5dc80a2c57 admin admin] PATH_INFO: `/v3/projects/147fa1ffc7e9485d9aa67bd2688fee09` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:51.599584 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e1e73-ab87-47ee-9c34-6c5dc80a2c57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=147fa1ffc7e9485d9aa67bd2688fee09)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:51.601478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e1e73-ab87-47ee-9c34-6c5dc80a2c57 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:51.701725 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-259e1e73-ab87-47ee-9c34-6c5dc80a2c57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '147fa1ffc7e9485d9aa67bd2688fee09', 'request_id': 'req-259e1e73-ab87-47ee-9c34-6c5dc80a2c57'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:51.764879 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-259e1e73-ab87-47ee-9c34-6c5dc80a2c57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '147fa1ffc7e9485d9aa67bd2688fee09', 'request_id': 'req-259e1e73-ab87-47ee-9c34-6c5dc80a2c57'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:51.771290 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-259e1e73-ab87-47ee-9c34-6c5dc80a2c57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '147fa1ffc7e9485d9aa67bd2688fee09', 'request_id': 'req-259e1e73-ab87-47ee-9c34-6c5dc80a2c57'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:51.782726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-259e1e73-ab87-47ee-9c34-6c5dc80a2c57 admin admin] The token cache is being invalidate because project 147fa1ffc7e9485d9aa67bd2688fee09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:26:51.783011 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-259e1e73-ab87-47ee-9c34-6c5dc80a2c57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:51.783645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-259e1e73-ab87-47ee-9c34-6c5dc80a2c57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:51.785169 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1233/2443] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:26:51 2022] DELETE /identity/v3/projects/147fa1ffc7e9485d9aa67bd2688fee09 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:26:51.789936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805af3e-6a9d-429d-8a74-a375879371d9 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:51.790426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805af3e-6a9d-429d-8a74-a375879371d9 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:51.790557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805af3e-6a9d-429d-8a74-a375879371d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:51.809282 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-7805af3e-6a9d-429d-8a74-a375879371d9 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:26:51.810688 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-7805af3e-6a9d-429d-8a74-a375879371d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:51.873535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1211/2444] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:26:51.881806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbdb80-368c-432c-bd8c-442ebcd6d889 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:51.882103 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbdb80-368c-432c-bd8c-442ebcd6d889 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:51.882388 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbdb80-368c-432c-bd8c-442ebcd6d889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:51.901461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-edbbdb80-368c-432c-bd8c-442ebcd6d889 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:26:51.902650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-edbbdb80-368c-432c-bd8c-442ebcd6d889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:51.911043 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1234/2445] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:26:51.915215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805af3e-6a9d-429d-8a74-a375879371d9 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:51.925354 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805af3e-6a9d-429d-8a74-a375879371d9 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:51.929960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdcab3-5e86-4b37-ac2a-4a869fbbf3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:51.930648 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdcab3-5e86-4b37-ac2a-4a869fbbf3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:51.930936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdcab3-5e86-4b37-ac2a-4a869fbbf3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:51.931246 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdcab3-5e86-4b37-ac2a-4a869fbbf3e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:51.931984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdcab3-5e86-4b37-ac2a-4a869fbbf3e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:26:51.932270 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdcab3-5e86-4b37-ac2a-4a869fbbf3e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:51.933842 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdcab3-5e86-4b37-ac2a-4a869fbbf3e1 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:51.945344 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1212/2446] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:26:51.949619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbdb80-368c-432c-bd8c-442ebcd6d889 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:51.960270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbdb80-368c-432c-bd8c-442ebcd6d889 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:51.965507 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a917463-547f-45dc-9092-3ba6dde26c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:51.966164 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a917463-547f-45dc-9092-3ba6dde26c25 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:51.966478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a917463-547f-45dc-9092-3ba6dde26c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:51.966763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a917463-547f-45dc-9092-3ba6dde26c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:51.967459 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a917463-547f-45dc-9092-3ba6dde26c25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:51.970583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a917463-547f-45dc-9092-3ba6dde26c25 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:52.070469 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1235/2447] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:26:51 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:26:52.073937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdcab3-5e86-4b37-ac2a-4a869fbbf3e1 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:52.084986 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdcab3-5e86-4b37-ac2a-4a869fbbf3e1 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:52.141849 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb74aa-b3b0-4557-95af-1df91058ef5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:52.142555 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb74aa-b3b0-4557-95af-1df91058ef5e admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:52.142836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb74aa-b3b0-4557-95af-1df91058ef5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:52.143110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb74aa-b3b0-4557-95af-1df91058ef5e admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:52.143814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb74aa-b3b0-4557-95af-1df91058ef5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:52.146164 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb74aa-b3b0-4557-95af-1df91058ef5e admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:52.243677 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1213/2448] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:26:52 2022] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:26:52.244736 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a917463-547f-45dc-9092-3ba6dde26c25 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:52.255683 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a917463-547f-45dc-9092-3ba6dde26c25 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:52.260673 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811cfe0-d0c2-405d-a065-546106291710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:52.261330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811cfe0-d0c2-405d-a065-546106291710 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:52.261616 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811cfe0-d0c2-405d-a065-546106291710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:52.261890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811cfe0-d0c2-405d-a065-546106291710 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:52.262643 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811cfe0-d0c2-405d-a065-546106291710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:52.264227 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811cfe0-d0c2-405d-a065-546106291710 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:52.275973 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1236/2449] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:26:52.279583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb74aa-b3b0-4557-95af-1df91058ef5e admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:52.290065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb74aa-b3b0-4557-95af-1df91058ef5e admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:52.295362 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c0bd8-5d93-4b59-896c-f8a7811f04f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:52.300551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c0bd8-5d93-4b59-896c-f8a7811f04f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:52.300551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c0bd8-5d93-4b59-896c-f8a7811f04f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:52.300551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c0bd8-5d93-4b59-896c-f8a7811f04f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:52.300551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c0bd8-5d93-4b59-896c-f8a7811f04f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:52.300551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c0bd8-5d93-4b59-896c-f8a7811f04f7 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:52.309180 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1214/2450] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:26:52.313906 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811cfe0-d0c2-405d-a065-546106291710 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:52.323789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811cfe0-d0c2-405d-a065-546106291710 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:52.329341 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a9a43-50d9-4b48-b580-f0576f293f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:52.330252 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a9a43-50d9-4b48-b580-f0576f293f78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:52.330565 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a9a43-50d9-4b48-b580-f0576f293f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:52.330847 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a9a43-50d9-4b48-b580-f0576f293f78 admin admin] PATH_INFO: `/v3/projects/ed0ac16b403f41cbaf14caf46439ec49/users/36b38e7eebc24703a7c6c6c8481c02c0/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:52.345743 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a9a43-50d9-4b48-b580-f0576f293f78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed0ac16b403f41cbaf14caf46439ec49, user_id=36b38e7eebc24703a7c6c6c8481c02c0, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:52.348426 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a9a43-50d9-4b48-b580-f0576f293f78 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:52.428397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1237/2451] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:26:52 2022] PUT /identity/v3/projects/ed0ac16b403f41cbaf14caf46439ec49/users/36b38e7eebc24703a7c6c6c8481c02c0/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:26:52.447398 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352c358-50cb-4718-a160-c41b20a58075 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:52.447697 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352c358-50cb-4718-a160-c41b20a58075 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:52.447980 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352c358-50cb-4718-a160-c41b20a58075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:52.474789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-f352c358-50cb-4718-a160-c41b20a58075 None None] MFA Rules not processed for user `36b38e7eebc24703a7c6c6c8481c02c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:26:52.476075 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-f352c358-50cb-4718-a160-c41b20a58075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:52.539858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1215/2452] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:26:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:26:52.550554 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a9a43-50d9-4b48-b580-f0576f293f78 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:52.552248 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-379a9a43-50d9-4b48-b580-f0576f293f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:52.615263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a9a43-50d9-4b48-b580-f0576f293f78 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:52.620528 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bd71c-4b88-49ea-a09f-326c8c31f062 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:52.621237 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bd71c-4b88-49ea-a09f-326c8c31f062 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:52.621520 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bd71c-4b88-49ea-a09f-326c8c31f062 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:52.621840 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bd71c-4b88-49ea-a09f-326c8c31f062 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:52.631909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bd71c-4b88-49ea-a09f-326c8c31f062 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:52.633344 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bd71c-4b88-49ea-a09f-326c8c31f062 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:52.642995 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1238/2453] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:26:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:26:58.657260 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352c358-50cb-4718-a160-c41b20a58075 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:58.658096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-f352c358-50cb-4718-a160-c41b20a58075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:58.713852 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352c358-50cb-4718-a160-c41b20a58075 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:58.717551 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9e6ba-50f2-4b77-8098-accc8c0cefc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:58.718204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9e6ba-50f2-4b77-8098-accc8c0cefc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:58.718513 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9e6ba-50f2-4b77-8098-accc8c0cefc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:58.718791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9e6ba-50f2-4b77-8098-accc8c0cefc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:58.720557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-d6f9e6ba-50f2-4b77-8098-accc8c0cefc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:58.785454 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9e6ba-50f2-4b77-8098-accc8c0cefc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:58.786902 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9e6ba-50f2-4b77-8098-accc8c0cefc9 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:58.796277 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1216/2454] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:26:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:27:02.589726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bd71c-4b88-49ea-a09f-326c8c31f062 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:02.591244 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-643bd71c-4b88-49ea-a09f-326c8c31f062 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:02.605848 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bd71c-4b88-49ea-a09f-326c8c31f062 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:02.610549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7382a-c65e-4231-b3d9-fd1f9d262f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:02.611444 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7382a-c65e-4231-b3d9-fd1f9d262f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:02.611724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7382a-c65e-4231-b3d9-fd1f9d262f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:02.611994 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7382a-c65e-4231-b3d9-fd1f9d262f2f admin admin] PATH_INFO: `/v3/users/05eb9dfc751a4b44a8d4d7a03138f0d4` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:02.613910 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7382a-c65e-4231-b3d9-fd1f9d262f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=05eb9dfc751a4b44a8d4d7a03138f0d4)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:02.615930 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7382a-c65e-4231-b3d9-fd1f9d262f2f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:02.767177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-abe7382a-c65e-4231-b3d9-fd1f9d262f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05eb9dfc751a4b44a8d4d7a03138f0d4'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:02.767743 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-abe7382a-c65e-4231-b3d9-fd1f9d262f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05eb9dfc751a4b44a8d4d7a03138f0d4'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:02.768341 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-abe7382a-c65e-4231-b3d9-fd1f9d262f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05eb9dfc751a4b44a8d4d7a03138f0d4'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:02.780503 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-abe7382a-c65e-4231-b3d9-fd1f9d262f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05eb9dfc751a4b44a8d4d7a03138f0d4'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:02.788828 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-abe7382a-c65e-4231-b3d9-fd1f9d262f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05eb9dfc751a4b44a8d4d7a03138f0d4'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:02.862208 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1239/2455] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:27:02 2022] DELETE /identity/v3/users/05eb9dfc751a4b44a8d4d7a03138f0d4 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:03.099122 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9e6ba-50f2-4b77-8098-accc8c0cefc9 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:03.109453 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9e6ba-50f2-4b77-8098-accc8c0cefc9 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:03.169542 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69efa45-ac71-473d-bebb-6b7244eb8e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:03.170410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69efa45-ac71-473d-bebb-6b7244eb8e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:03.170727 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69efa45-ac71-473d-bebb-6b7244eb8e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:03.171008 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69efa45-ac71-473d-bebb-6b7244eb8e0b admin admin] PATH_INFO: `/v3/projects/604bb43d90e344d3a89838c6575d12c2` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:03.172197 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69efa45-ac71-473d-bebb-6b7244eb8e0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=604bb43d90e344d3a89838c6575d12c2)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:03.174096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69efa45-ac71-473d-bebb-6b7244eb8e0b admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:03.289715 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-b69efa45-ac71-473d-bebb-6b7244eb8e0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '604bb43d90e344d3a89838c6575d12c2', 'request_id': 'req-b69efa45-ac71-473d-bebb-6b7244eb8e0b'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:03.393843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-b69efa45-ac71-473d-bebb-6b7244eb8e0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '604bb43d90e344d3a89838c6575d12c2', 'request_id': 'req-b69efa45-ac71-473d-bebb-6b7244eb8e0b'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:03.401025 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-b69efa45-ac71-473d-bebb-6b7244eb8e0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '604bb43d90e344d3a89838c6575d12c2', 'request_id': 'req-b69efa45-ac71-473d-bebb-6b7244eb8e0b'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:03.412477 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-b69efa45-ac71-473d-bebb-6b7244eb8e0b admin admin] The token cache is being invalidate because project 604bb43d90e344d3a89838c6575d12c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:27:03.412935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-b69efa45-ac71-473d-bebb-6b7244eb8e0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:03.413603 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-b69efa45-ac71-473d-bebb-6b7244eb8e0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:03.415425 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1217/2456] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:27:03 2022] DELETE /identity/v3/projects/604bb43d90e344d3a89838c6575d12c2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:03.420180 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4950f-43b2-4f69-92b5-99aef56aec0f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:03.420476 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4950f-43b2-4f69-92b5-99aef56aec0f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:03.420755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4950f-43b2-4f69-92b5-99aef56aec0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:03.440234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-26b4950f-43b2-4f69-92b5-99aef56aec0f None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:03.442633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-26b4950f-43b2-4f69-92b5-99aef56aec0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:03.499366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1240/2457] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:27:03.507750 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03683d-5a0c-4665-bc6b-326b33cda0e4 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:03.508037 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03683d-5a0c-4665-bc6b-326b33cda0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:03.508311 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03683d-5a0c-4665-bc6b-326b33cda0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:03.527188 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-9c03683d-5a0c-4665-bc6b-326b33cda0e4 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:03.528381 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-9c03683d-5a0c-4665-bc6b-326b33cda0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:03.536808 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1218/2458] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:03.541035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4950f-43b2-4f69-92b5-99aef56aec0f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:03.551061 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4950f-43b2-4f69-92b5-99aef56aec0f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:03.555845 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0b165-b6e0-4c4a-8b9f-8f82031d7c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:03.556503 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0b165-b6e0-4c4a-8b9f-8f82031d7c37 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:03.556786 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0b165-b6e0-4c4a-8b9f-8f82031d7c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:03.557061 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0b165-b6e0-4c4a-8b9f-8f82031d7c37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:03.557832 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0b165-b6e0-4c4a-8b9f-8f82031d7c37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:27:03.558143 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0b165-b6e0-4c4a-8b9f-8f82031d7c37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:03.559766 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0b165-b6e0-4c4a-8b9f-8f82031d7c37 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:03.571128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1241/2459] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:27:03.575433 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03683d-5a0c-4665-bc6b-326b33cda0e4 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:03.585155 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03683d-5a0c-4665-bc6b-326b33cda0e4 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:03.589817 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eaa14b-0016-4e4b-ad98-30d03325dfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:03.590531 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eaa14b-0016-4e4b-ad98-30d03325dfa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:03.590818 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eaa14b-0016-4e4b-ad98-30d03325dfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:03.591098 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eaa14b-0016-4e4b-ad98-30d03325dfa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:03.591789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eaa14b-0016-4e4b-ad98-30d03325dfa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:03.593683 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eaa14b-0016-4e4b-ad98-30d03325dfa6 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:03.686343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1219/2460] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:27:03 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:03.691858 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0b165-b6e0-4c4a-8b9f-8f82031d7c37 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:03.702035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0b165-b6e0-4c4a-8b9f-8f82031d7c37 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:03.762195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381930a-d084-4b4f-afd8-3f0868e0eed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:03.762901 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381930a-d084-4b4f-afd8-3f0868e0eed6 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:03.763184 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381930a-d084-4b4f-afd8-3f0868e0eed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:03.763456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381930a-d084-4b4f-afd8-3f0868e0eed6 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:03.764153 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381930a-d084-4b4f-afd8-3f0868e0eed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:03.766040 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381930a-d084-4b4f-afd8-3f0868e0eed6 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:03.833845 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1242/2461] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:27:03 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:03.837972 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eaa14b-0016-4e4b-ad98-30d03325dfa6 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:03.849076 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eaa14b-0016-4e4b-ad98-30d03325dfa6 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:03.857519 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b20583-a657-4c01-b655-443eebb541db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:03.858305 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b20583-a657-4c01-b655-443eebb541db admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:03.858614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b20583-a657-4c01-b655-443eebb541db admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:03.858886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b20583-a657-4c01-b655-443eebb541db admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:03.859611 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b20583-a657-4c01-b655-443eebb541db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:03.861239 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b20583-a657-4c01-b655-443eebb541db admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:03.872917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1220/2462] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:03.877286 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381930a-d084-4b4f-afd8-3f0868e0eed6 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:03.887973 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381930a-d084-4b4f-afd8-3f0868e0eed6 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:03.892630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed844c18-0469-457f-acd9-36e3b49dcfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:03.893278 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed844c18-0469-457f-acd9-36e3b49dcfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:03.893563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed844c18-0469-457f-acd9-36e3b49dcfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:03.893843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed844c18-0469-457f-acd9-36e3b49dcfe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:03.895091 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed844c18-0469-457f-acd9-36e3b49dcfe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:03.896702 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed844c18-0469-457f-acd9-36e3b49dcfe0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:03.906770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1243/2463] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:03.911307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b20583-a657-4c01-b655-443eebb541db admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:03.921092 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b20583-a657-4c01-b655-443eebb541db admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:03.926228 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c9208-31db-4dc1-8feb-9bd67f2e1a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:03.927120 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c9208-31db-4dc1-8feb-9bd67f2e1a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:03.927415 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c9208-31db-4dc1-8feb-9bd67f2e1a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:03.927671 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c9208-31db-4dc1-8feb-9bd67f2e1a42 admin admin] PATH_INFO: `/v3/projects/880ac0f64f9240a0aebd81ea56618df6/users/364b0de516a149f08aa7068a97ed218b/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:03.941704 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c9208-31db-4dc1-8feb-9bd67f2e1a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=880ac0f64f9240a0aebd81ea56618df6, user_id=364b0de516a149f08aa7068a97ed218b, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:03.944346 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c9208-31db-4dc1-8feb-9bd67f2e1a42 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:04.004522 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1221/2464] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:03 2022] PUT /identity/v3/projects/880ac0f64f9240a0aebd81ea56618df6/users/364b0de516a149f08aa7068a97ed218b/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:27:04.015239 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8575bb-b125-4806-8827-b522acb8c207 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:04.015539 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8575bb-b125-4806-8827-b522acb8c207 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:04.015824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8575bb-b125-4806-8827-b522acb8c207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:04.042401 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-be8575bb-b125-4806-8827-b522acb8c207 None None] MFA Rules not processed for user `364b0de516a149f08aa7068a97ed218b`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:04.043780 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-be8575bb-b125-4806-8827-b522acb8c207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:04.104087 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1244/2465] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:04.108458 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c9208-31db-4dc1-8feb-9bd67f2e1a42 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:04.172026 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c9208-31db-4dc1-8feb-9bd67f2e1a42 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:04.176896 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a375852-8d99-427f-b92a-a70b91365f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:04.177554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a375852-8d99-427f-b92a-a70b91365f98 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:04.177836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a375852-8d99-427f-b92a-a70b91365f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:04.178112 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a375852-8d99-427f-b92a-a70b91365f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:04.178847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a375852-8d99-427f-b92a-a70b91365f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:04.180817 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a375852-8d99-427f-b92a-a70b91365f98 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:04.287747 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1222/2466] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:27:04 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:04.291826 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8575bb-b125-4806-8827-b522acb8c207 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:04.302860 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8575bb-b125-4806-8827-b522acb8c207 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:04.357430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d870a98-d198-414a-b254-57ae24bc77f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:04.358141 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d870a98-d198-414a-b254-57ae24bc77f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:04.358429 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d870a98-d198-414a-b254-57ae24bc77f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:04.358738 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d870a98-d198-414a-b254-57ae24bc77f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:04.359432 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d870a98-d198-414a-b254-57ae24bc77f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:04.361336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d870a98-d198-414a-b254-57ae24bc77f9 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:04.468148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1245/2467] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:27:04 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:27:04.472284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a375852-8d99-427f-b92a-a70b91365f98 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:04.483405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a375852-8d99-427f-b92a-a70b91365f98 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:04.488980 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac7ddb-a44e-4f65-878e-c1a792be2d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:04.489886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac7ddb-a44e-4f65-878e-c1a792be2d8f admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:04.490239 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac7ddb-a44e-4f65-878e-c1a792be2d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:04.490636 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac7ddb-a44e-4f65-878e-c1a792be2d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:04.491440 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac7ddb-a44e-4f65-878e-c1a792be2d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:04.493129 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac7ddb-a44e-4f65-878e-c1a792be2d8f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:04.504499 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1223/2468] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:04.508740 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d870a98-d198-414a-b254-57ae24bc77f9 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:04.520147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d870a98-d198-414a-b254-57ae24bc77f9 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:04.524989 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92d636-b9e5-4bef-b8ba-07dc7a6cd615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:04.525726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92d636-b9e5-4bef-b8ba-07dc7a6cd615 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:04.526015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92d636-b9e5-4bef-b8ba-07dc7a6cd615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:04.526317 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92d636-b9e5-4bef-b8ba-07dc7a6cd615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:04.527087 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92d636-b9e5-4bef-b8ba-07dc7a6cd615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:04.528668 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92d636-b9e5-4bef-b8ba-07dc7a6cd615 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:04.539141 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1246/2469] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:04.543295 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac7ddb-a44e-4f65-878e-c1a792be2d8f admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:04.553406 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac7ddb-a44e-4f65-878e-c1a792be2d8f admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:04.558105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91be7d8-8807-4a49-8fde-2da506c6229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:04.559023 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91be7d8-8807-4a49-8fde-2da506c6229d admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:04.559302 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91be7d8-8807-4a49-8fde-2da506c6229d admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:04.559575 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91be7d8-8807-4a49-8fde-2da506c6229d admin admin] PATH_INFO: `/v3/projects/2a4f3719410740d389a02a65ffae9c63/users/d9ee8084114e4c2286bacf54af0278b6/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:04.576001 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91be7d8-8807-4a49-8fde-2da506c6229d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4f3719410740d389a02a65ffae9c63, user_id=d9ee8084114e4c2286bacf54af0278b6, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:04.580580 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91be7d8-8807-4a49-8fde-2da506c6229d admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:04.662545 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1224/2470] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:04 2022] PUT /identity/v3/projects/2a4f3719410740d389a02a65ffae9c63/users/d9ee8084114e4c2286bacf54af0278b6/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:27:04.672708 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d8ef7-5c55-40e8-ad55-3218f17b508a None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:04.678254 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d8ef7-5c55-40e8-ad55-3218f17b508a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:04.678254 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d8ef7-5c55-40e8-ad55-3218f17b508a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:04.700321 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8c7d8ef7-5c55-40e8-ad55-3218f17b508a None None] MFA Rules not processed for user `d9ee8084114e4c2286bacf54af0278b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:04.701530 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8c7d8ef7-5c55-40e8-ad55-3218f17b508a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:04.764548 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1247/2471] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:04.768978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91be7d8-8807-4a49-8fde-2da506c6229d admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:04.828569 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91be7d8-8807-4a49-8fde-2da506c6229d admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:04.834035 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaade775-59c2-4d88-8064-65076b70bac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:04.834716 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaade775-59c2-4d88-8064-65076b70bac5 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:04.835004 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaade775-59c2-4d88-8064-65076b70bac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:04.835278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaade775-59c2-4d88-8064-65076b70bac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:04.835971 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaade775-59c2-4d88-8064-65076b70bac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:04.837855 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaade775-59c2-4d88-8064-65076b70bac5 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:04.920679 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1225/2472] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:27:04 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:04.924641 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d8ef7-5c55-40e8-ad55-3218f17b508a None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:04.936009 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d8ef7-5c55-40e8-ad55-3218f17b508a None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:04.989897 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36e1f1-9316-4c0e-9886-88386ab1b069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:04.990585 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36e1f1-9316-4c0e-9886-88386ab1b069 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:04.990871 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36e1f1-9316-4c0e-9886-88386ab1b069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:04.991147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36e1f1-9316-4c0e-9886-88386ab1b069 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:04.991828 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36e1f1-9316-4c0e-9886-88386ab1b069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:04.993728 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36e1f1-9316-4c0e-9886-88386ab1b069 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:05.084599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1248/2473] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:27:04 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:05.088599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaade775-59c2-4d88-8064-65076b70bac5 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:05.099755 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaade775-59c2-4d88-8064-65076b70bac5 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:05.104456 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684381e4-9632-4884-be08-9dc25d37af07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:05.105110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684381e4-9632-4884-be08-9dc25d37af07 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:05.105396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684381e4-9632-4884-be08-9dc25d37af07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:05.105674 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684381e4-9632-4884-be08-9dc25d37af07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:05.106399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684381e4-9632-4884-be08-9dc25d37af07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:05.108018 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684381e4-9632-4884-be08-9dc25d37af07 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:05.118470 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1226/2474] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:05.129435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36e1f1-9316-4c0e-9886-88386ab1b069 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:05.139431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36e1f1-9316-4c0e-9886-88386ab1b069 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:05.144032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dac472-ddc6-428e-927f-b580683abbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:05.145405 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dac472-ddc6-428e-927f-b580683abbd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:05.145684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dac472-ddc6-428e-927f-b580683abbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:05.146002 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dac472-ddc6-428e-927f-b580683abbd0 admin admin] PATH_INFO: `/v3/projects/9e7e6f9bbec744adae9263d11df321f7/users/c605f062afcb43c089a59e61b6877590/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:05.160610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dac472-ddc6-428e-927f-b580683abbd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7e6f9bbec744adae9263d11df321f7, user_id=c605f062afcb43c089a59e61b6877590, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:05.163256 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dac472-ddc6-428e-927f-b580683abbd0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:05.233610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1249/2475] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:05 2022] PUT /identity/v3/projects/9e7e6f9bbec744adae9263d11df321f7/users/c605f062afcb43c089a59e61b6877590/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:05.237720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684381e4-9632-4884-be08-9dc25d37af07 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:05.247741 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684381e4-9632-4884-be08-9dc25d37af07 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:05.302507 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2c47a-d228-402b-ba5d-d48ae0cce679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:05.303168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2c47a-d228-402b-ba5d-d48ae0cce679 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:05.303453 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2c47a-d228-402b-ba5d-d48ae0cce679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:05.303730 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2c47a-d228-402b-ba5d-d48ae0cce679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:05.304445 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2c47a-d228-402b-ba5d-d48ae0cce679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:05.306027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2c47a-d228-402b-ba5d-d48ae0cce679 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:05.315653 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1227/2476] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:05.320126 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dac472-ddc6-428e-927f-b580683abbd0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:05.330362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dac472-ddc6-428e-927f-b580683abbd0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:05.335875 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebcceb-7bc9-4ee5-bfa6-74143fbda09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:05.336760 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebcceb-7bc9-4ee5-bfa6-74143fbda09a admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:05.337045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebcceb-7bc9-4ee5-bfa6-74143fbda09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:05.337318 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebcceb-7bc9-4ee5-bfa6-74143fbda09a admin admin] PATH_INFO: `/v3/projects/9e7e6f9bbec744adae9263d11df321f7/users/c605f062afcb43c089a59e61b6877590/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:05.339549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebcceb-7bc9-4ee5-bfa6-74143fbda09a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7e6f9bbec744adae9263d11df321f7, user_id=c605f062afcb43c089a59e61b6877590, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:05.342147 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebcceb-7bc9-4ee5-bfa6-74143fbda09a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:05.352220 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1250/2477] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:05 2022] PUT /identity/v3/projects/9e7e6f9bbec744adae9263d11df321f7/users/c605f062afcb43c089a59e61b6877590/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:05.362525 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd5e6b-b3f0-4ac9-a4c9-958305350223 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:05.362829 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd5e6b-b3f0-4ac9-a4c9-958305350223 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:05.363143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd5e6b-b3f0-4ac9-a4c9-958305350223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:05.390221 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-7dcd5e6b-b3f0-4ac9-a4c9-958305350223 None None] MFA Rules not processed for user `c605f062afcb43c089a59e61b6877590`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:05.391487 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-7dcd5e6b-b3f0-4ac9-a4c9-958305350223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:05.457844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1228/2478] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:05.468561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebcceb-7bc9-4ee5-bfa6-74143fbda09a admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:05.470397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-73ebcceb-7bc9-4ee5-bfa6-74143fbda09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:05.527551 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebcceb-7bc9-4ee5-bfa6-74143fbda09a admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:05.531120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce35df-cc2a-4a36-a6d3-71a1003f9be9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:05.531755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce35df-cc2a-4a36-a6d3-71a1003f9be9 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:05.532044 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce35df-cc2a-4a36-a6d3-71a1003f9be9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:05.532319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce35df-cc2a-4a36-a6d3-71a1003f9be9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:05.541460 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce35df-cc2a-4a36-a6d3-71a1003f9be9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:05.542904 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce35df-cc2a-4a36-a6d3-71a1003f9be9 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:05.552193 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1251/2479] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:27:06.587635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd5e6b-b3f0-4ac9-a4c9-958305350223 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:06.589122 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-7dcd5e6b-b3f0-4ac9-a4c9-958305350223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:06.600862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd5e6b-b3f0-4ac9-a4c9-958305350223 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:06.604350 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aec24d-ad9a-4185-8775-7540e56f028b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:06.604982 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aec24d-ad9a-4185-8775-7540e56f028b service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:06.605268 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aec24d-ad9a-4185-8775-7540e56f028b service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:06.605537 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aec24d-ad9a-4185-8775-7540e56f028b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:06.660473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aec24d-ad9a-4185-8775-7540e56f028b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:06.661898 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aec24d-ad9a-4185-8775-7540e56f028b service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:06.670817 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1229/2480] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:27:11.601265 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce35df-cc2a-4a36-a6d3-71a1003f9be9 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:11.607204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce35df-cc2a-4a36-a6d3-71a1003f9be9 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:11.610893 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e16700-9586-46cc-918e-58572cdcab45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:11.619456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e16700-9586-46cc-918e-58572cdcab45 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:11.619456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e16700-9586-46cc-918e-58572cdcab45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:11.619456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e16700-9586-46cc-918e-58572cdcab45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:11.670967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e16700-9586-46cc-918e-58572cdcab45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:11.672403 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e16700-9586-46cc-918e-58572cdcab45 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:11.681237 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1252/2481] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:27:13.550521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aec24d-ad9a-4185-8775-7540e56f028b service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:13.551950 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-d5aec24d-ad9a-4185-8775-7540e56f028b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:13.618730 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aec24d-ad9a-4185-8775-7540e56f028b service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:13.623252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722dfdd1-c9af-4767-9d91-e5d98dc4f0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:13.624121 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dfdd1-c9af-4767-9d91-e5d98dc4f0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:13.624403 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dfdd1-c9af-4767-9d91-e5d98dc4f0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:13.624678 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dfdd1-c9af-4767-9d91-e5d98dc4f0e6 admin admin] PATH_INFO: `/v3/users/36b38e7eebc24703a7c6c6c8481c02c0` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:13.625844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722dfdd1-c9af-4767-9d91-e5d98dc4f0e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b38e7eebc24703a7c6c6c8481c02c0)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:13.627819 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722dfdd1-c9af-4767-9d91-e5d98dc4f0e6 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:13.760974 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-722dfdd1-c9af-4767-9d91-e5d98dc4f0e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b38e7eebc24703a7c6c6c8481c02c0'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:13.761652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-722dfdd1-c9af-4767-9d91-e5d98dc4f0e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b38e7eebc24703a7c6c6c8481c02c0'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:13.773772 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-722dfdd1-c9af-4767-9d91-e5d98dc4f0e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b38e7eebc24703a7c6c6c8481c02c0'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:13.774413 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-722dfdd1-c9af-4767-9d91-e5d98dc4f0e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b38e7eebc24703a7c6c6c8481c02c0'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:13.781074 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-722dfdd1-c9af-4767-9d91-e5d98dc4f0e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b38e7eebc24703a7c6c6c8481c02c0'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:13.839886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1230/2482] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:27:13 2022] DELETE /identity/v3/users/36b38e7eebc24703a7c6c6c8481c02c0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:13.844533 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c5e78-351b-4e63-82b0-c6b26a93eaff None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:13.845035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c5e78-351b-4e63-82b0-c6b26a93eaff None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:13.845642 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c5e78-351b-4e63-82b0-c6b26a93eaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:13.863442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7f4c5e78-351b-4e63-82b0-c6b26a93eaff None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:13.864742 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7f4c5e78-351b-4e63-82b0-c6b26a93eaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:13.927896 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1253/2483] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:27:13.934962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722dfdd1-c9af-4767-9d91-e5d98dc4f0e6 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:13.936362 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-722dfdd1-c9af-4767-9d91-e5d98dc4f0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:13.997192 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722dfdd1-c9af-4767-9d91-e5d98dc4f0e6 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:14.000839 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b58bf-93f9-46a3-a7e7-11fc9ac13688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:14.001483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b58bf-93f9-46a3-a7e7-11fc9ac13688 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:14.001764 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b58bf-93f9-46a3-a7e7-11fc9ac13688 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:14.002035 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b58bf-93f9-46a3-a7e7-11fc9ac13688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:14.012793 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b58bf-93f9-46a3-a7e7-11fc9ac13688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:14.014216 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b58bf-93f9-46a3-a7e7-11fc9ac13688 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:14.024736 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1231/2484] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:27:14.458878 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c5e78-351b-4e63-82b0-c6b26a93eaff None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:14.460560 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7f4c5e78-351b-4e63-82b0-c6b26a93eaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:14.473571 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c5e78-351b-4e63-82b0-c6b26a93eaff None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:14.483973 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac89a11-9af2-4afe-b5fb-676c79ac168b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:14.483973 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac89a11-9af2-4afe-b5fb-676c79ac168b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:14.483973 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac89a11-9af2-4afe-b5fb-676c79ac168b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:14.483973 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac89a11-9af2-4afe-b5fb-676c79ac168b admin admin] PATH_INFO: `/v3/projects/ed0ac16b403f41cbaf14caf46439ec49` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:14.484597 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac89a11-9af2-4afe-b5fb-676c79ac168b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed0ac16b403f41cbaf14caf46439ec49)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:14.484597 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac89a11-9af2-4afe-b5fb-676c79ac168b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:14.594637 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-aac89a11-9af2-4afe-b5fb-676c79ac168b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed0ac16b403f41cbaf14caf46439ec49', 'request_id': 'req-aac89a11-9af2-4afe-b5fb-676c79ac168b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:14.673500 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-aac89a11-9af2-4afe-b5fb-676c79ac168b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed0ac16b403f41cbaf14caf46439ec49', 'request_id': 'req-aac89a11-9af2-4afe-b5fb-676c79ac168b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:14.680297 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-aac89a11-9af2-4afe-b5fb-676c79ac168b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed0ac16b403f41cbaf14caf46439ec49', 'request_id': 'req-aac89a11-9af2-4afe-b5fb-676c79ac168b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:14.691504 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-aac89a11-9af2-4afe-b5fb-676c79ac168b admin admin] The token cache is being invalidate because project ed0ac16b403f41cbaf14caf46439ec49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:27:14.691793 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-aac89a11-9af2-4afe-b5fb-676c79ac168b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:14.692454 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-aac89a11-9af2-4afe-b5fb-676c79ac168b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:14.695252 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1254/2485] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:27:14 2022] DELETE /identity/v3/projects/ed0ac16b403f41cbaf14caf46439ec49 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:15.459715 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b58bf-93f9-46a3-a7e7-11fc9ac13688 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:15.461107 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-0d0b58bf-93f9-46a3-a7e7-11fc9ac13688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:15.472054 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b58bf-93f9-46a3-a7e7-11fc9ac13688 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:15.520168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef4e02-6cf8-455a-8a96-97b2cab7299c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:15.520812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef4e02-6cf8-455a-8a96-97b2cab7299c service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:15.521134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef4e02-6cf8-455a-8a96-97b2cab7299c service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:15.521408 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef4e02-6cf8-455a-8a96-97b2cab7299c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:15.523424 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-16ef4e02-6cf8-455a-8a96-97b2cab7299c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:15.585675 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef4e02-6cf8-455a-8a96-97b2cab7299c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:15.587126 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef4e02-6cf8-455a-8a96-97b2cab7299c service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:15.596491 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1232/2486] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:27:15.674509 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac89a11-9af2-4afe-b5fb-676c79ac168b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:15.676032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-aac89a11-9af2-4afe-b5fb-676c79ac168b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:15.689204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac89a11-9af2-4afe-b5fb-676c79ac168b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:15.694537 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc0fab-aa9e-4c45-b4a5-3e932b7278e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:15.695496 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc0fab-aa9e-4c45-b4a5-3e932b7278e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:15.695851 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc0fab-aa9e-4c45-b4a5-3e932b7278e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:15.696197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc0fab-aa9e-4c45-b4a5-3e932b7278e1 admin admin] PATH_INFO: `/v3/users/364b0de516a149f08aa7068a97ed218b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:15.697389 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc0fab-aa9e-4c45-b4a5-3e932b7278e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=364b0de516a149f08aa7068a97ed218b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:15.699343 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc0fab-aa9e-4c45-b4a5-3e932b7278e1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:15.893382 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5cfc0fab-aa9e-4c45-b4a5-3e932b7278e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '364b0de516a149f08aa7068a97ed218b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:15.894051 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5cfc0fab-aa9e-4c45-b4a5-3e932b7278e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '364b0de516a149f08aa7068a97ed218b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:15.894705 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5cfc0fab-aa9e-4c45-b4a5-3e932b7278e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '364b0de516a149f08aa7068a97ed218b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:15.907291 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5cfc0fab-aa9e-4c45-b4a5-3e932b7278e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '364b0de516a149f08aa7068a97ed218b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:15.913865 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5cfc0fab-aa9e-4c45-b4a5-3e932b7278e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '364b0de516a149f08aa7068a97ed218b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:15.987361 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1255/2487] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:27:15 2022] DELETE /identity/v3/users/364b0de516a149f08aa7068a97ed218b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:15.991970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9cbd8-8bf7-49df-b8b3-c7b4f4e34f66 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:15.992290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9cbd8-8bf7-49df-b8b3-c7b4f4e34f66 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:15.992571 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9cbd8-8bf7-49df-b8b3-c7b4f4e34f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:16.010959 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-13f9cbd8-8bf7-49df-b8b3-c7b4f4e34f66 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:16.012207 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-13f9cbd8-8bf7-49df-b8b3-c7b4f4e34f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:16.073472 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1233/2488] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:16.083507 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc0fab-aa9e-4c45-b4a5-3e932b7278e1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:16.085268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5cfc0fab-aa9e-4c45-b4a5-3e932b7278e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:16.145752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc0fab-aa9e-4c45-b4a5-3e932b7278e1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:16.149506 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb4297-3e4f-4169-93ce-adf1ed195d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:16.150164 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb4297-3e4f-4169-93ce-adf1ed195d20 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:16.150457 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb4297-3e4f-4169-93ce-adf1ed195d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:16.150749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb4297-3e4f-4169-93ce-adf1ed195d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:16.160379 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb4297-3e4f-4169-93ce-adf1ed195d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:16.161818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb4297-3e4f-4169-93ce-adf1ed195d20 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:16.172205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1256/2489] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:27:16.667961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9cbd8-8bf7-49df-b8b3-c7b4f4e34f66 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:16.669656 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-13f9cbd8-8bf7-49df-b8b3-c7b4f4e34f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:16.682452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9cbd8-8bf7-49df-b8b3-c7b4f4e34f66 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:16.687183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522541f-f3bd-455e-8033-d8ea2abf7b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:16.688065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522541f-f3bd-455e-8033-d8ea2abf7b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:16.688569 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522541f-f3bd-455e-8033-d8ea2abf7b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:16.688844 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522541f-f3bd-455e-8033-d8ea2abf7b16 admin admin] PATH_INFO: `/v3/projects/880ac0f64f9240a0aebd81ea56618df6` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:16.690068 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522541f-f3bd-455e-8033-d8ea2abf7b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=880ac0f64f9240a0aebd81ea56618df6)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:16.692035 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522541f-f3bd-455e-8033-d8ea2abf7b16 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:16.794402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2522541f-f3bd-455e-8033-d8ea2abf7b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '880ac0f64f9240a0aebd81ea56618df6', 'request_id': 'req-2522541f-f3bd-455e-8033-d8ea2abf7b16'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:16.873829 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2522541f-f3bd-455e-8033-d8ea2abf7b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '880ac0f64f9240a0aebd81ea56618df6', 'request_id': 'req-2522541f-f3bd-455e-8033-d8ea2abf7b16'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:16.879714 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2522541f-f3bd-455e-8033-d8ea2abf7b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '880ac0f64f9240a0aebd81ea56618df6', 'request_id': 'req-2522541f-f3bd-455e-8033-d8ea2abf7b16'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:16.892143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2522541f-f3bd-455e-8033-d8ea2abf7b16 admin admin] The token cache is being invalidate because project 880ac0f64f9240a0aebd81ea56618df6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:27:16.892143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2522541f-f3bd-455e-8033-d8ea2abf7b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:16.892899 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2522541f-f3bd-455e-8033-d8ea2abf7b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:16.894914 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1234/2490] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:27:16 2022] DELETE /identity/v3/projects/880ac0f64f9240a0aebd81ea56618df6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:16.899536 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb4297-3e4f-4169-93ce-adf1ed195d20 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:16.909408 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb4297-3e4f-4169-93ce-adf1ed195d20 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:16.977180 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc55e5d-4e59-4d12-8ca3-62546c7f9567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:16.978223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc55e5d-4e59-4d12-8ca3-62546c7f9567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:16.978552 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc55e5d-4e59-4d12-8ca3-62546c7f9567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:16.978837 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc55e5d-4e59-4d12-8ca3-62546c7f9567 admin admin] PATH_INFO: `/v3/users/d9ee8084114e4c2286bacf54af0278b6` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:16.980111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc55e5d-4e59-4d12-8ca3-62546c7f9567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ee8084114e4c2286bacf54af0278b6)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:16.982051 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc55e5d-4e59-4d12-8ca3-62546c7f9567 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:17.212598 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-4fc55e5d-4e59-4d12-8ca3-62546c7f9567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ee8084114e4c2286bacf54af0278b6'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:17.213198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-4fc55e5d-4e59-4d12-8ca3-62546c7f9567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ee8084114e4c2286bacf54af0278b6'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:17.213830 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-4fc55e5d-4e59-4d12-8ca3-62546c7f9567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ee8084114e4c2286bacf54af0278b6'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:17.226385 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-4fc55e5d-4e59-4d12-8ca3-62546c7f9567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ee8084114e4c2286bacf54af0278b6'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:17.233327 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-4fc55e5d-4e59-4d12-8ca3-62546c7f9567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ee8084114e4c2286bacf54af0278b6'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:17.313493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1257/2491] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:27:16 2022] DELETE /identity/v3/users/d9ee8084114e4c2286bacf54af0278b6 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:17.750472 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522541f-f3bd-455e-8033-d8ea2abf7b16 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:17.752079 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-2522541f-f3bd-455e-8033-d8ea2abf7b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:17.770676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522541f-f3bd-455e-8033-d8ea2abf7b16 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:17.836669 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd111e-978a-4d46-a37f-746e4419d05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:17.836669 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd111e-978a-4d46-a37f-746e4419d05e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:17.836669 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd111e-978a-4d46-a37f-746e4419d05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:17.836669 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd111e-978a-4d46-a37f-746e4419d05e admin admin] PATH_INFO: `/v3/projects/2a4f3719410740d389a02a65ffae9c63` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:17.837946 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd111e-978a-4d46-a37f-746e4419d05e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a4f3719410740d389a02a65ffae9c63)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:17.844410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd111e-978a-4d46-a37f-746e4419d05e admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:17.961479 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-45fd111e-978a-4d46-a37f-746e4419d05e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a4f3719410740d389a02a65ffae9c63', 'request_id': 'req-45fd111e-978a-4d46-a37f-746e4419d05e'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:18.028041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-45fd111e-978a-4d46-a37f-746e4419d05e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a4f3719410740d389a02a65ffae9c63', 'request_id': 'req-45fd111e-978a-4d46-a37f-746e4419d05e'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:18.034265 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-45fd111e-978a-4d46-a37f-746e4419d05e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a4f3719410740d389a02a65ffae9c63', 'request_id': 'req-45fd111e-978a-4d46-a37f-746e4419d05e'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:18.046768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-45fd111e-978a-4d46-a37f-746e4419d05e admin admin] The token cache is being invalidate because project 2a4f3719410740d389a02a65ffae9c63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:27:18.047060 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-45fd111e-978a-4d46-a37f-746e4419d05e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:18.047709 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-45fd111e-978a-4d46-a37f-746e4419d05e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:18.049489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1235/2492] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:27:17 2022] DELETE /identity/v3/projects/2a4f3719410740d389a02a65ffae9c63 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:18.054127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc55e5d-4e59-4d12-8ca3-62546c7f9567 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:18.055744 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4fc55e5d-4e59-4d12-8ca3-62546c7f9567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:18.068233 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc55e5d-4e59-4d12-8ca3-62546c7f9567 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:18.124303 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a899f2-21f4-46d0-bdd8-d42f372cbcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:18.125182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a899f2-21f4-46d0-bdd8-d42f372cbcc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:18.125472 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a899f2-21f4-46d0-bdd8-d42f372cbcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:18.125751 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a899f2-21f4-46d0-bdd8-d42f372cbcc8 admin admin] PATH_INFO: `/v3/users/c605f062afcb43c089a59e61b6877590` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:18.127100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a899f2-21f4-46d0-bdd8-d42f372cbcc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c605f062afcb43c089a59e61b6877590)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:18.129016 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a899f2-21f4-46d0-bdd8-d42f372cbcc8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:18.323978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-00a899f2-21f4-46d0-bdd8-d42f372cbcc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c605f062afcb43c089a59e61b6877590'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:18.328471 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-00a899f2-21f4-46d0-bdd8-d42f372cbcc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c605f062afcb43c089a59e61b6877590'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:18.329095 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-00a899f2-21f4-46d0-bdd8-d42f372cbcc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c605f062afcb43c089a59e61b6877590'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:18.343089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-00a899f2-21f4-46d0-bdd8-d42f372cbcc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c605f062afcb43c089a59e61b6877590'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:18.350822 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-00a899f2-21f4-46d0-bdd8-d42f372cbcc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c605f062afcb43c089a59e61b6877590'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:18.427956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1258/2493] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:27:18 2022] DELETE /identity/v3/users/c605f062afcb43c089a59e61b6877590 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:18.907614 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd111e-978a-4d46-a37f-746e4419d05e admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:18.910031 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-45fd111e-978a-4d46-a37f-746e4419d05e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:18.931748 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd111e-978a-4d46-a37f-746e4419d05e admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:19.024226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a215161-0743-4fce-b26d-2727bf43b4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:19.025231 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a215161-0743-4fce-b26d-2727bf43b4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:19.025523 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a215161-0743-4fce-b26d-2727bf43b4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:19.025802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a215161-0743-4fce-b26d-2727bf43b4e1 admin admin] PATH_INFO: `/v3/projects/9e7e6f9bbec744adae9263d11df321f7` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:19.027039 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a215161-0743-4fce-b26d-2727bf43b4e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e7e6f9bbec744adae9263d11df321f7)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:19.028978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a215161-0743-4fce-b26d-2727bf43b4e1 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:19.159386 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-1a215161-0743-4fce-b26d-2727bf43b4e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e7e6f9bbec744adae9263d11df321f7', 'request_id': 'req-1a215161-0743-4fce-b26d-2727bf43b4e1'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:19.234112 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-1a215161-0743-4fce-b26d-2727bf43b4e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e7e6f9bbec744adae9263d11df321f7', 'request_id': 'req-1a215161-0743-4fce-b26d-2727bf43b4e1'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:19.240088 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-1a215161-0743-4fce-b26d-2727bf43b4e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e7e6f9bbec744adae9263d11df321f7', 'request_id': 'req-1a215161-0743-4fce-b26d-2727bf43b4e1'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:19.251979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-1a215161-0743-4fce-b26d-2727bf43b4e1 admin admin] The token cache is being invalidate because project 9e7e6f9bbec744adae9263d11df321f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:27:19.252267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-1a215161-0743-4fce-b26d-2727bf43b4e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:19.252914 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-1a215161-0743-4fce-b26d-2727bf43b4e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:19.254664 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1236/2494] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:27:18 2022] DELETE /identity/v3/projects/9e7e6f9bbec744adae9263d11df321f7 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:19.261738 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab2514-1210-444f-b66a-bfb347a92ad4 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:19.262243 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab2514-1210-444f-b66a-bfb347a92ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:19.262524 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab2514-1210-444f-b66a-bfb347a92ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:19.280694 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-91ab2514-1210-444f-b66a-bfb347a92ad4 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:19.282015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-91ab2514-1210-444f-b66a-bfb347a92ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:19.353757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1259/2495] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:27:19.362405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e739cb2-c0f5-4295-98e3-dd1671033880 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:19.370116 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e739cb2-c0f5-4295-98e3-dd1671033880 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:19.370116 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e739cb2-c0f5-4295-98e3-dd1671033880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:19.387420 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-8e739cb2-c0f5-4295-98e3-dd1671033880 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:19.388114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-8e739cb2-c0f5-4295-98e3-dd1671033880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:19.404620 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1237/2496] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:19.406165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab2514-1210-444f-b66a-bfb347a92ad4 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:19.422127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab2514-1210-444f-b66a-bfb347a92ad4 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:19.427567 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8350ff0-5538-4893-867e-d9c7ca438bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:19.429097 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8350ff0-5538-4893-867e-d9c7ca438bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:19.429580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8350ff0-5538-4893-867e-d9c7ca438bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:19.429860 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8350ff0-5538-4893-867e-d9c7ca438bb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:19.431056 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8350ff0-5538-4893-867e-d9c7ca438bb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:27:19.431431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8350ff0-5538-4893-867e-d9c7ca438bb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:19.433295 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8350ff0-5538-4893-867e-d9c7ca438bb4 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:19.446945 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1260/2497] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:27:19.451728 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e739cb2-c0f5-4295-98e3-dd1671033880 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:19.464130 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e739cb2-c0f5-4295-98e3-dd1671033880 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:19.470159 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba7079-a87b-4e59-985f-429a8aacd35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:19.471723 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba7079-a87b-4e59-985f-429a8aacd35e admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:19.471866 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba7079-a87b-4e59-985f-429a8aacd35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:19.472265 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba7079-a87b-4e59-985f-429a8aacd35e admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:19.473070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba7079-a87b-4e59-985f-429a8aacd35e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:19.475731 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba7079-a87b-4e59-985f-429a8aacd35e admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:19.547826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1238/2498] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:27:19 2022] POST /identity/v3/projects => generated 405 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:19.548967 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8350ff0-5538-4893-867e-d9c7ca438bb4 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:19.560595 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8350ff0-5538-4893-867e-d9c7ca438bb4 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:19.617574 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17840f-74d4-499b-9eab-8f0d0112ff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:19.618170 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17840f-74d4-499b-9eab-8f0d0112ff62 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:19.618466 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17840f-74d4-499b-9eab-8f0d0112ff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:19.618752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17840f-74d4-499b-9eab-8f0d0112ff62 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:19.619448 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17840f-74d4-499b-9eab-8f0d0112ff62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:19.621344 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17840f-74d4-499b-9eab-8f0d0112ff62 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:19.640861 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba7079-a87b-4e59-985f-429a8aacd35e admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:19.642865 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-25ba7079-a87b-4e59-985f-429a8aacd35e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:19.655862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba7079-a87b-4e59-985f-429a8aacd35e admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:19.660633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33813c-58c6-4fe5-89ad-40f6780fb0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:19.661508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33813c-58c6-4fe5-89ad-40f6780fb0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:19.661796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33813c-58c6-4fe5-89ad-40f6780fb0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:19.662073 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33813c-58c6-4fe5-89ad-40f6780fb0f1 admin admin] PATH_INFO: `/v3/users/ca39678abe6e476283f94c675d4ea369` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:19.664522 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33813c-58c6-4fe5-89ad-40f6780fb0f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca39678abe6e476283f94c675d4ea369)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:19.666413 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33813c-58c6-4fe5-89ad-40f6780fb0f1 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:19.708132 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1261/2499] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:27:19 2022] POST /identity/v3/users => generated 303 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:19.712497 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17840f-74d4-499b-9eab-8f0d0112ff62 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:19.723014 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17840f-74d4-499b-9eab-8f0d0112ff62 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:19.728599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e361bb9-357e-47a4-843b-19be583364f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:19.729315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e361bb9-357e-47a4-843b-19be583364f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:19.729564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e361bb9-357e-47a4-843b-19be583364f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:19.729835 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e361bb9-357e-47a4-843b-19be583364f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:19.730593 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e361bb9-357e-47a4-843b-19be583364f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:19.732158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e361bb9-357e-47a4-843b-19be583364f4 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:19.742646 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1262/2500] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:27:19.746690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e361bb9-357e-47a4-843b-19be583364f4 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:19.756128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e361bb9-357e-47a4-843b-19be583364f4 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:19.761105 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53e2c0-6f8f-44a8-a934-09bace245e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:19.761756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53e2c0-6f8f-44a8-a934-09bace245e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:19.762031 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53e2c0-6f8f-44a8-a934-09bace245e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:19.762309 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53e2c0-6f8f-44a8-a934-09bace245e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:19.763060 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53e2c0-6f8f-44a8-a934-09bace245e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:19.764660 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53e2c0-6f8f-44a8-a934-09bace245e54 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:19.775603 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1263/2501] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:27:19.779617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53e2c0-6f8f-44a8-a934-09bace245e54 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:19.789504 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53e2c0-6f8f-44a8-a934-09bace245e54 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:19.794152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cda427-0bad-4ded-81d3-27fb94688f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:19.795045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cda427-0bad-4ded-81d3-27fb94688f71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:19.795325 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cda427-0bad-4ded-81d3-27fb94688f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:19.795676 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cda427-0bad-4ded-81d3-27fb94688f71 admin admin] PATH_INFO: `/v3/projects/b6a8b2813af04da29aeaece3a2108cb5/users/7fe0abf9609d420dbee44308390aed39/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:19.812098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cda427-0bad-4ded-81d3-27fb94688f71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a8b2813af04da29aeaece3a2108cb5, user_id=7fe0abf9609d420dbee44308390aed39, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:19.814894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cda427-0bad-4ded-81d3-27fb94688f71 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:19.842332 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7a33813c-58c6-4fe5-89ad-40f6780fb0f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca39678abe6e476283f94c675d4ea369'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:19.843034 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7a33813c-58c6-4fe5-89ad-40f6780fb0f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca39678abe6e476283f94c675d4ea369'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:19.855641 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7a33813c-58c6-4fe5-89ad-40f6780fb0f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca39678abe6e476283f94c675d4ea369'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:19.857797 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7a33813c-58c6-4fe5-89ad-40f6780fb0f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca39678abe6e476283f94c675d4ea369'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:19.863266 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7a33813c-58c6-4fe5-89ad-40f6780fb0f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca39678abe6e476283f94c675d4ea369'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:19.908097 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1264/2502] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:19 2022] PUT /identity/v3/projects/b6a8b2813af04da29aeaece3a2108cb5/users/7fe0abf9609d420dbee44308390aed39/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:27:19.920473 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76557443-8e35-49dc-8faf-a87c79ba7aea None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:19.920767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76557443-8e35-49dc-8faf-a87c79ba7aea None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:19.921088 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76557443-8e35-49dc-8faf-a87c79ba7aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:19.942223 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1239/2503] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:27:19 2022] DELETE /identity/v3/users/ca39678abe6e476283f94c675d4ea369 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:27:19.949310 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-76557443-8e35-49dc-8faf-a87c79ba7aea None None] MFA Rules not processed for user `7fe0abf9609d420dbee44308390aed39`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:19.950563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-76557443-8e35-49dc-8faf-a87c79ba7aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:20.014939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1265/2504] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:27:20.019516 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33813c-58c6-4fe5-89ad-40f6780fb0f1 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:20.020995 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-7a33813c-58c6-4fe5-89ad-40f6780fb0f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:20.086104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33813c-58c6-4fe5-89ad-40f6780fb0f1 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:20.090792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b121e56-d76b-41f3-8085-31dace407089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:20.091448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b121e56-d76b-41f3-8085-31dace407089 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:20.091730 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b121e56-d76b-41f3-8085-31dace407089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:20.092004 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b121e56-d76b-41f3-8085-31dace407089 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:20.092686 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b121e56-d76b-41f3-8085-31dace407089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:20.094632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b121e56-d76b-41f3-8085-31dace407089 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:20.201369 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76557443-8e35-49dc-8faf-a87c79ba7aea None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:20.202826 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-76557443-8e35-49dc-8faf-a87c79ba7aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:20.213578 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1240/2505] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:27:20 2022] POST /identity/v3/projects => generated 407 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:27:20.218074 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b121e56-d76b-41f3-8085-31dace407089 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:20.218950 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76557443-8e35-49dc-8faf-a87c79ba7aea None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:20.278351 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c1bd8-e284-4d03-83a5-f157ee9a5ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:20.282672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c1bd8-e284-4d03-83a5-f157ee9a5ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:20.282672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c1bd8-e284-4d03-83a5-f157ee9a5ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:20.282672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c1bd8-e284-4d03-83a5-f157ee9a5ce1 admin admin] PATH_INFO: `/v3/projects/8286226c580f4896aec72c65642fce30` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:20.282672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c1bd8-e284-4d03-83a5-f157ee9a5ce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8286226c580f4896aec72c65642fce30)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:20.283019 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b121e56-d76b-41f3-8085-31dace407089 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:20.283106 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c1bd8-e284-4d03-83a5-f157ee9a5ce1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:20.286748 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e4251-9189-4608-b147-838df55ee28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:20.287416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e4251-9189-4608-b147-838df55ee28f admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:20.288581 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e4251-9189-4608-b147-838df55ee28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:20.288889 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e4251-9189-4608-b147-838df55ee28f admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:20.289644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e4251-9189-4608-b147-838df55ee28f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:20.291588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e4251-9189-4608-b147-838df55ee28f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:20.399995 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1241/2506] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:27:20 2022] POST /identity/v3/users => generated 310 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:20.403805 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e4251-9189-4608-b147-838df55ee28f admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:20.413880 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e4251-9189-4608-b147-838df55ee28f admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:20.422516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-af8c1bd8-e284-4d03-83a5-f157ee9a5ce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8286226c580f4896aec72c65642fce30', 'request_id': 'req-af8c1bd8-e284-4d03-83a5-f157ee9a5ce1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:20.467763 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73453430-8aeb-4727-9617-c4ab0cfbcbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:20.468348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73453430-8aeb-4727-9617-c4ab0cfbcbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:20.468630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73453430-8aeb-4727-9617-c4ab0cfbcbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:20.468901 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73453430-8aeb-4727-9617-c4ab0cfbcbd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:20.469613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73453430-8aeb-4727-9617-c4ab0cfbcbd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:20.471216 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73453430-8aeb-4727-9617-c4ab0cfbcbd5 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:20.481050 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1242/2507] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:27:20.485206 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73453430-8aeb-4727-9617-c4ab0cfbcbd5 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:20.495322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73453430-8aeb-4727-9617-c4ab0cfbcbd5 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:20.496307 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-af8c1bd8-e284-4d03-83a5-f157ee9a5ce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8286226c580f4896aec72c65642fce30', 'request_id': 'req-af8c1bd8-e284-4d03-83a5-f157ee9a5ce1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:20.500109 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f04c6c-37ef-4041-aa7d-e6d1b9bc016f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:20.501081 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f04c6c-37ef-4041-aa7d-e6d1b9bc016f admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:20.501365 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f04c6c-37ef-4041-aa7d-e6d1b9bc016f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:20.501644 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f04c6c-37ef-4041-aa7d-e6d1b9bc016f admin admin] PATH_INFO: `/v3/projects/9841f80c5a0240c290f9865cf936488f/users/b57f768dfd10432d95db02442f980c2a/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:20.502260 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-af8c1bd8-e284-4d03-83a5-f157ee9a5ce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8286226c580f4896aec72c65642fce30', 'request_id': 'req-af8c1bd8-e284-4d03-83a5-f157ee9a5ce1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:20.513884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-af8c1bd8-e284-4d03-83a5-f157ee9a5ce1 admin admin] The token cache is being invalidate because project 8286226c580f4896aec72c65642fce30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:27:20.514174 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-af8c1bd8-e284-4d03-83a5-f157ee9a5ce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:20.514868 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-af8c1bd8-e284-4d03-83a5-f157ee9a5ce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:20.516530 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1266/2508] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:27:20 2022] DELETE /identity/v3/projects/8286226c580f4896aec72c65642fce30 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:27:20.516667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f04c6c-37ef-4041-aa7d-e6d1b9bc016f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9841f80c5a0240c290f9865cf936488f, user_id=b57f768dfd10432d95db02442f980c2a, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:20.519300 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f04c6c-37ef-4041-aa7d-e6d1b9bc016f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:20.521270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea79c3-1287-45f1-a519-abb7ba004af2 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:20.521564 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea79c3-1287-45f1-a519-abb7ba004af2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:20.521843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea79c3-1287-45f1-a519-abb7ba004af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:20.539844 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8bea79c3-1287-45f1-a519-abb7ba004af2 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:20.541040 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8bea79c3-1287-45f1-a519-abb7ba004af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:20.549052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1267/2509] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:20.557382 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38188ec0-61ab-421b-bbbd-4884762d8b6c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:20.557703 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38188ec0-61ab-421b-bbbd-4884762d8b6c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:20.557966 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38188ec0-61ab-421b-bbbd-4884762d8b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:20.575300 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-38188ec0-61ab-421b-bbbd-4884762d8b6c None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:20.576474 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-38188ec0-61ab-421b-bbbd-4884762d8b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:20.584123 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1268/2510] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:27:20.588631 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38188ec0-61ab-421b-bbbd-4884762d8b6c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:20.589393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1243/2511] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:20 2022] PUT /identity/v3/projects/9841f80c5a0240c290f9865cf936488f/users/b57f768dfd10432d95db02442f980c2a/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:27:20.593077 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f04c6c-37ef-4041-aa7d-e6d1b9bc016f admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:20.594711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-37f04c6c-37ef-4041-aa7d-e6d1b9bc016f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:20.597382 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38188ec0-61ab-421b-bbbd-4884762d8b6c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:20.652818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbb952-f3f5-4177-8dce-154302aa3ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:20.653492 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbb952-f3f5-4177-8dce-154302aa3ffb admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:20.653779 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbb952-f3f5-4177-8dce-154302aa3ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:20.654063 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbb952-f3f5-4177-8dce-154302aa3ffb admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:20.654848 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbb952-f3f5-4177-8dce-154302aa3ffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:27:20.655181 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbb952-f3f5-4177-8dce-154302aa3ffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:20.656736 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbb952-f3f5-4177-8dce-154302aa3ffb admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:20.657878 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f04c6c-37ef-4041-aa7d-e6d1b9bc016f admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:20.662594 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2485fe4-6082-407a-8bb3-c75c51fb4158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:20.663895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2485fe4-6082-407a-8bb3-c75c51fb4158 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:20.664193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2485fe4-6082-407a-8bb3-c75c51fb4158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:20.664468 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2485fe4-6082-407a-8bb3-c75c51fb4158 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:20.665200 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2485fe4-6082-407a-8bb3-c75c51fb4158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:20.666808 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2485fe4-6082-407a-8bb3-c75c51fb4158 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:20.668954 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1269/2512] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:27:20.673260 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbb952-f3f5-4177-8dce-154302aa3ffb admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:20.678842 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1244/2513] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:27:20.682468 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2485fe4-6082-407a-8bb3-c75c51fb4158 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:20.683125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbb952-f3f5-4177-8dce-154302aa3ffb admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:20.687735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838f2a7-6939-4437-9cf9-bcce07a341c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:20.688384 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838f2a7-6939-4437-9cf9-bcce07a341c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:20.688674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838f2a7-6939-4437-9cf9-bcce07a341c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:20.688956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838f2a7-6939-4437-9cf9-bcce07a341c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:20.689650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838f2a7-6939-4437-9cf9-bcce07a341c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:20.691624 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838f2a7-6939-4437-9cf9-bcce07a341c7 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:20.691961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2485fe4-6082-407a-8bb3-c75c51fb4158 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:20.696954 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6b792-034d-40ec-b0fc-c0e451a0d931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:20.697817 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6b792-034d-40ec-b0fc-c0e451a0d931 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:20.698102 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6b792-034d-40ec-b0fc-c0e451a0d931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:20.698397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6b792-034d-40ec-b0fc-c0e451a0d931 admin admin] PATH_INFO: `/v3/projects/9841f80c5a0240c290f9865cf936488f/users/b57f768dfd10432d95db02442f980c2a/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:20.700388 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6b792-034d-40ec-b0fc-c0e451a0d931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9841f80c5a0240c290f9865cf936488f, user_id=b57f768dfd10432d95db02442f980c2a, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:20.703034 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6b792-034d-40ec-b0fc-c0e451a0d931 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:20.713867 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1245/2514] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:20 2022] PUT /identity/v3/projects/9841f80c5a0240c290f9865cf936488f/users/b57f768dfd10432d95db02442f980c2a/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:20.724682 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0dd83-1a1b-4867-9225-5173654a5c84 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:20.724912 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0dd83-1a1b-4867-9225-5173654a5c84 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:20.725893 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0dd83-1a1b-4867-9225-5173654a5c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:20.753327 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-93d0dd83-1a1b-4867-9225-5173654a5c84 None None] MFA Rules not processed for user `b57f768dfd10432d95db02442f980c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:20.754569 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-93d0dd83-1a1b-4867-9225-5173654a5c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:20.792041 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1270/2515] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:27:20 2022] POST /identity/v3/projects => generated 355 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:20.793155 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838f2a7-6939-4437-9cf9-bcce07a341c7 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:20.821531 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1246/2516] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:20 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:27:20.832493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0dd83-1a1b-4867-9225-5173654a5c84 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:20.833862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-93d0dd83-1a1b-4867-9225-5173654a5c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:20.855815 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838f2a7-6939-4437-9cf9-bcce07a341c7 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:20.860589 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ca958-a9aa-486e-a36c-462430128421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:20.861259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca958-a9aa-486e-a36c-462430128421 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:20.861548 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca958-a9aa-486e-a36c-462430128421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:20.861828 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca958-a9aa-486e-a36c-462430128421 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:20.862587 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ca958-a9aa-486e-a36c-462430128421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:20.864537 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ca958-a9aa-486e-a36c-462430128421 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:20.891804 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0dd83-1a1b-4867-9225-5173654a5c84 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:20.941282 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2796ed-f3ba-46e4-812e-c1db4ee80843 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:20.941933 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2796ed-f3ba-46e4-812e-c1db4ee80843 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:20.942221 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2796ed-f3ba-46e4-812e-c1db4ee80843 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:20.943077 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2796ed-f3ba-46e4-812e-c1db4ee80843 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:20.943634 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1271/2517] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:27:20 2022] POST /identity/v3/users => generated 278 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:27:20.947165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ca958-a9aa-486e-a36c-462430128421 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:20.960685 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ca958-a9aa-486e-a36c-462430128421 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:20.966873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b18c2c-3ec2-4174-b4ee-b54a2d1a4c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:20.967548 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b18c2c-3ec2-4174-b4ee-b54a2d1a4c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:20.970983 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b18c2c-3ec2-4174-b4ee-b54a2d1a4c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:20.970983 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b18c2c-3ec2-4174-b4ee-b54a2d1a4c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:20.970983 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b18c2c-3ec2-4174-b4ee-b54a2d1a4c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:20.970983 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b18c2c-3ec2-4174-b4ee-b54a2d1a4c51 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:20.981875 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1272/2518] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:27:20.985306 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b18c2c-3ec2-4174-b4ee-b54a2d1a4c51 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:20.996670 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b18c2c-3ec2-4174-b4ee-b54a2d1a4c51 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:21.001455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf09ab-0128-4a68-9d17-82ce9dcb0c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:21.002115 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf09ab-0128-4a68-9d17-82ce9dcb0c67 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:21.002401 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf09ab-0128-4a68-9d17-82ce9dcb0c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:21.002710 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf09ab-0128-4a68-9d17-82ce9dcb0c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:21.003438 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf09ab-0128-4a68-9d17-82ce9dcb0c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:21.005049 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf09ab-0128-4a68-9d17-82ce9dcb0c67 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:21.013410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2796ed-f3ba-46e4-812e-c1db4ee80843 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:21.014965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2796ed-f3ba-46e4-812e-c1db4ee80843 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:21.017412 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1273/2519] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:27:21.021541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf09ab-0128-4a68-9d17-82ce9dcb0c67 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:21.025547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1247/2520] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:20 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:27:21.032325 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf09ab-0128-4a68-9d17-82ce9dcb0c67 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:21.037094 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c7087-e6f5-457f-8666-304287aaf6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:21.038076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c7087-e6f5-457f-8666-304287aaf6a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:21.038423 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c7087-e6f5-457f-8666-304287aaf6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:21.038801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c7087-e6f5-457f-8666-304287aaf6a4 admin admin] PATH_INFO: `/v3/projects/a5c13427fa494183b48606003b18e54c/users/3303579daa824c6b908b35df766a41c8/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:21.053755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c7087-e6f5-457f-8666-304287aaf6a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5c13427fa494183b48606003b18e54c, user_id=3303579daa824c6b908b35df766a41c8, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:21.056654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c7087-e6f5-457f-8666-304287aaf6a4 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:21.124851 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1274/2521] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:21 2022] PUT /identity/v3/projects/a5c13427fa494183b48606003b18e54c/users/3303579daa824c6b908b35df766a41c8/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:21.136059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26267f-232e-4977-b8b7-1bd2ce2873ca None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:21.136352 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26267f-232e-4977-b8b7-1bd2ce2873ca None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:21.136630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26267f-232e-4977-b8b7-1bd2ce2873ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:21.163228 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-6c26267f-232e-4977-b8b7-1bd2ce2873ca None None] MFA Rules not processed for user `3303579daa824c6b908b35df766a41c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:21.164427 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-6c26267f-232e-4977-b8b7-1bd2ce2873ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:21.228482 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1248/2522] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:21 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:21.232933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c7087-e6f5-457f-8666-304287aaf6a4 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:21.293603 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c7087-e6f5-457f-8666-304287aaf6a4 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:21.298589 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90158f29-fc7d-4958-8547-49745ab2230a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:21.299254 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90158f29-fc7d-4958-8547-49745ab2230a admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:21.299542 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90158f29-fc7d-4958-8547-49745ab2230a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:21.299829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90158f29-fc7d-4958-8547-49745ab2230a admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:21.300524 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90158f29-fc7d-4958-8547-49745ab2230a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:21.302521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90158f29-fc7d-4958-8547-49745ab2230a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:21.400951 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1275/2523] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:27:21 2022] POST /identity/v3/projects => generated 357 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:21.405253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26267f-232e-4977-b8b7-1bd2ce2873ca None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:21.416208 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26267f-232e-4977-b8b7-1bd2ce2873ca None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:21.420358 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90158f29-fc7d-4958-8547-49745ab2230a admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:21.471778 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d26dc2-034b-48d8-9e50-3cfb018999a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:21.472441 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d26dc2-034b-48d8-9e50-3cfb018999a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:21.472723 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d26dc2-034b-48d8-9e50-3cfb018999a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:21.473000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d26dc2-034b-48d8-9e50-3cfb018999a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:21.473704 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d26dc2-034b-48d8-9e50-3cfb018999a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:21.475790 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d26dc2-034b-48d8-9e50-3cfb018999a1 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:21.476310 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90158f29-fc7d-4958-8547-49745ab2230a admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:21.480008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1433cc7-ae57-4c31-95ea-91ef4e51802b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:21.480648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1433cc7-ae57-4c31-95ea-91ef4e51802b service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:21.480929 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1433cc7-ae57-4c31-95ea-91ef4e51802b service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:21.481231 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1433cc7-ae57-4c31-95ea-91ef4e51802b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:21.483206 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e1433cc7-ae57-4c31-95ea-91ef4e51802b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:21.541487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1433cc7-ae57-4c31-95ea-91ef4e51802b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:21.542940 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1433cc7-ae57-4c31-95ea-91ef4e51802b service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:21.551592 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1276/2524] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:21 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:27:21.556338 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1249/2525] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:27:21 2022] POST /identity/v3/users => generated 285 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:21.565033 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1433cc7-ae57-4c31-95ea-91ef4e51802b service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:21.575975 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1433cc7-ae57-4c31-95ea-91ef4e51802b service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:21.580516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe40175-aafb-4696-9b1b-80028d567a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:21.581163 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe40175-aafb-4696-9b1b-80028d567a2d admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:21.581447 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe40175-aafb-4696-9b1b-80028d567a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:21.581724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe40175-aafb-4696-9b1b-80028d567a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:21.582463 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe40175-aafb-4696-9b1b-80028d567a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:21.584027 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe40175-aafb-4696-9b1b-80028d567a2d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:21.594057 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1277/2526] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:21.598279 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d26dc2-034b-48d8-9e50-3cfb018999a1 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:21.608397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d26dc2-034b-48d8-9e50-3cfb018999a1 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:21.613006 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adb401-5da6-4955-9100-9fc19aac112e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:21.613885 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adb401-5da6-4955-9100-9fc19aac112e admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:21.614170 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adb401-5da6-4955-9100-9fc19aac112e admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:21.614485 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adb401-5da6-4955-9100-9fc19aac112e admin admin] PATH_INFO: `/v3/projects/8155f8c6fee64b3f943c2ab25a3263b3/users/0ad09f7799274e5eb1038386846111de/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:21.629507 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adb401-5da6-4955-9100-9fc19aac112e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8155f8c6fee64b3f943c2ab25a3263b3, user_id=0ad09f7799274e5eb1038386846111de, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:21.632812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adb401-5da6-4955-9100-9fc19aac112e admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:21.743321 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1250/2527] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:21 2022] PUT /identity/v3/projects/8155f8c6fee64b3f943c2ab25a3263b3/users/0ad09f7799274e5eb1038386846111de/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:21.747233 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe40175-aafb-4696-9b1b-80028d567a2d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:21.757007 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe40175-aafb-4696-9b1b-80028d567a2d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:21.812906 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1a141-6263-415d-81af-788fb1038244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:21.813628 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1a141-6263-415d-81af-788fb1038244 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:21.813963 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1a141-6263-415d-81af-788fb1038244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:21.814242 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1a141-6263-415d-81af-788fb1038244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:21.815090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1a141-6263-415d-81af-788fb1038244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:21.816724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1a141-6263-415d-81af-788fb1038244 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:21.826957 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1278/2528] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:21.831176 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adb401-5da6-4955-9100-9fc19aac112e admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:21.846178 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adb401-5da6-4955-9100-9fc19aac112e admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:21.851613 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9d9fb-5fa5-4f31-b939-b2d506af8bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:21.852649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9d9fb-5fa5-4f31-b939-b2d506af8bba admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:21.852942 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9d9fb-5fa5-4f31-b939-b2d506af8bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:21.853223 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9d9fb-5fa5-4f31-b939-b2d506af8bba admin admin] PATH_INFO: `/v3/projects/8155f8c6fee64b3f943c2ab25a3263b3/users/0ad09f7799274e5eb1038386846111de/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:21.855292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9d9fb-5fa5-4f31-b939-b2d506af8bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8155f8c6fee64b3f943c2ab25a3263b3, user_id=0ad09f7799274e5eb1038386846111de, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:21.857935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9d9fb-5fa5-4f31-b939-b2d506af8bba admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:21.869229 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1251/2529] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:21 2022] PUT /identity/v3/projects/8155f8c6fee64b3f943c2ab25a3263b3/users/0ad09f7799274e5eb1038386846111de/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:21.880910 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df57a21-f5c5-4724-85fb-91ed6c0f26a5 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:21.881209 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df57a21-f5c5-4724-85fb-91ed6c0f26a5 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:21.881584 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df57a21-f5c5-4724-85fb-91ed6c0f26a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:21.907896 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2df57a21-f5c5-4724-85fb-91ed6c0f26a5 None None] MFA Rules not processed for user `0ad09f7799274e5eb1038386846111de`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:21.909089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2df57a21-f5c5-4724-85fb-91ed6c0f26a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:21.976467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1279/2530] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:21 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:21.988707 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9d9fb-5fa5-4f31-b939-b2d506af8bba admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:21.990486 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-1fa9d9fb-5fa5-4f31-b939-b2d506af8bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:22.047786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9d9fb-5fa5-4f31-b939-b2d506af8bba admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:22.051445 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e65239-3d46-4338-bdf7-99eb5372709f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:22.052088 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e65239-3d46-4338-bdf7-99eb5372709f service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:22.052375 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e65239-3d46-4338-bdf7-99eb5372709f service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:22.052653 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e65239-3d46-4338-bdf7-99eb5372709f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:22.062332 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e65239-3d46-4338-bdf7-99eb5372709f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:22.064006 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e65239-3d46-4338-bdf7-99eb5372709f service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:22.073656 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1252/2531] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:21 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:27:22.304180 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df57a21-f5c5-4724-85fb-91ed6c0f26a5 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:22.313747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df57a21-f5c5-4724-85fb-91ed6c0f26a5 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:22.317372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a16a5-e671-4055-a7ee-6c9f72dcd2f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:22.318048 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a16a5-e671-4055-a7ee-6c9f72dcd2f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:22.318329 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a16a5-e671-4055-a7ee-6c9f72dcd2f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:22.318629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a16a5-e671-4055-a7ee-6c9f72dcd2f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:22.375321 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a16a5-e671-4055-a7ee-6c9f72dcd2f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:22.376755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a16a5-e671-4055-a7ee-6c9f72dcd2f9 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:22.386696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1280/2532] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:22 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:27:30.282582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e65239-3d46-4338-bdf7-99eb5372709f service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:30.347170 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e65239-3d46-4338-bdf7-99eb5372709f service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:30.352021 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfcd09-7a13-482f-bf85-83e30a48ce95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:30.353404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfcd09-7a13-482f-bf85-83e30a48ce95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:30.353846 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfcd09-7a13-482f-bf85-83e30a48ce95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:30.353940 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfcd09-7a13-482f-bf85-83e30a48ce95 admin admin] PATH_INFO: `/v3/users/7fe0abf9609d420dbee44308390aed39` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:30.355232 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfcd09-7a13-482f-bf85-83e30a48ce95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe0abf9609d420dbee44308390aed39)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:30.366640 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfcd09-7a13-482f-bf85-83e30a48ce95 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:30.584305 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-bbdfcd09-7a13-482f-bf85-83e30a48ce95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe0abf9609d420dbee44308390aed39'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:30.584962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-bbdfcd09-7a13-482f-bf85-83e30a48ce95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe0abf9609d420dbee44308390aed39'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:30.597103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-bbdfcd09-7a13-482f-bf85-83e30a48ce95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe0abf9609d420dbee44308390aed39'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:30.597876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-bbdfcd09-7a13-482f-bf85-83e30a48ce95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe0abf9609d420dbee44308390aed39'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:30.605198 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-bbdfcd09-7a13-482f-bf85-83e30a48ce95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe0abf9609d420dbee44308390aed39'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:30.674811 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1253/2533] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:27:30 2022] DELETE /identity/v3/users/7fe0abf9609d420dbee44308390aed39 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:27:30.680541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33952e16-14f3-48bd-b287-7e7a49f48578 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:30.681257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33952e16-14f3-48bd-b287-7e7a49f48578 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:30.681257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33952e16-14f3-48bd-b287-7e7a49f48578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:30.700144 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-33952e16-14f3-48bd-b287-7e7a49f48578 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:30.701365 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-33952e16-14f3-48bd-b287-7e7a49f48578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:30.762946 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1281/2534] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:30.781479 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfcd09-7a13-482f-bf85-83e30a48ce95 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:30.782999 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-bbdfcd09-7a13-482f-bf85-83e30a48ce95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:30.842548 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfcd09-7a13-482f-bf85-83e30a48ce95 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:30.844847 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf0125-e963-49b2-99dd-0985ebb111b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:30.845657 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf0125-e963-49b2-99dd-0985ebb111b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:30.848888 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf0125-e963-49b2-99dd-0985ebb111b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:30.848888 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf0125-e963-49b2-99dd-0985ebb111b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:30.858011 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf0125-e963-49b2-99dd-0985ebb111b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:30.859503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf0125-e963-49b2-99dd-0985ebb111b7 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:30.871063 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1254/2535] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:27:31.448082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33952e16-14f3-48bd-b287-7e7a49f48578 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:31.449776 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-33952e16-14f3-48bd-b287-7e7a49f48578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:31.468639 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33952e16-14f3-48bd-b287-7e7a49f48578 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:31.473752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975f3c8-01bd-4a49-a177-9ab649ce1906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:31.474743 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975f3c8-01bd-4a49-a177-9ab649ce1906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:31.475091 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975f3c8-01bd-4a49-a177-9ab649ce1906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:31.475439 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975f3c8-01bd-4a49-a177-9ab649ce1906 admin admin] PATH_INFO: `/v3/projects/b6a8b2813af04da29aeaece3a2108cb5` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:31.476844 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975f3c8-01bd-4a49-a177-9ab649ce1906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6a8b2813af04da29aeaece3a2108cb5)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:31.479349 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975f3c8-01bd-4a49-a177-9ab649ce1906 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:31.565137 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d975f3c8-01bd-4a49-a177-9ab649ce1906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6a8b2813af04da29aeaece3a2108cb5', 'request_id': 'req-d975f3c8-01bd-4a49-a177-9ab649ce1906'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:31.627750 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d975f3c8-01bd-4a49-a177-9ab649ce1906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6a8b2813af04da29aeaece3a2108cb5', 'request_id': 'req-d975f3c8-01bd-4a49-a177-9ab649ce1906'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:31.634227 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d975f3c8-01bd-4a49-a177-9ab649ce1906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6a8b2813af04da29aeaece3a2108cb5', 'request_id': 'req-d975f3c8-01bd-4a49-a177-9ab649ce1906'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:31.645734 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d975f3c8-01bd-4a49-a177-9ab649ce1906 admin admin] The token cache is being invalidate because project b6a8b2813af04da29aeaece3a2108cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:27:31.646097 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d975f3c8-01bd-4a49-a177-9ab649ce1906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:31.646880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d975f3c8-01bd-4a49-a177-9ab649ce1906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:31.648551 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1282/2536] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:27:31 2022] DELETE /identity/v3/projects/b6a8b2813af04da29aeaece3a2108cb5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:31.652656 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf0125-e963-49b2-99dd-0985ebb111b7 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:31.664624 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf0125-e963-49b2-99dd-0985ebb111b7 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:31.721280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5138fc3-6d5c-4f6f-be59-c69ea1d6544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:31.723327 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5138fc3-6d5c-4f6f-be59-c69ea1d6544b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:31.723327 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5138fc3-6d5c-4f6f-be59-c69ea1d6544b admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:31.723327 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5138fc3-6d5c-4f6f-be59-c69ea1d6544b admin admin] PATH_INFO: `/v3/users/b57f768dfd10432d95db02442f980c2a` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:31.724071 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5138fc3-6d5c-4f6f-be59-c69ea1d6544b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b57f768dfd10432d95db02442f980c2a)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:31.725960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5138fc3-6d5c-4f6f-be59-c69ea1d6544b admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:31.943401 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d5138fc3-6d5c-4f6f-be59-c69ea1d6544b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b57f768dfd10432d95db02442f980c2a'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:31.944041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d5138fc3-6d5c-4f6f-be59-c69ea1d6544b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b57f768dfd10432d95db02442f980c2a'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:31.955573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d5138fc3-6d5c-4f6f-be59-c69ea1d6544b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b57f768dfd10432d95db02442f980c2a'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:31.956197 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d5138fc3-6d5c-4f6f-be59-c69ea1d6544b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b57f768dfd10432d95db02442f980c2a'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:31.963907 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-d5138fc3-6d5c-4f6f-be59-c69ea1d6544b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b57f768dfd10432d95db02442f980c2a'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:32.045379 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1255/2537] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:27:31 2022] DELETE /identity/v3/users/b57f768dfd10432d95db02442f980c2a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:32.502866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975f3c8-01bd-4a49-a177-9ab649ce1906 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:32.504366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d975f3c8-01bd-4a49-a177-9ab649ce1906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:32.517995 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975f3c8-01bd-4a49-a177-9ab649ce1906 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:32.576914 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4673aa-a3af-4f16-91fe-8b6fd26ea4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:32.577784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4673aa-a3af-4f16-91fe-8b6fd26ea4a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:32.578091 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4673aa-a3af-4f16-91fe-8b6fd26ea4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:32.578364 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4673aa-a3af-4f16-91fe-8b6fd26ea4a1 admin admin] PATH_INFO: `/v3/projects/9841f80c5a0240c290f9865cf936488f` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:32.579563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4673aa-a3af-4f16-91fe-8b6fd26ea4a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9841f80c5a0240c290f9865cf936488f)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:32.581505 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4673aa-a3af-4f16-91fe-8b6fd26ea4a1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:32.689093 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2a4673aa-a3af-4f16-91fe-8b6fd26ea4a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9841f80c5a0240c290f9865cf936488f', 'request_id': 'req-2a4673aa-a3af-4f16-91fe-8b6fd26ea4a1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:32.769699 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2a4673aa-a3af-4f16-91fe-8b6fd26ea4a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9841f80c5a0240c290f9865cf936488f', 'request_id': 'req-2a4673aa-a3af-4f16-91fe-8b6fd26ea4a1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:32.776934 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2a4673aa-a3af-4f16-91fe-8b6fd26ea4a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9841f80c5a0240c290f9865cf936488f', 'request_id': 'req-2a4673aa-a3af-4f16-91fe-8b6fd26ea4a1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:32.789963 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2a4673aa-a3af-4f16-91fe-8b6fd26ea4a1 admin admin] The token cache is being invalidate because project 9841f80c5a0240c290f9865cf936488f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:27:32.790348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2a4673aa-a3af-4f16-91fe-8b6fd26ea4a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:32.791034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2a4673aa-a3af-4f16-91fe-8b6fd26ea4a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:32.792862 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1283/2538] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:27:32 2022] DELETE /identity/v3/projects/9841f80c5a0240c290f9865cf936488f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:32.798115 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdc615-91c3-4243-bf0b-fdcd1881a94e None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:32.798628 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdc615-91c3-4243-bf0b-fdcd1881a94e None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:32.799046 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdc615-91c3-4243-bf0b-fdcd1881a94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:32.820093 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-efcdc615-91c3-4243-bf0b-fdcd1881a94e None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:32.821348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-efcdc615-91c3-4243-bf0b-fdcd1881a94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:32.887021 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1256/2539] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:32.895014 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31061d83-05bc-4c16-b4f2-89a6091eb241 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:32.895309 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31061d83-05bc-4c16-b4f2-89a6091eb241 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:32.895592 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31061d83-05bc-4c16-b4f2-89a6091eb241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:32.915300 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-31061d83-05bc-4c16-b4f2-89a6091eb241 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:32.916521 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-31061d83-05bc-4c16-b4f2-89a6091eb241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:32.924486 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1284/2540] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:32.928814 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdc615-91c3-4243-bf0b-fdcd1881a94e None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:32.938575 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdc615-91c3-4243-bf0b-fdcd1881a94e None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:32.943329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffb626-8fe9-4f9f-b1e8-d6e9098968a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:32.943932 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffb626-8fe9-4f9f-b1e8-d6e9098968a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:32.944241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffb626-8fe9-4f9f-b1e8-d6e9098968a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:32.944501 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffb626-8fe9-4f9f-b1e8-d6e9098968a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:32.945761 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffb626-8fe9-4f9f-b1e8-d6e9098968a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:27:32.946070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffb626-8fe9-4f9f-b1e8-d6e9098968a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:32.947703 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffb626-8fe9-4f9f-b1e8-d6e9098968a4 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:32.959023 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1257/2541] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:27:32.963947 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31061d83-05bc-4c16-b4f2-89a6091eb241 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:32.972944 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31061d83-05bc-4c16-b4f2-89a6091eb241 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:32.977970 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf7867-26f7-4e5a-88f3-59d73a2d4f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:32.978867 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf7867-26f7-4e5a-88f3-59d73a2d4f8f admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:32.985414 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf7867-26f7-4e5a-88f3-59d73a2d4f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:32.985414 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf7867-26f7-4e5a-88f3-59d73a2d4f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:32.985414 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf7867-26f7-4e5a-88f3-59d73a2d4f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:32.985414 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf7867-26f7-4e5a-88f3-59d73a2d4f8f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:33.109525 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1285/2542] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:27:32 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:33.113320 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffb626-8fe9-4f9f-b1e8-d6e9098968a4 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:33.123406 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffb626-8fe9-4f9f-b1e8-d6e9098968a4 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:33.179771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c1aee-c455-4b88-94db-2d30a7a0dd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:33.180429 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c1aee-c455-4b88-94db-2d30a7a0dd29 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:33.180711 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c1aee-c455-4b88-94db-2d30a7a0dd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:33.180991 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c1aee-c455-4b88-94db-2d30a7a0dd29 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:33.181661 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c1aee-c455-4b88-94db-2d30a7a0dd29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:33.183617 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c1aee-c455-4b88-94db-2d30a7a0dd29 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:33.256297 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1258/2543] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:27:33 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:27:33.261396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf7867-26f7-4e5a-88f3-59d73a2d4f8f admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:33.271562 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf7867-26f7-4e5a-88f3-59d73a2d4f8f admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:33.277757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a323890-66fe-4082-801f-430dfe6f3e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:33.278487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a323890-66fe-4082-801f-430dfe6f3e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:33.281326 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a323890-66fe-4082-801f-430dfe6f3e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:33.281326 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a323890-66fe-4082-801f-430dfe6f3e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:33.281326 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a323890-66fe-4082-801f-430dfe6f3e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:33.281614 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a323890-66fe-4082-801f-430dfe6f3e26 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:33.295617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1286/2544] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:33.296789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c1aee-c455-4b88-94db-2d30a7a0dd29 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:33.309147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c1aee-c455-4b88-94db-2d30a7a0dd29 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:33.317519 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790c02e-452c-488c-8c82-80b5aa536578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:33.318748 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790c02e-452c-488c-8c82-80b5aa536578 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:33.319248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790c02e-452c-488c-8c82-80b5aa536578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:33.319765 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790c02e-452c-488c-8c82-80b5aa536578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:33.321641 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790c02e-452c-488c-8c82-80b5aa536578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:33.324558 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790c02e-452c-488c-8c82-80b5aa536578 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:33.336398 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1259/2545] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:33.340692 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a323890-66fe-4082-801f-430dfe6f3e26 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:33.350722 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a323890-66fe-4082-801f-430dfe6f3e26 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:33.355690 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1c3c8-8471-41a8-9ea2-234f21162f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:33.356596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1c3c8-8471-41a8-9ea2-234f21162f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:33.356902 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1c3c8-8471-41a8-9ea2-234f21162f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:33.357174 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1c3c8-8471-41a8-9ea2-234f21162f94 admin admin] PATH_INFO: `/v3/projects/971682d7e1604a27997bfaad32c698c3/users/fadee13fcee14dea8b577e97371f8605/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:33.373112 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1c3c8-8471-41a8-9ea2-234f21162f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=971682d7e1604a27997bfaad32c698c3, user_id=fadee13fcee14dea8b577e97371f8605, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:33.376080 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1c3c8-8471-41a8-9ea2-234f21162f94 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:33.457266 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1287/2546] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:33 2022] PUT /identity/v3/projects/971682d7e1604a27997bfaad32c698c3/users/fadee13fcee14dea8b577e97371f8605/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:27:33.467820 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ae7bc-27d4-4ade-a66c-e5c9e42aa1d1 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:33.468134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ae7bc-27d4-4ade-a66c-e5c9e42aa1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:33.468411 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ae7bc-27d4-4ade-a66c-e5c9e42aa1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:33.495512 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-572ae7bc-27d4-4ade-a66c-e5c9e42aa1d1 None None] MFA Rules not processed for user `fadee13fcee14dea8b577e97371f8605`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:33.496723 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-572ae7bc-27d4-4ade-a66c-e5c9e42aa1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:33.562171 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1260/2547] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:33.566680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1c3c8-8471-41a8-9ea2-234f21162f94 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:33.629486 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1c3c8-8471-41a8-9ea2-234f21162f94 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:33.634934 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9d89b-fcaf-420b-b332-3e11e6b01c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:33.635837 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9d89b-fcaf-420b-b332-3e11e6b01c24 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:33.636120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9d89b-fcaf-420b-b332-3e11e6b01c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:33.636392 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9d89b-fcaf-420b-b332-3e11e6b01c24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:33.637078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9d89b-fcaf-420b-b332-3e11e6b01c24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:33.639042 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9d89b-fcaf-420b-b332-3e11e6b01c24 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:33.709584 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1288/2548] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:27:33 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:33.714053 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ae7bc-27d4-4ade-a66c-e5c9e42aa1d1 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:33.724785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ae7bc-27d4-4ade-a66c-e5c9e42aa1d1 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:33.787217 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c335c-ff95-45ab-aebe-d581368af7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:33.787897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c335c-ff95-45ab-aebe-d581368af7ad admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:33.788183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c335c-ff95-45ab-aebe-d581368af7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:33.788462 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c335c-ff95-45ab-aebe-d581368af7ad admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:33.789713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c335c-ff95-45ab-aebe-d581368af7ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:33.791889 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c335c-ff95-45ab-aebe-d581368af7ad admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:33.896404 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1261/2549] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:27:33 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:33.900326 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9d89b-fcaf-420b-b332-3e11e6b01c24 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:33.910611 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9d89b-fcaf-420b-b332-3e11e6b01c24 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:33.916292 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c8753-4301-4710-9fc3-f7745fa56751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:33.916954 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c8753-4301-4710-9fc3-f7745fa56751 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:33.917242 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c8753-4301-4710-9fc3-f7745fa56751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:33.917524 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c8753-4301-4710-9fc3-f7745fa56751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:33.918253 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c8753-4301-4710-9fc3-f7745fa56751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:33.919872 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c8753-4301-4710-9fc3-f7745fa56751 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:33.930996 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1289/2550] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:27:33.935143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c335c-ff95-45ab-aebe-d581368af7ad admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:33.945031 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c335c-ff95-45ab-aebe-d581368af7ad admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:33.949745 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35f3eb-0e7c-4514-a494-205d889c283c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:33.950641 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35f3eb-0e7c-4514-a494-205d889c283c admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:33.950922 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35f3eb-0e7c-4514-a494-205d889c283c admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:33.951192 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35f3eb-0e7c-4514-a494-205d889c283c admin admin] PATH_INFO: `/v3/projects/b88a8afaac0f4155955bbb95002bab39/users/20c569ce807e4b3db8165d38b9c163f9/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:33.968274 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35f3eb-0e7c-4514-a494-205d889c283c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b88a8afaac0f4155955bbb95002bab39, user_id=20c569ce807e4b3db8165d38b9c163f9, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:33.970997 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35f3eb-0e7c-4514-a494-205d889c283c admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:34.027953 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1262/2551] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:33 2022] PUT /identity/v3/projects/b88a8afaac0f4155955bbb95002bab39/users/20c569ce807e4b3db8165d38b9c163f9/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:34.031939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c8753-4301-4710-9fc3-f7745fa56751 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:34.042811 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c8753-4301-4710-9fc3-f7745fa56751 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:34.099724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41a830-28a5-443b-beac-a202dfae392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:34.100431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41a830-28a5-443b-beac-a202dfae392a admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:34.100719 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41a830-28a5-443b-beac-a202dfae392a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:34.101010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41a830-28a5-443b-beac-a202dfae392a admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:34.102408 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41a830-28a5-443b-beac-a202dfae392a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:34.103997 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41a830-28a5-443b-beac-a202dfae392a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:34.113772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1290/2552] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:34.119800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35f3eb-0e7c-4514-a494-205d889c283c admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:34.131005 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35f3eb-0e7c-4514-a494-205d889c283c admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:34.136435 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7efbb-8308-4487-ae67-e3f7af8a2402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:34.137321 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7efbb-8308-4487-ae67-e3f7af8a2402 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:34.137628 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7efbb-8308-4487-ae67-e3f7af8a2402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:34.137863 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7efbb-8308-4487-ae67-e3f7af8a2402 admin admin] PATH_INFO: `/v3/projects/b88a8afaac0f4155955bbb95002bab39/users/20c569ce807e4b3db8165d38b9c163f9/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:34.139899 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7efbb-8308-4487-ae67-e3f7af8a2402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b88a8afaac0f4155955bbb95002bab39, user_id=20c569ce807e4b3db8165d38b9c163f9, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:34.142633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7efbb-8308-4487-ae67-e3f7af8a2402 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:34.153590 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1263/2553] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:34 2022] PUT /identity/v3/projects/b88a8afaac0f4155955bbb95002bab39/users/20c569ce807e4b3db8165d38b9c163f9/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:34.165530 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b60f2-f83e-4139-99be-1fd4f29fbab8 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:34.165827 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b60f2-f83e-4139-99be-1fd4f29fbab8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:34.166106 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b60f2-f83e-4139-99be-1fd4f29fbab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:34.166881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7efbb-8308-4487-ae67-e3f7af8a2402 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:34.168589 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-14a7efbb-8308-4487-ae67-e3f7af8a2402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:34.192124 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8f1b60f2-f83e-4139-99be-1fd4f29fbab8 None None] MFA Rules not processed for user `20c569ce807e4b3db8165d38b9c163f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:34.193356 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8f1b60f2-f83e-4139-99be-1fd4f29fbab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:34.224446 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7efbb-8308-4487-ae67-e3f7af8a2402 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:34.228914 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3867622-ec84-4747-b56e-4b56a74d530c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:34.229560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3867622-ec84-4747-b56e-4b56a74d530c service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:34.229841 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3867622-ec84-4747-b56e-4b56a74d530c service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:34.230114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3867622-ec84-4747-b56e-4b56a74d530c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:34.232033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-c3867622-ec84-4747-b56e-4b56a74d530c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:34.261964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1291/2554] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:34.273182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b60f2-f83e-4139-99be-1fd4f29fbab8 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:34.275485 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8f1b60f2-f83e-4139-99be-1fd4f29fbab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:34.298548 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3867622-ec84-4747-b56e-4b56a74d530c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:34.299962 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3867622-ec84-4747-b56e-4b56a74d530c service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:34.309768 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1264/2555] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:27:34.331122 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b60f2-f83e-4139-99be-1fd4f29fbab8 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:34.334809 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71a51c-4462-4e4f-8392-39a05577cd98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:34.335452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71a51c-4462-4e4f-8392-39a05577cd98 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:34.336335 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71a51c-4462-4e4f-8392-39a05577cd98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:34.336657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71a51c-4462-4e4f-8392-39a05577cd98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:34.345903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71a51c-4462-4e4f-8392-39a05577cd98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:34.347371 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71a51c-4462-4e4f-8392-39a05577cd98 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:34.357604 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1292/2556] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:27:35.533820 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3867622-ec84-4747-b56e-4b56a74d530c service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:35.543607 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3867622-ec84-4747-b56e-4b56a74d530c service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:35.548436 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd20792-2a62-480c-8801-9d3ad53d994e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:35.549307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd20792-2a62-480c-8801-9d3ad53d994e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:35.549625 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd20792-2a62-480c-8801-9d3ad53d994e admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:35.549911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd20792-2a62-480c-8801-9d3ad53d994e admin admin] PATH_INFO: `/v3/users/fadee13fcee14dea8b577e97371f8605` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:35.551286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd20792-2a62-480c-8801-9d3ad53d994e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fadee13fcee14dea8b577e97371f8605)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:35.553207 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd20792-2a62-480c-8801-9d3ad53d994e admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:35.722390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3bd20792-2a62-480c-8801-9d3ad53d994e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fadee13fcee14dea8b577e97371f8605'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:35.723426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3bd20792-2a62-480c-8801-9d3ad53d994e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fadee13fcee14dea8b577e97371f8605'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:35.738085 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3bd20792-2a62-480c-8801-9d3ad53d994e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fadee13fcee14dea8b577e97371f8605'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:35.738907 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3bd20792-2a62-480c-8801-9d3ad53d994e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fadee13fcee14dea8b577e97371f8605'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:35.746100 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3bd20792-2a62-480c-8801-9d3ad53d994e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fadee13fcee14dea8b577e97371f8605'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:35.799343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1265/2557] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:27:35 2022] DELETE /identity/v3/users/fadee13fcee14dea8b577e97371f8605 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:35.803824 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a26c6-771d-4b2b-a0c1-dca3bf61cca0 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:35.804344 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a26c6-771d-4b2b-a0c1-dca3bf61cca0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:35.804668 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a26c6-771d-4b2b-a0c1-dca3bf61cca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:35.822546 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-386a26c6-771d-4b2b-a0c1-dca3bf61cca0 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:35.823774 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-386a26c6-771d-4b2b-a0c1-dca3bf61cca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:35.884937 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1293/2558] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:35.894919 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd20792-2a62-480c-8801-9d3ad53d994e admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:35.896417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-3bd20792-2a62-480c-8801-9d3ad53d994e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:35.953316 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd20792-2a62-480c-8801-9d3ad53d994e admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:35.956971 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78753b14-3428-4ab7-a5b5-4c925505ec6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:35.958164 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78753b14-3428-4ab7-a5b5-4c925505ec6e service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:35.958164 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78753b14-3428-4ab7-a5b5-4c925505ec6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:35.958164 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78753b14-3428-4ab7-a5b5-4c925505ec6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:35.968015 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78753b14-3428-4ab7-a5b5-4c925505ec6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:35.969426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78753b14-3428-4ab7-a5b5-4c925505ec6e service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:35.979102 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1266/2559] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:27:36.421038 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a26c6-771d-4b2b-a0c1-dca3bf61cca0 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:36.421038 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-386a26c6-771d-4b2b-a0c1-dca3bf61cca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:36.433747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a26c6-771d-4b2b-a0c1-dca3bf61cca0 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:36.439456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ebf1-0390-4c9b-a3df-a97cb9bfd07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:36.440414 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ebf1-0390-4c9b-a3df-a97cb9bfd07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:36.440833 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ebf1-0390-4c9b-a3df-a97cb9bfd07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:36.441110 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ebf1-0390-4c9b-a3df-a97cb9bfd07d admin admin] PATH_INFO: `/v3/projects/971682d7e1604a27997bfaad32c698c3` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:36.442396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691ebf1-0390-4c9b-a3df-a97cb9bfd07d admin admin] RBAC: Authorizing `identity:delete_project(project_id=971682d7e1604a27997bfaad32c698c3)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:36.445019 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691ebf1-0390-4c9b-a3df-a97cb9bfd07d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:36.567340 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2691ebf1-0390-4c9b-a3df-a97cb9bfd07d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '971682d7e1604a27997bfaad32c698c3', 'request_id': 'req-2691ebf1-0390-4c9b-a3df-a97cb9bfd07d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:36.639454 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2691ebf1-0390-4c9b-a3df-a97cb9bfd07d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '971682d7e1604a27997bfaad32c698c3', 'request_id': 'req-2691ebf1-0390-4c9b-a3df-a97cb9bfd07d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:36.650194 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2691ebf1-0390-4c9b-a3df-a97cb9bfd07d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '971682d7e1604a27997bfaad32c698c3', 'request_id': 'req-2691ebf1-0390-4c9b-a3df-a97cb9bfd07d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:36.662664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2691ebf1-0390-4c9b-a3df-a97cb9bfd07d admin admin] The token cache is being invalidate because project 971682d7e1604a27997bfaad32c698c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:27:36.663049 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2691ebf1-0390-4c9b-a3df-a97cb9bfd07d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:36.663720 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2691ebf1-0390-4c9b-a3df-a97cb9bfd07d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:36.666857 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1294/2560] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:27:36 2022] DELETE /identity/v3/projects/971682d7e1604a27997bfaad32c698c3 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:36.670400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78753b14-3428-4ab7-a5b5-4c925505ec6e service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:36.680802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78753b14-3428-4ab7-a5b5-4c925505ec6e service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:36.737312 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72a90c-9f0d-40eb-8be6-96ed39268f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:36.738345 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72a90c-9f0d-40eb-8be6-96ed39268f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:36.738728 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72a90c-9f0d-40eb-8be6-96ed39268f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:36.739080 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72a90c-9f0d-40eb-8be6-96ed39268f10 admin admin] PATH_INFO: `/v3/users/20c569ce807e4b3db8165d38b9c163f9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:36.740375 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72a90c-9f0d-40eb-8be6-96ed39268f10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20c569ce807e4b3db8165d38b9c163f9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:36.742480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72a90c-9f0d-40eb-8be6-96ed39268f10 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:36.905626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-5e72a90c-9f0d-40eb-8be6-96ed39268f10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20c569ce807e4b3db8165d38b9c163f9'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:36.906322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-5e72a90c-9f0d-40eb-8be6-96ed39268f10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20c569ce807e4b3db8165d38b9c163f9'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:36.918417 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-5e72a90c-9f0d-40eb-8be6-96ed39268f10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20c569ce807e4b3db8165d38b9c163f9'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:36.919136 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-5e72a90c-9f0d-40eb-8be6-96ed39268f10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20c569ce807e4b3db8165d38b9c163f9'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:36.925969 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-5e72a90c-9f0d-40eb-8be6-96ed39268f10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20c569ce807e4b3db8165d38b9c163f9'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:36.983410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1267/2561] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:27:36 2022] DELETE /identity/v3/users/20c569ce807e4b3db8165d38b9c163f9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:27:37.787083 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ebf1-0390-4c9b-a3df-a97cb9bfd07d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:37.790332 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2691ebf1-0390-4c9b-a3df-a97cb9bfd07d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:37.808421 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ebf1-0390-4c9b-a3df-a97cb9bfd07d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:37.882020 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1d85f-a8b9-4a4f-a578-2cc56fcbfb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:37.883226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1d85f-a8b9-4a4f-a578-2cc56fcbfb58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:37.883609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1d85f-a8b9-4a4f-a578-2cc56fcbfb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:37.884010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1d85f-a8b9-4a4f-a578-2cc56fcbfb58 admin admin] PATH_INFO: `/v3/projects/b88a8afaac0f4155955bbb95002bab39` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:37.886360 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1d85f-a8b9-4a4f-a578-2cc56fcbfb58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b88a8afaac0f4155955bbb95002bab39)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:37.888577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1d85f-a8b9-4a4f-a578-2cc56fcbfb58 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:38.015818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1ad1d85f-a8b9-4a4f-a578-2cc56fcbfb58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b88a8afaac0f4155955bbb95002bab39', 'request_id': 'req-1ad1d85f-a8b9-4a4f-a578-2cc56fcbfb58'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:38.090948 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1ad1d85f-a8b9-4a4f-a578-2cc56fcbfb58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b88a8afaac0f4155955bbb95002bab39', 'request_id': 'req-1ad1d85f-a8b9-4a4f-a578-2cc56fcbfb58'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:38.097244 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1ad1d85f-a8b9-4a4f-a578-2cc56fcbfb58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b88a8afaac0f4155955bbb95002bab39', 'request_id': 'req-1ad1d85f-a8b9-4a4f-a578-2cc56fcbfb58'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:38.110125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1ad1d85f-a8b9-4a4f-a578-2cc56fcbfb58 admin admin] The token cache is being invalidate because project b88a8afaac0f4155955bbb95002bab39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:27:38.110515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1ad1d85f-a8b9-4a4f-a578-2cc56fcbfb58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:38.111338 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1ad1d85f-a8b9-4a4f-a578-2cc56fcbfb58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:38.113488 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1295/2562] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:27:37 2022] DELETE /identity/v3/projects/b88a8afaac0f4155955bbb95002bab39 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:38.121593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f830e-cc24-41a3-98c2-541de4ea3a9e None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:38.122044 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f830e-cc24-41a3-98c2-541de4ea3a9e None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:38.122044 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f830e-cc24-41a3-98c2-541de4ea3a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:38.144116 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-af5f830e-cc24-41a3-98c2-541de4ea3a9e None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:38.145415 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-af5f830e-cc24-41a3-98c2-541de4ea3a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:38.215352 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1268/2563] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:38.223270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a3edd-c121-40ae-8fa6-e403c1b86fa8 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:38.223558 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a3edd-c121-40ae-8fa6-e403c1b86fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:38.223835 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a3edd-c121-40ae-8fa6-e403c1b86fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:38.244242 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-704a3edd-c121-40ae-8fa6-e403c1b86fa8 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:38.245519 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-704a3edd-c121-40ae-8fa6-e403c1b86fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:38.253706 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1296/2564] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:27:38.262491 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f830e-cc24-41a3-98c2-541de4ea3a9e None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:38.276387 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f830e-cc24-41a3-98c2-541de4ea3a9e None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:38.282383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e9754-f44f-4d81-83cd-b871bf98be2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:38.283143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e9754-f44f-4d81-83cd-b871bf98be2a admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:38.283433 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e9754-f44f-4d81-83cd-b871bf98be2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:38.283713 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e9754-f44f-4d81-83cd-b871bf98be2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:38.284452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e9754-f44f-4d81-83cd-b871bf98be2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:27:38.284959 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e9754-f44f-4d81-83cd-b871bf98be2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:38.286671 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e9754-f44f-4d81-83cd-b871bf98be2a admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:38.299248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1269/2565] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:27:38.304633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a3edd-c121-40ae-8fa6-e403c1b86fa8 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:38.314397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a3edd-c121-40ae-8fa6-e403c1b86fa8 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:38.319740 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e8f5c-62b2-4a34-b7ac-98c151bf6429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:38.321163 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e8f5c-62b2-4a34-b7ac-98c151bf6429 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:38.321390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e8f5c-62b2-4a34-b7ac-98c151bf6429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:38.321675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e8f5c-62b2-4a34-b7ac-98c151bf6429 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:38.322829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e8f5c-62b2-4a34-b7ac-98c151bf6429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:38.324732 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e8f5c-62b2-4a34-b7ac-98c151bf6429 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:38.435104 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1297/2566] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:27:38 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:38.439697 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e9754-f44f-4d81-83cd-b871bf98be2a admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:38.450183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e9754-f44f-4d81-83cd-b871bf98be2a admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:38.503528 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e8f5c-62b2-4a34-b7ac-98c151bf6429 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:38.505372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4d7e8f5c-62b2-4a34-b7ac-98c151bf6429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:38.509482 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19732ae-eb4d-4283-82b0-34ae667c663a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:38.510154 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19732ae-eb4d-4283-82b0-34ae667c663a admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:38.511012 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19732ae-eb4d-4283-82b0-34ae667c663a admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:38.511414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19732ae-eb4d-4283-82b0-34ae667c663a admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:38.512171 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19732ae-eb4d-4283-82b0-34ae667c663a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:38.515233 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19732ae-eb4d-4283-82b0-34ae667c663a admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:38.521015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e8f5c-62b2-4a34-b7ac-98c151bf6429 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:38.527087 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2731c71-f3d0-424b-9a37-5534b6a6e648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:38.527908 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2731c71-f3d0-424b-9a37-5534b6a6e648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:38.528197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2731c71-f3d0-424b-9a37-5534b6a6e648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:38.528477 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2731c71-f3d0-424b-9a37-5534b6a6e648 admin admin] PATH_INFO: `/v3/users/d2267b0c3311480eb8d1f54df5296c4c` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:38.529758 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2731c71-f3d0-424b-9a37-5534b6a6e648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2267b0c3311480eb8d1f54df5296c4c)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:38.531751 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2731c71-f3d0-424b-9a37-5534b6a6e648 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:38.588204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1270/2567] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:27:38 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:27:38.592143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19732ae-eb4d-4283-82b0-34ae667c663a admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:38.601701 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19732ae-eb4d-4283-82b0-34ae667c663a admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:38.606717 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c398d96-c845-4e70-8896-651752ce64ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:38.607560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c398d96-c845-4e70-8896-651752ce64ff admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:38.607850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c398d96-c845-4e70-8896-651752ce64ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:38.608186 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c398d96-c845-4e70-8896-651752ce64ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:38.608947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c398d96-c845-4e70-8896-651752ce64ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:38.610684 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c398d96-c845-4e70-8896-651752ce64ff admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:38.621400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1271/2568] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:27:38.625257 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c398d96-c845-4e70-8896-651752ce64ff admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:38.635741 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c398d96-c845-4e70-8896-651752ce64ff admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:38.640660 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4682ce5-f42c-40af-809a-4062c9b0ef7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:38.641294 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4682ce5-f42c-40af-809a-4062c9b0ef7a admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:38.641578 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4682ce5-f42c-40af-809a-4062c9b0ef7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:38.641856 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4682ce5-f42c-40af-809a-4062c9b0ef7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:38.642620 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4682ce5-f42c-40af-809a-4062c9b0ef7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:38.644227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4682ce5-f42c-40af-809a-4062c9b0ef7a admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:38.654590 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1272/2569] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:27:38.658378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4682ce5-f42c-40af-809a-4062c9b0ef7a admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:38.667846 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4682ce5-f42c-40af-809a-4062c9b0ef7a admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:38.672668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e507e5-4d98-4df6-bd79-c56bb8e5a3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:38.673513 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e507e5-4d98-4df6-bd79-c56bb8e5a3c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:38.673794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e507e5-4d98-4df6-bd79-c56bb8e5a3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:38.674071 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e507e5-4d98-4df6-bd79-c56bb8e5a3c3 admin admin] PATH_INFO: `/v3/projects/95545f74981b44aeb69f246159088da1/users/618beebad5b645c9a30632bd0677658e/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:38.688828 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e507e5-4d98-4df6-bd79-c56bb8e5a3c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95545f74981b44aeb69f246159088da1, user_id=618beebad5b645c9a30632bd0677658e, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:38.691438 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e507e5-4d98-4df6-bd79-c56bb8e5a3c3 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:38.693318 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d2731c71-f3d0-424b-9a37-5534b6a6e648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2267b0c3311480eb8d1f54df5296c4c'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:38.693978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d2731c71-f3d0-424b-9a37-5534b6a6e648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2267b0c3311480eb8d1f54df5296c4c'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:38.694676 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d2731c71-f3d0-424b-9a37-5534b6a6e648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2267b0c3311480eb8d1f54df5296c4c'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:38.707088 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d2731c71-f3d0-424b-9a37-5534b6a6e648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2267b0c3311480eb8d1f54df5296c4c'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:38.714138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d2731c71-f3d0-424b-9a37-5534b6a6e648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2267b0c3311480eb8d1f54df5296c4c'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:38.782348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1273/2570] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:38 2022] PUT /identity/v3/projects/95545f74981b44aeb69f246159088da1/users/618beebad5b645c9a30632bd0677658e/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:27:38.787471 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef94fc-c7cd-4fd6-8bdb-dff3eb7c0099 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:38.787808 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef94fc-c7cd-4fd6-8bdb-dff3eb7c0099 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:38.788091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef94fc-c7cd-4fd6-8bdb-dff3eb7c0099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:38.808184 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-34ef94fc-c7cd-4fd6-8bdb-dff3eb7c0099 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:38.809518 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-34ef94fc-c7cd-4fd6-8bdb-dff3eb7c0099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:38.811814 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1298/2571] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:27:38 2022] DELETE /identity/v3/users/d2267b0c3311480eb8d1f54df5296c4c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:27:38.870691 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1274/2572] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:27:38.880560 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2731c71-f3d0-424b-9a37-5534b6a6e648 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:38.882078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d2731c71-f3d0-424b-9a37-5534b6a6e648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:39.000766 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2731c71-f3d0-424b-9a37-5534b6a6e648 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:39.000766 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa823f4c-fa98-42c0-bf2c-73e67f520e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:39.000766 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa823f4c-fa98-42c0-bf2c-73e67f520e17 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:39.000766 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa823f4c-fa98-42c0-bf2c-73e67f520e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:39.001677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa823f4c-fa98-42c0-bf2c-73e67f520e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:39.001677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa823f4c-fa98-42c0-bf2c-73e67f520e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:39.001677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa823f4c-fa98-42c0-bf2c-73e67f520e17 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:39.001677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1299/2573] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:27:39.241420 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef94fc-c7cd-4fd6-8bdb-dff3eb7c0099 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:39.242955 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-34ef94fc-c7cd-4fd6-8bdb-dff3eb7c0099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:39.265189 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef94fc-c7cd-4fd6-8bdb-dff3eb7c0099 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:39.266586 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9826c-8fdb-4cb5-8611-d6bdb68973fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:39.267581 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9826c-8fdb-4cb5-8611-d6bdb68973fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:39.267979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9826c-8fdb-4cb5-8611-d6bdb68973fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:39.268722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9826c-8fdb-4cb5-8611-d6bdb68973fc admin admin] PATH_INFO: `/v3/projects/802e2ef29f6f4b2c8ca69204b69cc142` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:39.269980 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9826c-8fdb-4cb5-8611-d6bdb68973fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=802e2ef29f6f4b2c8ca69204b69cc142)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:39.272377 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9826c-8fdb-4cb5-8611-d6bdb68973fc admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:39.376750 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-f1b9826c-8fdb-4cb5-8611-d6bdb68973fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '802e2ef29f6f4b2c8ca69204b69cc142', 'request_id': 'req-f1b9826c-8fdb-4cb5-8611-d6bdb68973fc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:39.440310 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-f1b9826c-8fdb-4cb5-8611-d6bdb68973fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '802e2ef29f6f4b2c8ca69204b69cc142', 'request_id': 'req-f1b9826c-8fdb-4cb5-8611-d6bdb68973fc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:39.447545 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-f1b9826c-8fdb-4cb5-8611-d6bdb68973fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '802e2ef29f6f4b2c8ca69204b69cc142', 'request_id': 'req-f1b9826c-8fdb-4cb5-8611-d6bdb68973fc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:39.458524 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-f1b9826c-8fdb-4cb5-8611-d6bdb68973fc admin admin] The token cache is being invalidate because project 802e2ef29f6f4b2c8ca69204b69cc142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:27:39.458817 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-f1b9826c-8fdb-4cb5-8611-d6bdb68973fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:39.459462 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-f1b9826c-8fdb-4cb5-8611-d6bdb68973fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:39.461034 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1275/2574] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:27:39 2022] DELETE /identity/v3/projects/802e2ef29f6f4b2c8ca69204b69cc142 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:39.466127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d81ed9-b948-47aa-aabf-9a9726fb2220 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:39.466609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d81ed9-b948-47aa-aabf-9a9726fb2220 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:39.466964 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d81ed9-b948-47aa-aabf-9a9726fb2220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:39.485494 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a1d81ed9-b948-47aa-aabf-9a9726fb2220 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:39.486831 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a1d81ed9-b948-47aa-aabf-9a9726fb2220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:39.545504 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1300/2575] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:39.553413 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee24138-d4bc-43d2-9b9d-af450a26e894 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:39.553774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee24138-d4bc-43d2-9b9d-af450a26e894 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:39.554167 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee24138-d4bc-43d2-9b9d-af450a26e894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:39.575024 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-3ee24138-d4bc-43d2-9b9d-af450a26e894 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:39.576251 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-3ee24138-d4bc-43d2-9b9d-af450a26e894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:39.584282 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1276/2576] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:27:39.588640 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d81ed9-b948-47aa-aabf-9a9726fb2220 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:39.598660 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d81ed9-b948-47aa-aabf-9a9726fb2220 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:39.603412 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd949c4a-4339-4e3d-a3a6-d400ed9ae700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:39.636379 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949c4a-4339-4e3d-a3a6-d400ed9ae700 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:39.636379 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949c4a-4339-4e3d-a3a6-d400ed9ae700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:39.636379 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949c4a-4339-4e3d-a3a6-d400ed9ae700 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:39.636379 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd949c4a-4339-4e3d-a3a6-d400ed9ae700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:27:39.636379 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd949c4a-4339-4e3d-a3a6-d400ed9ae700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:39.636379 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd949c4a-4339-4e3d-a3a6-d400ed9ae700 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:39.637797 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1301/2577] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:27:39.639562 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee24138-d4bc-43d2-9b9d-af450a26e894 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:39.649116 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee24138-d4bc-43d2-9b9d-af450a26e894 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:39.653874 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ae491-5bed-475b-a629-b6a168e1e83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:39.654638 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ae491-5bed-475b-a629-b6a168e1e83e admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:39.654988 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ae491-5bed-475b-a629-b6a168e1e83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:39.655271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ae491-5bed-475b-a629-b6a168e1e83e admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:39.655967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ae491-5bed-475b-a629-b6a168e1e83e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:39.657869 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ae491-5bed-475b-a629-b6a168e1e83e admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:39.744765 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1277/2578] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:27:39 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:27:39.749114 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd949c4a-4339-4e3d-a3a6-d400ed9ae700 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:39.759649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd949c4a-4339-4e3d-a3a6-d400ed9ae700 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:39.816093 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425586d-e27a-43e6-9d53-534a1f989f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:39.816793 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425586d-e27a-43e6-9d53-534a1f989f13 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:39.816977 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425586d-e27a-43e6-9d53-534a1f989f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:39.817272 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425586d-e27a-43e6-9d53-534a1f989f13 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:39.817978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425586d-e27a-43e6-9d53-534a1f989f13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:39.819896 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425586d-e27a-43e6-9d53-534a1f989f13 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:39.891336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1302/2579] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:27:39 2022] POST /identity/v3/users => generated 283 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:39.895303 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ae491-5bed-475b-a629-b6a168e1e83e admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:39.906083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ae491-5bed-475b-a629-b6a168e1e83e admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:39.910787 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e86a8c-5be0-4798-9a64-dcbfc46dbd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:39.911449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e86a8c-5be0-4798-9a64-dcbfc46dbd52 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:39.911789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e86a8c-5be0-4798-9a64-dcbfc46dbd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:39.912065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e86a8c-5be0-4798-9a64-dcbfc46dbd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:39.912789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e86a8c-5be0-4798-9a64-dcbfc46dbd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:39.914949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e86a8c-5be0-4798-9a64-dcbfc46dbd52 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:39.925758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1278/2580] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:39.929994 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425586d-e27a-43e6-9d53-534a1f989f13 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:39.940211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425586d-e27a-43e6-9d53-534a1f989f13 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:39.945629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65628a4-f704-43c8-9e61-15eccfc0ede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:39.946563 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65628a4-f704-43c8-9e61-15eccfc0ede5 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:39.946847 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65628a4-f704-43c8-9e61-15eccfc0ede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:39.947116 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65628a4-f704-43c8-9e61-15eccfc0ede5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:39.948017 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65628a4-f704-43c8-9e61-15eccfc0ede5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:39.949614 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65628a4-f704-43c8-9e61-15eccfc0ede5 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:39.959450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1303/2581] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:27:39.964269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e86a8c-5be0-4798-9a64-dcbfc46dbd52 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:39.974162 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e86a8c-5be0-4798-9a64-dcbfc46dbd52 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:39.979358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183fb51-9dbc-4a09-8314-5b1994c17f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:39.980227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183fb51-9dbc-4a09-8314-5b1994c17f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:39.980511 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183fb51-9dbc-4a09-8314-5b1994c17f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:39.980785 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183fb51-9dbc-4a09-8314-5b1994c17f56 admin admin] PATH_INFO: `/v3/projects/c2631f2278154335aeb7bc12479e8509/users/9d666450ef5643749577ebe23a9a89ec/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:39.995182 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183fb51-9dbc-4a09-8314-5b1994c17f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2631f2278154335aeb7bc12479e8509, user_id=9d666450ef5643749577ebe23a9a89ec, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:39.997846 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183fb51-9dbc-4a09-8314-5b1994c17f56 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:40.079237 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1279/2582] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:39 2022] PUT /identity/v3/projects/c2631f2278154335aeb7bc12479e8509/users/9d666450ef5643749577ebe23a9a89ec/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:40.085835 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94436ca-1be3-4884-bcfc-ecde930affb8 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:40.086645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94436ca-1be3-4884-bcfc-ecde930affb8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:40.086645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94436ca-1be3-4884-bcfc-ecde930affb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:40.112480 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d94436ca-1be3-4884-bcfc-ecde930affb8 None None] MFA Rules not processed for user `9d666450ef5643749577ebe23a9a89ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:40.113698 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d94436ca-1be3-4884-bcfc-ecde930affb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:40.178546 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1304/2583] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:40.189761 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183fb51-9dbc-4a09-8314-5b1994c17f56 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:40.191500 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-5183fb51-9dbc-4a09-8314-5b1994c17f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:40.255310 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183fb51-9dbc-4a09-8314-5b1994c17f56 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:40.259572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81593b-828d-4c09-a114-c67a6830b9b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:40.260483 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81593b-828d-4c09-a114-c67a6830b9b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:40.260817 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81593b-828d-4c09-a114-c67a6830b9b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:40.261103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81593b-828d-4c09-a114-c67a6830b9b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:40.274789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81593b-828d-4c09-a114-c67a6830b9b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:40.274789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81593b-828d-4c09-a114-c67a6830b9b3 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:40.276992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f50718-43ae-49a5-97cd-ced34d781856 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:40.277296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f50718-43ae-49a5-97cd-ced34d781856 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:40.278018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f50718-43ae-49a5-97cd-ced34d781856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:40.284824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1280/2584] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:27:40.328239 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-28f50718-43ae-49a5-97cd-ced34d781856 None None] MFA Rules not processed for user `618beebad5b645c9a30632bd0677658e`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:40.328504 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-28f50718-43ae-49a5-97cd-ced34d781856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:40.413169 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1305/2585] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:27:40.436579 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81593b-828d-4c09-a114-c67a6830b9b3 service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:40.438187 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-ac81593b-828d-4c09-a114-c67a6830b9b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:40.450061 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81593b-828d-4c09-a114-c67a6830b9b3 service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:40.453696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a778a86-c1a1-4933-8496-7fb6eb62b320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:40.454345 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a778a86-c1a1-4933-8496-7fb6eb62b320 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:40.454665 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a778a86-c1a1-4933-8496-7fb6eb62b320 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:40.454941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a778a86-c1a1-4933-8496-7fb6eb62b320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:40.463139 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a778a86-c1a1-4933-8496-7fb6eb62b320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:40.464529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a778a86-c1a1-4933-8496-7fb6eb62b320 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:40.473124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1281/2586] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:27:41.139617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f50718-43ae-49a5-97cd-ced34d781856 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:41.141111 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-28f50718-43ae-49a5-97cd-ced34d781856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:41.207927 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f50718-43ae-49a5-97cd-ced34d781856 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:41.212481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb6283-64e2-4acc-9f87-36995f193617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:41.213350 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb6283-64e2-4acc-9f87-36995f193617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:41.213631 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb6283-64e2-4acc-9f87-36995f193617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:41.213907 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb6283-64e2-4acc-9f87-36995f193617 admin admin] PATH_INFO: `/v3/users/3303579daa824c6b908b35df766a41c8` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:41.215151 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb6283-64e2-4acc-9f87-36995f193617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3303579daa824c6b908b35df766a41c8)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:41.217038 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb6283-64e2-4acc-9f87-36995f193617 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:41.355988 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2ecb6283-64e2-4acc-9f87-36995f193617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3303579daa824c6b908b35df766a41c8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:41.356675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2ecb6283-64e2-4acc-9f87-36995f193617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3303579daa824c6b908b35df766a41c8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:41.357338 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2ecb6283-64e2-4acc-9f87-36995f193617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3303579daa824c6b908b35df766a41c8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:41.369053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2ecb6283-64e2-4acc-9f87-36995f193617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3303579daa824c6b908b35df766a41c8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:41.375918 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2ecb6283-64e2-4acc-9f87-36995f193617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3303579daa824c6b908b35df766a41c8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:41.444830 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1306/2587] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:27:41 2022] DELETE /identity/v3/users/3303579daa824c6b908b35df766a41c8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:41.449741 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb4440-0e89-4212-b79c-589378b75091 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:41.451194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb4440-0e89-4212-b79c-589378b75091 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:41.451194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb4440-0e89-4212-b79c-589378b75091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:41.468798 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-fadb4440-0e89-4212-b79c-589378b75091 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:41.469978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-fadb4440-0e89-4212-b79c-589378b75091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:41.526088 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1282/2588] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:41.535628 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb6283-64e2-4acc-9f87-36995f193617 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:41.537051 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2ecb6283-64e2-4acc-9f87-36995f193617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:41.592752 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb6283-64e2-4acc-9f87-36995f193617 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:41.596388 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6c115-4efb-4aa4-95ee-d63408594b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:41.599890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6c115-4efb-4aa4-95ee-d63408594b28 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:41.599890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6c115-4efb-4aa4-95ee-d63408594b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:41.599890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6c115-4efb-4aa4-95ee-d63408594b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:41.606525 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6c115-4efb-4aa4-95ee-d63408594b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:41.607970 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6c115-4efb-4aa4-95ee-d63408594b28 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:41.617836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1307/2589] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:27:42.023947 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb4440-0e89-4212-b79c-589378b75091 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:42.033602 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-fadb4440-0e89-4212-b79c-589378b75091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:42.050173 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb4440-0e89-4212-b79c-589378b75091 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:42.060476 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d487f-6066-46a8-b48f-d929b90ad5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:42.060476 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d487f-6066-46a8-b48f-d929b90ad5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:42.060476 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d487f-6066-46a8-b48f-d929b90ad5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:42.060476 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d487f-6066-46a8-b48f-d929b90ad5ee admin admin] PATH_INFO: `/v3/projects/a5c13427fa494183b48606003b18e54c` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:42.060835 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d487f-6066-46a8-b48f-d929b90ad5ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5c13427fa494183b48606003b18e54c)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:42.061241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d487f-6066-46a8-b48f-d929b90ad5ee admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:42.188460 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-811d487f-6066-46a8-b48f-d929b90ad5ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5c13427fa494183b48606003b18e54c', 'request_id': 'req-811d487f-6066-46a8-b48f-d929b90ad5ee'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:42.258225 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7baf3-47cd-4284-91e8-a029f93018dc None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:42.258761 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7baf3-47cd-4284-91e8-a029f93018dc None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:42.258892 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7baf3-47cd-4284-91e8-a029f93018dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:42.273706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-811d487f-6066-46a8-b48f-d929b90ad5ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5c13427fa494183b48606003b18e54c', 'request_id': 'req-811d487f-6066-46a8-b48f-d929b90ad5ee'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:42.277279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-eeb7baf3-47cd-4284-91e8-a029f93018dc None None] MFA Rules not processed for user `618beebad5b645c9a30632bd0677658e`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:42.278649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-eeb7baf3-47cd-4284-91e8-a029f93018dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:42.279994 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-811d487f-6066-46a8-b48f-d929b90ad5ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5c13427fa494183b48606003b18e54c', 'request_id': 'req-811d487f-6066-46a8-b48f-d929b90ad5ee'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:42.292019 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-811d487f-6066-46a8-b48f-d929b90ad5ee admin admin] The token cache is being invalidate because project a5c13427fa494183b48606003b18e54c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:27:42.292410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-811d487f-6066-46a8-b48f-d929b90ad5ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:42.293124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-811d487f-6066-46a8-b48f-d929b90ad5ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:42.295145 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1283/2590] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:27:42 2022] DELETE /identity/v3/projects/a5c13427fa494183b48606003b18e54c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:42.298637 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d487f-6066-46a8-b48f-d929b90ad5ee admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:42.300040 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-811d487f-6066-46a8-b48f-d929b90ad5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:42.337911 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1308/2591] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:27:42.369074 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d487f-6066-46a8-b48f-d929b90ad5ee admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:42.373876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceac764-851c-4557-8cd6-fe947eca7cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:42.374786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceac764-851c-4557-8cd6-fe947eca7cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:42.377824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceac764-851c-4557-8cd6-fe947eca7cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:42.377824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceac764-851c-4557-8cd6-fe947eca7cf5 admin admin] PATH_INFO: `/v3/users/0ad09f7799274e5eb1038386846111de` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:42.377824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceac764-851c-4557-8cd6-fe947eca7cf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ad09f7799274e5eb1038386846111de)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:42.378459 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceac764-851c-4557-8cd6-fe947eca7cf5 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:42.581928 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7baf3-47cd-4284-91e8-a029f93018dc None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:42.583370 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-eeb7baf3-47cd-4284-91e8-a029f93018dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:42.605044 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7ceac764-851c-4557-8cd6-fe947eca7cf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ad09f7799274e5eb1038386846111de'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:42.606006 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7ceac764-851c-4557-8cd6-fe947eca7cf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ad09f7799274e5eb1038386846111de'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:42.619025 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7ceac764-851c-4557-8cd6-fe947eca7cf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ad09f7799274e5eb1038386846111de'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:42.619719 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7ceac764-851c-4557-8cd6-fe947eca7cf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ad09f7799274e5eb1038386846111de'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:42.626764 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7ceac764-851c-4557-8cd6-fe947eca7cf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ad09f7799274e5eb1038386846111de'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:42.643258 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7baf3-47cd-4284-91e8-a029f93018dc None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:42.646867 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37e00e-53f2-4686-98a1-cacedb1de422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:42.647515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37e00e-53f2-4686-98a1-cacedb1de422 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:42.647898 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37e00e-53f2-4686-98a1-cacedb1de422 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:42.648684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37e00e-53f2-4686-98a1-cacedb1de422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:42.650638 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fb37e00e-53f2-4686-98a1-cacedb1de422 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:42.660193 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37e00e-53f2-4686-98a1-cacedb1de422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:42.662651 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37e00e-53f2-4686-98a1-cacedb1de422 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:42.671668 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1309/2592] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:27:42.707414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1284/2593] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:27:42 2022] DELETE /identity/v3/users/0ad09f7799274e5eb1038386846111de => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:27:43.076933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37e00e-53f2-4686-98a1-cacedb1de422 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:43.080651 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fb37e00e-53f2-4686-98a1-cacedb1de422 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:43.114049 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37e00e-53f2-4686-98a1-cacedb1de422 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:43.174739 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa8ecc-ed4e-4a6c-8d14-9ab3351a824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:43.175619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa8ecc-ed4e-4a6c-8d14-9ab3351a824d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:43.175902 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa8ecc-ed4e-4a6c-8d14-9ab3351a824d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:43.176176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa8ecc-ed4e-4a6c-8d14-9ab3351a824d admin admin] PATH_INFO: `/v3/projects/8155f8c6fee64b3f943c2ab25a3263b3` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:43.177366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa8ecc-ed4e-4a6c-8d14-9ab3351a824d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8155f8c6fee64b3f943c2ab25a3263b3)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:43.179285 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa8ecc-ed4e-4a6c-8d14-9ab3351a824d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:43.290973 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-43fa8ecc-ed4e-4a6c-8d14-9ab3351a824d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8155f8c6fee64b3f943c2ab25a3263b3', 'request_id': 'req-43fa8ecc-ed4e-4a6c-8d14-9ab3351a824d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:43.376125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-43fa8ecc-ed4e-4a6c-8d14-9ab3351a824d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8155f8c6fee64b3f943c2ab25a3263b3', 'request_id': 'req-43fa8ecc-ed4e-4a6c-8d14-9ab3351a824d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:43.382138 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-43fa8ecc-ed4e-4a6c-8d14-9ab3351a824d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8155f8c6fee64b3f943c2ab25a3263b3', 'request_id': 'req-43fa8ecc-ed4e-4a6c-8d14-9ab3351a824d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:43.394226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-43fa8ecc-ed4e-4a6c-8d14-9ab3351a824d admin admin] The token cache is being invalidate because project 8155f8c6fee64b3f943c2ab25a3263b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:27:43.394549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-43fa8ecc-ed4e-4a6c-8d14-9ab3351a824d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:43.395182 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-43fa8ecc-ed4e-4a6c-8d14-9ab3351a824d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:43.396724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1310/2594] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:27:43 2022] DELETE /identity/v3/projects/8155f8c6fee64b3f943c2ab25a3263b3 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:43.401778 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09af55-6e3d-41f4-8af6-f8ade18af2ed None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:43.402072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09af55-6e3d-41f4-8af6-f8ade18af2ed None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:43.402349 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09af55-6e3d-41f4-8af6-f8ade18af2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:43.422413 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-9a09af55-6e3d-41f4-8af6-f8ade18af2ed None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:43.423763 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-9a09af55-6e3d-41f4-8af6-f8ade18af2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:43.483518 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1285/2595] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:43.492184 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24217acb-d353-4d98-9cb9-c6b35751289b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:43.492547 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24217acb-d353-4d98-9cb9-c6b35751289b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:43.493081 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24217acb-d353-4d98-9cb9-c6b35751289b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:43.512240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-24217acb-d353-4d98-9cb9-c6b35751289b None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:43.514983 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-24217acb-d353-4d98-9cb9-c6b35751289b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:43.521286 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1311/2596] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:43.526118 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09af55-6e3d-41f4-8af6-f8ade18af2ed None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:43.535734 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09af55-6e3d-41f4-8af6-f8ade18af2ed None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:43.540397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e7887-4c7b-4168-859d-a88e8171e768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:43.541120 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e7887-4c7b-4168-859d-a88e8171e768 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:43.541364 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e7887-4c7b-4168-859d-a88e8171e768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:43.541638 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e7887-4c7b-4168-859d-a88e8171e768 admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:43.549758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e7887-4c7b-4168-859d-a88e8171e768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:27:43.549758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e7887-4c7b-4168-859d-a88e8171e768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:43.549758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e7887-4c7b-4168-859d-a88e8171e768 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:43.556560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1286/2597] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:27:43.560969 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24217acb-d353-4d98-9cb9-c6b35751289b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:43.570864 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24217acb-d353-4d98-9cb9-c6b35751289b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:43.576633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003a889-b9d7-4f51-89ad-713336a2c7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:43.576633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003a889-b9d7-4f51-89ad-713336a2c7eb admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:43.576633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003a889-b9d7-4f51-89ad-713336a2c7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:43.577216 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003a889-b9d7-4f51-89ad-713336a2c7eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:43.577608 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003a889-b9d7-4f51-89ad-713336a2c7eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:43.579617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003a889-b9d7-4f51-89ad-713336a2c7eb admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:43.667337 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1312/2598] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:27:43 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:43.668410 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e7887-4c7b-4168-859d-a88e8171e768 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:43.678560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e7887-4c7b-4168-859d-a88e8171e768 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:43.737959 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea458f-95d2-4388-98dc-2cf89fb61312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:43.738660 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea458f-95d2-4388-98dc-2cf89fb61312 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:43.738942 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea458f-95d2-4388-98dc-2cf89fb61312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:43.739211 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea458f-95d2-4388-98dc-2cf89fb61312 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:43.739895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea458f-95d2-4388-98dc-2cf89fb61312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:43.742122 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea458f-95d2-4388-98dc-2cf89fb61312 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:43.839341 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1287/2599] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:27:43 2022] POST /identity/v3/users => generated 282 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:27:43.843753 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003a889-b9d7-4f51-89ad-713336a2c7eb admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:43.854268 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003a889-b9d7-4f51-89ad-713336a2c7eb admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:43.859401 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be602b1f-d114-4d01-b8e6-f5cc1bbc3d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:43.863667 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be602b1f-d114-4d01-b8e6-f5cc1bbc3d9d admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:43.863667 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be602b1f-d114-4d01-b8e6-f5cc1bbc3d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:43.863667 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be602b1f-d114-4d01-b8e6-f5cc1bbc3d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:43.863667 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be602b1f-d114-4d01-b8e6-f5cc1bbc3d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:43.863667 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be602b1f-d114-4d01-b8e6-f5cc1bbc3d9d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:43.874200 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1313/2600] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:43.878549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea458f-95d2-4388-98dc-2cf89fb61312 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:43.890192 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea458f-95d2-4388-98dc-2cf89fb61312 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:43.895173 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82449b-6922-4aa5-86c5-19063989ac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:43.895859 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82449b-6922-4aa5-86c5-19063989ac27 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:43.896145 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82449b-6922-4aa5-86c5-19063989ac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:43.896419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82449b-6922-4aa5-86c5-19063989ac27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:43.897172 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82449b-6922-4aa5-86c5-19063989ac27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:43.899468 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82449b-6922-4aa5-86c5-19063989ac27 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:43.909493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1288/2601] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:43.913627 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be602b1f-d114-4d01-b8e6-f5cc1bbc3d9d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:43.923603 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be602b1f-d114-4d01-b8e6-f5cc1bbc3d9d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:43.929358 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e7e9d-1a50-4f48-b270-40898cc7b3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:43.930788 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7e9d-1a50-4f48-b270-40898cc7b3c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:43.931100 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7e9d-1a50-4f48-b270-40898cc7b3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:43.931348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7e9d-1a50-4f48-b270-40898cc7b3c1 admin admin] PATH_INFO: `/v3/projects/8d9e21bd4f964aa2bb43f16c9a78179f/users/ba5c20c3d09d471c99b440b4fc853c9f/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:43.948650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e7e9d-1a50-4f48-b270-40898cc7b3c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9e21bd4f964aa2bb43f16c9a78179f, user_id=ba5c20c3d09d471c99b440b4fc853c9f, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:43.951450 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e7e9d-1a50-4f48-b270-40898cc7b3c1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:44.003779 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1314/2602] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:43 2022] PUT /identity/v3/projects/8d9e21bd4f964aa2bb43f16c9a78179f/users/ba5c20c3d09d471c99b440b4fc853c9f/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:44.016562 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c81206-84db-4eaf-846e-bfae43521f7d None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:44.016858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c81206-84db-4eaf-846e-bfae43521f7d None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:44.017173 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c81206-84db-4eaf-846e-bfae43521f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:44.043984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-18c81206-84db-4eaf-846e-bfae43521f7d None None] MFA Rules not processed for user `ba5c20c3d09d471c99b440b4fc853c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:44.045112 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-18c81206-84db-4eaf-846e-bfae43521f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:44.113183 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1289/2603] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:44 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:44.125276 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e7e9d-1a50-4f48-b270-40898cc7b3c1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:44.237835 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e7e9d-1a50-4f48-b270-40898cc7b3c1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:44.242582 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c235409-35b3-494f-b16b-3d1c83f5d241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:44.243280 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c235409-35b3-494f-b16b-3d1c83f5d241 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:44.243560 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c235409-35b3-494f-b16b-3d1c83f5d241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:44.243833 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c235409-35b3-494f-b16b-3d1c83f5d241 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:44.244538 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c235409-35b3-494f-b16b-3d1c83f5d241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:44.246407 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c235409-35b3-494f-b16b-3d1c83f5d241 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:44.326388 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1315/2604] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:27:44 2022] POST /identity/v3/projects => generated 365 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:27:44.330667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c81206-84db-4eaf-846e-bfae43521f7d None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:44.341634 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c81206-84db-4eaf-846e-bfae43521f7d None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:44.397545 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393d419-e398-4887-ab89-dfba99243795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:44.398267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393d419-e398-4887-ab89-dfba99243795 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:44.399072 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393d419-e398-4887-ab89-dfba99243795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:44.399343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393d419-e398-4887-ab89-dfba99243795 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:44.400035 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393d419-e398-4887-ab89-dfba99243795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:44.401935 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393d419-e398-4887-ab89-dfba99243795 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:44.514524 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1290/2605] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:27:44 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:44.518617 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c235409-35b3-494f-b16b-3d1c83f5d241 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:44.529912 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c235409-35b3-494f-b16b-3d1c83f5d241 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:44.534639 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbda84b-dc41-467a-bc3b-7aff18b28c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:44.535449 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbda84b-dc41-467a-bc3b-7aff18b28c7d admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:44.535746 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbda84b-dc41-467a-bc3b-7aff18b28c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:44.536020 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbda84b-dc41-467a-bc3b-7aff18b28c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:44.536856 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbda84b-dc41-467a-bc3b-7aff18b28c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:44.538416 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbda84b-dc41-467a-bc3b-7aff18b28c7d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:44.549455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1316/2606] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:27:44.553673 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393d419-e398-4887-ab89-dfba99243795 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:44.564215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393d419-e398-4887-ab89-dfba99243795 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:44.568884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd8048-bc76-474d-9f1c-548c377ca1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:44.569761 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd8048-bc76-474d-9f1c-548c377ca1c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:44.570681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd8048-bc76-474d-9f1c-548c377ca1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:44.570973 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd8048-bc76-474d-9f1c-548c377ca1c3 admin admin] PATH_INFO: `/v3/projects/d914a42008024a699b22e4374b144526/users/0ecf454845a143e3917f504cf5c34e12/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:44.585781 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd8048-bc76-474d-9f1c-548c377ca1c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d914a42008024a699b22e4374b144526, user_id=0ecf454845a143e3917f504cf5c34e12, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:44.588621 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd8048-bc76-474d-9f1c-548c377ca1c3 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:44.685800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1291/2607] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:44 2022] PUT /identity/v3/projects/d914a42008024a699b22e4374b144526/users/0ecf454845a143e3917f504cf5c34e12/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:44.689879 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbda84b-dc41-467a-bc3b-7aff18b28c7d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:44.700413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbda84b-dc41-467a-bc3b-7aff18b28c7d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:44.754851 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74c538-4da1-4b6d-8435-d9863c0b36d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:44.755518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74c538-4da1-4b6d-8435-d9863c0b36d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:44.755801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74c538-4da1-4b6d-8435-d9863c0b36d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:44.756074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74c538-4da1-4b6d-8435-d9863c0b36d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:44.756793 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74c538-4da1-4b6d-8435-d9863c0b36d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:44.759455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74c538-4da1-4b6d-8435-d9863c0b36d8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:44.771631 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1317/2608] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:44.775928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd8048-bc76-474d-9f1c-548c377ca1c3 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:44.785998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd8048-bc76-474d-9f1c-548c377ca1c3 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:44.790901 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813b626-912e-44ca-b05e-cb3e90c1bd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:44.791860 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813b626-912e-44ca-b05e-cb3e90c1bd81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:44.792147 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813b626-912e-44ca-b05e-cb3e90c1bd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:44.792422 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813b626-912e-44ca-b05e-cb3e90c1bd81 admin admin] PATH_INFO: `/v3/projects/d914a42008024a699b22e4374b144526/users/0ecf454845a143e3917f504cf5c34e12/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:44.794384 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813b626-912e-44ca-b05e-cb3e90c1bd81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d914a42008024a699b22e4374b144526, user_id=0ecf454845a143e3917f504cf5c34e12, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:44.797059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813b626-912e-44ca-b05e-cb3e90c1bd81 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:44.807660 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1292/2609] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:44 2022] PUT /identity/v3/projects/d914a42008024a699b22e4374b144526/users/0ecf454845a143e3917f504cf5c34e12/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:44.817880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7281827-1445-4abf-905f-222971be8941 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:44.818114 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7281827-1445-4abf-905f-222971be8941 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:44.818392 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7281827-1445-4abf-905f-222971be8941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:44.845098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b7281827-1445-4abf-905f-222971be8941 None None] MFA Rules not processed for user `0ecf454845a143e3917f504cf5c34e12`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:44.846234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b7281827-1445-4abf-905f-222971be8941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:44.915089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1318/2610] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:44 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:44.926691 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813b626-912e-44ca-b05e-cb3e90c1bd81 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:44.928371 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-b813b626-912e-44ca-b05e-cb3e90c1bd81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:44.985259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813b626-912e-44ca-b05e-cb3e90c1bd81 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:44.989009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638042b-85ac-4445-a0bb-b63df9e903e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:44.989662 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638042b-85ac-4445-a0bb-b63df9e903e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:44.989945 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638042b-85ac-4445-a0bb-b63df9e903e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:44.990222 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638042b-85ac-4445-a0bb-b63df9e903e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:45.000235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638042b-85ac-4445-a0bb-b63df9e903e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:45.001675 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638042b-85ac-4445-a0bb-b63df9e903e4 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:45.011825 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1293/2611] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:27:45.249620 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7281827-1445-4abf-905f-222971be8941 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:45.249620 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b7281827-1445-4abf-905f-222971be8941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:45.266772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7281827-1445-4abf-905f-222971be8941 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:45.271528 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c06fbc-447e-4f38-ba55-c076fc9dcfe8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:45.272245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c06fbc-447e-4f38-ba55-c076fc9dcfe8 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:45.272605 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c06fbc-447e-4f38-ba55-c076fc9dcfe8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:45.273008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c06fbc-447e-4f38-ba55-c076fc9dcfe8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:45.369942 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c06fbc-447e-4f38-ba55-c076fc9dcfe8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:45.371267 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c06fbc-447e-4f38-ba55-c076fc9dcfe8 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:45.380119 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1319/2612] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:45 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:27:48.861480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638042b-85ac-4445-a0bb-b63df9e903e4 service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:48.927850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638042b-85ac-4445-a0bb-b63df9e903e4 service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:48.933696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368b7d7-a47d-4b2d-ab53-2f833309e97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:48.934615 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368b7d7-a47d-4b2d-ab53-2f833309e97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:48.934928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368b7d7-a47d-4b2d-ab53-2f833309e97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:48.935219 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368b7d7-a47d-4b2d-ab53-2f833309e97b admin admin] PATH_INFO: `/v3/users/ba5c20c3d09d471c99b440b4fc853c9f` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:48.936531 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368b7d7-a47d-4b2d-ab53-2f833309e97b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5c20c3d09d471c99b440b4fc853c9f)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:48.938501 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368b7d7-a47d-4b2d-ab53-2f833309e97b admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:49.138304 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-8368b7d7-a47d-4b2d-ab53-2f833309e97b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5c20c3d09d471c99b440b4fc853c9f'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:49.138931 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-8368b7d7-a47d-4b2d-ab53-2f833309e97b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5c20c3d09d471c99b440b4fc853c9f'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:49.150254 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-8368b7d7-a47d-4b2d-ab53-2f833309e97b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5c20c3d09d471c99b440b4fc853c9f'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:49.157228 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-8368b7d7-a47d-4b2d-ab53-2f833309e97b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5c20c3d09d471c99b440b4fc853c9f'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:49.157363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-8368b7d7-a47d-4b2d-ab53-2f833309e97b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5c20c3d09d471c99b440b4fc853c9f'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:49.237870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1294/2613] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:27:48 2022] DELETE /identity/v3/users/ba5c20c3d09d471c99b440b4fc853c9f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:49.242282 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd157f-b300-4da8-802e-6204c94c28e5 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:49.243323 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd157f-b300-4da8-802e-6204c94c28e5 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:49.243467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd157f-b300-4da8-802e-6204c94c28e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:49.261567 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7bbd157f-b300-4da8-802e-6204c94c28e5 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:49.262804 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7bbd157f-b300-4da8-802e-6204c94c28e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:49.323128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1320/2614] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:49.332637 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368b7d7-a47d-4b2d-ab53-2f833309e97b admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:49.334089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-8368b7d7-a47d-4b2d-ab53-2f833309e97b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:49.391520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368b7d7-a47d-4b2d-ab53-2f833309e97b admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:49.394968 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e46688-d68d-4bf2-91d8-675fddde7dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:49.395630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e46688-d68d-4bf2-91d8-675fddde7dab service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:49.395949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e46688-d68d-4bf2-91d8-675fddde7dab service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:49.396287 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e46688-d68d-4bf2-91d8-675fddde7dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:49.405317 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e46688-d68d-4bf2-91d8-675fddde7dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:49.406766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e46688-d68d-4bf2-91d8-675fddde7dab service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:49.416695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1295/2615] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:27:49.853170 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd157f-b300-4da8-802e-6204c94c28e5 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:49.855301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7bbd157f-b300-4da8-802e-6204c94c28e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:49.875269 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd157f-b300-4da8-802e-6204c94c28e5 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:49.880101 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedeaa6-6a2c-4eef-8ddb-601618aaf92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:49.881043 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedeaa6-6a2c-4eef-8ddb-601618aaf92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:49.881336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedeaa6-6a2c-4eef-8ddb-601618aaf92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:49.881650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedeaa6-6a2c-4eef-8ddb-601618aaf92b admin admin] PATH_INFO: `/v3/projects/8d9e21bd4f964aa2bb43f16c9a78179f` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:49.882875 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedeaa6-6a2c-4eef-8ddb-601618aaf92b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d9e21bd4f964aa2bb43f16c9a78179f)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:49.886571 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedeaa6-6a2c-4eef-8ddb-601618aaf92b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:49.938301 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e46688-d68d-4bf2-91d8-675fddde7dab service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:49.939826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-40e46688-d68d-4bf2-91d8-675fddde7dab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:49.955587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e46688-d68d-4bf2-91d8-675fddde7dab service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:49.970413 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473babfe-bb06-4e60-9c1f-748f16a1b131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:49.971467 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473babfe-bb06-4e60-9c1f-748f16a1b131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:49.971760 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473babfe-bb06-4e60-9c1f-748f16a1b131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:49.972041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473babfe-bb06-4e60-9c1f-748f16a1b131 admin admin] PATH_INFO: `/v3/users/9d666450ef5643749577ebe23a9a89ec` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:49.973432 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473babfe-bb06-4e60-9c1f-748f16a1b131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d666450ef5643749577ebe23a9a89ec)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:49.975807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473babfe-bb06-4e60-9c1f-748f16a1b131 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:50.034223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6eedeaa6-6a2c-4eef-8ddb-601618aaf92b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d9e21bd4f964aa2bb43f16c9a78179f', 'request_id': 'req-6eedeaa6-6a2c-4eef-8ddb-601618aaf92b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:50.124154 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6eedeaa6-6a2c-4eef-8ddb-601618aaf92b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d9e21bd4f964aa2bb43f16c9a78179f', 'request_id': 'req-6eedeaa6-6a2c-4eef-8ddb-601618aaf92b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:50.129980 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6eedeaa6-6a2c-4eef-8ddb-601618aaf92b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d9e21bd4f964aa2bb43f16c9a78179f', 'request_id': 'req-6eedeaa6-6a2c-4eef-8ddb-601618aaf92b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:50.141576 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6eedeaa6-6a2c-4eef-8ddb-601618aaf92b admin admin] The token cache is being invalidate because project 8d9e21bd4f964aa2bb43f16c9a78179f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:27:50.141859 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6eedeaa6-6a2c-4eef-8ddb-601618aaf92b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:50.142510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6eedeaa6-6a2c-4eef-8ddb-601618aaf92b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:50.144037 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1321/2616] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:27:49 2022] DELETE /identity/v3/projects/8d9e21bd4f964aa2bb43f16c9a78179f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:50.147809 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedeaa6-6a2c-4eef-8ddb-601618aaf92b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:50.149959 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6eedeaa6-6a2c-4eef-8ddb-601618aaf92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:50.163937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-473babfe-bb06-4e60-9c1f-748f16a1b131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d666450ef5643749577ebe23a9a89ec'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:50.164631 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-473babfe-bb06-4e60-9c1f-748f16a1b131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d666450ef5643749577ebe23a9a89ec'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:50.177591 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-473babfe-bb06-4e60-9c1f-748f16a1b131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d666450ef5643749577ebe23a9a89ec'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:50.178277 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-473babfe-bb06-4e60-9c1f-748f16a1b131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d666450ef5643749577ebe23a9a89ec'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:50.186867 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-473babfe-bb06-4e60-9c1f-748f16a1b131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d666450ef5643749577ebe23a9a89ec'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:50.213355 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedeaa6-6a2c-4eef-8ddb-601618aaf92b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:50.218098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24390739-9f1c-4d1b-9093-cd4f700e953c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:50.219021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24390739-9f1c-4d1b-9093-cd4f700e953c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:50.219286 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24390739-9f1c-4d1b-9093-cd4f700e953c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:50.219558 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24390739-9f1c-4d1b-9093-cd4f700e953c admin admin] PATH_INFO: `/v3/users/0ecf454845a143e3917f504cf5c34e12` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:50.220826 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24390739-9f1c-4d1b-9093-cd4f700e953c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ecf454845a143e3917f504cf5c34e12)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:50.222787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24390739-9f1c-4d1b-9093-cd4f700e953c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:50.261597 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1296/2617] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:27:49 2022] DELETE /identity/v3/users/9d666450ef5643749577ebe23a9a89ec => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:27:50.265866 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66f8c2-27f0-4057-b50c-bbf1125234c1 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:50.266156 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66f8c2-27f0-4057-b50c-bbf1125234c1 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:50.266463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66f8c2-27f0-4057-b50c-bbf1125234c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:50.283769 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-5a66f8c2-27f0-4057-b50c-bbf1125234c1 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:50.284992 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-5a66f8c2-27f0-4057-b50c-bbf1125234c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:50.342621 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1297/2618] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:27:50.353784 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66f8c2-27f0-4057-b50c-bbf1125234c1 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:50.355227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-5a66f8c2-27f0-4057-b50c-bbf1125234c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:50.411470 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66f8c2-27f0-4057-b50c-bbf1125234c1 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:50.416450 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76e3f2-2ec0-43d0-93a5-41661538d791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:50.419698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76e3f2-2ec0-43d0-93a5-41661538d791 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:50.419698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76e3f2-2ec0-43d0-93a5-41661538d791 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:50.419698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76e3f2-2ec0-43d0-93a5-41661538d791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:50.425940 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-24390739-9f1c-4d1b-9093-cd4f700e953c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ecf454845a143e3917f504cf5c34e12'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:50.427319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-24390739-9f1c-4d1b-9093-cd4f700e953c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ecf454845a143e3917f504cf5c34e12'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:50.427445 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76e3f2-2ec0-43d0-93a5-41661538d791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:50.427961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-24390739-9f1c-4d1b-9093-cd4f700e953c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ecf454845a143e3917f504cf5c34e12'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:50.428855 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76e3f2-2ec0-43d0-93a5-41661538d791 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:50.440348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1298/2619] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:27:50.448078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-24390739-9f1c-4d1b-9093-cd4f700e953c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ecf454845a143e3917f504cf5c34e12'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:50.455605 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-24390739-9f1c-4d1b-9093-cd4f700e953c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ecf454845a143e3917f504cf5c34e12'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:50.542875 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1322/2620] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:27:50 2022] DELETE /identity/v3/users/0ecf454845a143e3917f504cf5c34e12 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:27:50.893467 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76e3f2-2ec0-43d0-93a5-41661538d791 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:50.894965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-eb76e3f2-2ec0-43d0-93a5-41661538d791 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:50.911651 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76e3f2-2ec0-43d0-93a5-41661538d791 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:50.971863 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21881fb8-3c01-430e-86da-fd75ae154007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:50.972659 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881fb8-3c01-430e-86da-fd75ae154007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:50.972936 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881fb8-3c01-430e-86da-fd75ae154007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:50.973204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881fb8-3c01-430e-86da-fd75ae154007 admin admin] PATH_INFO: `/v3/projects/c2631f2278154335aeb7bc12479e8509` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:50.974371 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21881fb8-3c01-430e-86da-fd75ae154007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2631f2278154335aeb7bc12479e8509)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:50.976281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21881fb8-3c01-430e-86da-fd75ae154007 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:51.012978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24390739-9f1c-4d1b-9093-cd4f700e953c admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:51.014398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-24390739-9f1c-4d1b-9093-cd4f700e953c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:51.028361 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24390739-9f1c-4d1b-9093-cd4f700e953c admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:51.033095 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ddabb-7721-4361-833d-67f7800ee1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:51.033965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ddabb-7721-4361-833d-67f7800ee1ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:51.034250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ddabb-7721-4361-833d-67f7800ee1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:51.034570 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ddabb-7721-4361-833d-67f7800ee1ea admin admin] PATH_INFO: `/v3/projects/d914a42008024a699b22e4374b144526` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:51.035861 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ddabb-7721-4361-833d-67f7800ee1ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d914a42008024a699b22e4374b144526)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:51.037868 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ddabb-7721-4361-833d-67f7800ee1ea admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:51.113794 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-21881fb8-3c01-430e-86da-fd75ae154007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2631f2278154335aeb7bc12479e8509', 'request_id': 'req-21881fb8-3c01-430e-86da-fd75ae154007'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:51.137515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ad1ddabb-7721-4361-833d-67f7800ee1ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd914a42008024a699b22e4374b144526', 'request_id': 'req-ad1ddabb-7721-4361-833d-67f7800ee1ea'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:51.199041 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-21881fb8-3c01-430e-86da-fd75ae154007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2631f2278154335aeb7bc12479e8509', 'request_id': 'req-21881fb8-3c01-430e-86da-fd75ae154007'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:51.205288 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-21881fb8-3c01-430e-86da-fd75ae154007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2631f2278154335aeb7bc12479e8509', 'request_id': 'req-21881fb8-3c01-430e-86da-fd75ae154007'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:51.217649 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-21881fb8-3c01-430e-86da-fd75ae154007 admin admin] The token cache is being invalidate because project c2631f2278154335aeb7bc12479e8509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:27:51.218035 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-21881fb8-3c01-430e-86da-fd75ae154007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:51.219066 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-21881fb8-3c01-430e-86da-fd75ae154007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:51.230136 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1299/2621] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:27:50 2022] DELETE /identity/v3/projects/c2631f2278154335aeb7bc12479e8509 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:51.230136 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d9c71-7601-4936-9955-0cdc44b875d5 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:51.230136 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d9c71-7601-4936-9955-0cdc44b875d5 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:51.230136 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d9c71-7601-4936-9955-0cdc44b875d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:51.245412 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ad1ddabb-7721-4361-833d-67f7800ee1ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd914a42008024a699b22e4374b144526', 'request_id': 'req-ad1ddabb-7721-4361-833d-67f7800ee1ea'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:51.247328 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-ee1d9c71-7601-4936-9955-0cdc44b875d5 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:51.248651 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-ee1d9c71-7601-4936-9955-0cdc44b875d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:51.252363 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ad1ddabb-7721-4361-833d-67f7800ee1ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd914a42008024a699b22e4374b144526', 'request_id': 'req-ad1ddabb-7721-4361-833d-67f7800ee1ea'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:51.264286 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ad1ddabb-7721-4361-833d-67f7800ee1ea admin admin] The token cache is being invalidate because project d914a42008024a699b22e4374b144526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:27:51.264571 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ad1ddabb-7721-4361-833d-67f7800ee1ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:51.265217 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ad1ddabb-7721-4361-833d-67f7800ee1ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:51.266856 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1323/2622] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:27:51 2022] DELETE /identity/v3/projects/d914a42008024a699b22e4374b144526 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:27:51.272561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f4e46-dbc8-4b46-8864-2dd062dae0ba None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:51.272854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f4e46-dbc8-4b46-8864-2dd062dae0ba None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:51.273133 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f4e46-dbc8-4b46-8864-2dd062dae0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:51.290949 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6f9f4e46-dbc8-4b46-8864-2dd062dae0ba None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:51.292139 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6f9f4e46-dbc8-4b46-8864-2dd062dae0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:51.313552 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1300/2623] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:27:51.321915 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf95a2a-23fc-406b-a8c9-5aa4df7b958d None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:51.322397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf95a2a-23fc-406b-a8c9-5aa4df7b958d None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:51.322774 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf95a2a-23fc-406b-a8c9-5aa4df7b958d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:51.340627 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-fcf95a2a-23fc-406b-a8c9-5aa4df7b958d None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:51.341838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-fcf95a2a-23fc-406b-a8c9-5aa4df7b958d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:51.349862 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1301/2624] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:27:51.350547 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1324/2625] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:27:51.354005 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf95a2a-23fc-406b-a8c9-5aa4df7b958d None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:51.358403 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f6914-df12-4c3a-b995-13313e416b94 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:51.358791 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f6914-df12-4c3a-b995-13313e416b94 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:51.359071 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f6914-df12-4c3a-b995-13313e416b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:51.363115 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf95a2a-23fc-406b-a8c9-5aa4df7b958d None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:51.367718 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df5a30-969d-4ad1-a083-8e1c9f4c7cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:51.368905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df5a30-969d-4ad1-a083-8e1c9f4c7cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:51.369246 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df5a30-969d-4ad1-a083-8e1c9f4c7cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:51.369547 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df5a30-969d-4ad1-a083-8e1c9f4c7cb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:51.370290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df5a30-969d-4ad1-a083-8e1c9f4c7cb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:27:51.370631 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df5a30-969d-4ad1-a083-8e1c9f4c7cb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:51.372215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df5a30-969d-4ad1-a083-8e1c9f4c7cb3 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:51.377442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2a0f6914-df12-4c3a-b995-13313e416b94 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:51.378657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2a0f6914-df12-4c3a-b995-13313e416b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:51.383553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1302/2626] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:27:51.388253 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1325/2627] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:27:51.394306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df5a30-969d-4ad1-a083-8e1c9f4c7cb3 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:51.395203 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f6914-df12-4c3a-b995-13313e416b94 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:51.398419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df5a30-969d-4ad1-a083-8e1c9f4c7cb3 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:51.403192 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77feeacf-7789-4c24-9f15-f43edca5ab64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:51.404003 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feeacf-7789-4c24-9f15-f43edca5ab64 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:51.404190 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f6914-df12-4c3a-b995-13313e416b94 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:51.404466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feeacf-7789-4c24-9f15-f43edca5ab64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:51.404890 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feeacf-7789-4c24-9f15-f43edca5ab64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:51.405582 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77feeacf-7789-4c24-9f15-f43edca5ab64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:51.407500 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77feeacf-7789-4c24-9f15-f43edca5ab64 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:51.408895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a2fe5-8238-4cdd-b9ef-783f3ed91b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:51.409736 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a2fe5-8238-4cdd-b9ef-783f3ed91b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:51.410025 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a2fe5-8238-4cdd-b9ef-783f3ed91b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:51.410329 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a2fe5-8238-4cdd-b9ef-783f3ed91b9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:51.411088 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a2fe5-8238-4cdd-b9ef-783f3ed91b9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:27:51.411427 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a2fe5-8238-4cdd-b9ef-783f3ed91b9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:51.412987 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a2fe5-8238-4cdd-b9ef-783f3ed91b9a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:51.424259 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1326/2628] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:27:51.428580 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a2fe5-8238-4cdd-b9ef-783f3ed91b9a admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:51.438467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a2fe5-8238-4cdd-b9ef-783f3ed91b9a admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:51.444768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fe1f6-ee92-4202-b4ac-3b92fca6a413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:51.444768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fe1f6-ee92-4202-b4ac-3b92fca6a413 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:51.444768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fe1f6-ee92-4202-b4ac-3b92fca6a413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:51.444768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fe1f6-ee92-4202-b4ac-3b92fca6a413 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:51.445161 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3fe1f6-ee92-4202-b4ac-3b92fca6a413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:51.447404 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3fe1f6-ee92-4202-b4ac-3b92fca6a413 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:51.497925 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1303/2629] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:27:51 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:27:51.501696 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77feeacf-7789-4c24-9f15-f43edca5ab64 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:51.519994 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1327/2630] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:27:51 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:27:51.528118 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fe1f6-ee92-4202-b4ac-3b92fca6a413 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:51.569654 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77feeacf-7789-4c24-9f15-f43edca5ab64 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:51.597284 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fe1f6-ee92-4202-b4ac-3b92fca6a413 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:51.603495 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42799f8f-292c-49d2-8bd7-65b76d1ec403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:51.604342 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42799f8f-292c-49d2-8bd7-65b76d1ec403 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:51.605090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42799f8f-292c-49d2-8bd7-65b76d1ec403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:51.605384 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42799f8f-292c-49d2-8bd7-65b76d1ec403 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:51.606601 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42799f8f-292c-49d2-8bd7-65b76d1ec403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:51.609717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42799f8f-292c-49d2-8bd7-65b76d1ec403 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:51.633203 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d4c56-f21f-494b-bbbd-506ba853f9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:51.639916 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d4c56-f21f-494b-bbbd-506ba853f9dc admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:51.639916 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d4c56-f21f-494b-bbbd-506ba853f9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:51.639916 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d4c56-f21f-494b-bbbd-506ba853f9dc admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:51.639916 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d4c56-f21f-494b-bbbd-506ba853f9dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:51.639916 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d4c56-f21f-494b-bbbd-506ba853f9dc admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:51.720227 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1328/2631] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:27:51 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:27:51.724080 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42799f8f-292c-49d2-8bd7-65b76d1ec403 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:51.732200 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1304/2632] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:27:51 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:27:51.734675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42799f8f-292c-49d2-8bd7-65b76d1ec403 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:51.739659 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a402d7-0321-4850-a1d1-64f8109c4af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:51.740323 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a402d7-0321-4850-a1d1-64f8109c4af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:51.740618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a402d7-0321-4850-a1d1-64f8109c4af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:51.740898 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a402d7-0321-4850-a1d1-64f8109c4af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:51.741635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a402d7-0321-4850-a1d1-64f8109c4af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:51.742121 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d4c56-f21f-494b-bbbd-506ba853f9dc admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:51.744017 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a402d7-0321-4850-a1d1-64f8109c4af6 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:51.753961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d4c56-f21f-494b-bbbd-506ba853f9dc admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:51.755247 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1329/2633] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:27:51.759289 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a402d7-0321-4850-a1d1-64f8109c4af6 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:51.760088 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22773ace-5e9e-4f00-adce-6b01c69c3032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:51.762565 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22773ace-5e9e-4f00-adce-6b01c69c3032 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:51.762894 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22773ace-5e9e-4f00-adce-6b01c69c3032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:51.763239 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22773ace-5e9e-4f00-adce-6b01c69c3032 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:51.763993 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22773ace-5e9e-4f00-adce-6b01c69c3032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:51.767388 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22773ace-5e9e-4f00-adce-6b01c69c3032 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:51.772066 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a402d7-0321-4850-a1d1-64f8109c4af6 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:51.777768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b13ee9-4d7f-4449-8d80-d88a2eb3631a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:51.778565 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b13ee9-4d7f-4449-8d80-d88a2eb3631a admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:51.779045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b13ee9-4d7f-4449-8d80-d88a2eb3631a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:51.779333 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1305/2634] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:51.779452 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b13ee9-4d7f-4449-8d80-d88a2eb3631a admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:51.780256 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b13ee9-4d7f-4449-8d80-d88a2eb3631a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:51.781972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b13ee9-4d7f-4449-8d80-d88a2eb3631a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:51.783083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22773ace-5e9e-4f00-adce-6b01c69c3032 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:51.794702 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22773ace-5e9e-4f00-adce-6b01c69c3032 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:51.797795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1330/2635] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:51.798816 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b13ee9-4d7f-4449-8d80-d88a2eb3631a admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:51.799806 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ab64a-352b-4b1e-9930-6c3c32fd1393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:51.800463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ab64a-352b-4b1e-9930-6c3c32fd1393 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:51.800812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ab64a-352b-4b1e-9930-6c3c32fd1393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:51.801140 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ab64a-352b-4b1e-9930-6c3c32fd1393 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:51.801798 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ab64a-352b-4b1e-9930-6c3c32fd1393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:51.803439 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ab64a-352b-4b1e-9930-6c3c32fd1393 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:51.809973 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b13ee9-4d7f-4449-8d80-d88a2eb3631a admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:51.817656 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1306/2636] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:27:51.819152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e5f38-2e91-4bd9-98c7-568ca411c231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:51.820095 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e5f38-2e91-4bd9-98c7-568ca411c231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:51.820382 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e5f38-2e91-4bd9-98c7-568ca411c231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:51.820757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e5f38-2e91-4bd9-98c7-568ca411c231 admin admin] PATH_INFO: `/v3/projects/3cef9b4fe1684e86a371412bb2ad5514/users/a344ed80f81143cca7368f3f323d9f1a/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:51.822260 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ab64a-352b-4b1e-9930-6c3c32fd1393 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:51.832539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ab64a-352b-4b1e-9930-6c3c32fd1393 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:51.836699 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e5f38-2e91-4bd9-98c7-568ca411c231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cef9b4fe1684e86a371412bb2ad5514, user_id=a344ed80f81143cca7368f3f323d9f1a, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:51.837510 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60160b2b-e12f-4957-ace0-5e7e409bbf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:51.838425 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60160b2b-e12f-4957-ace0-5e7e409bbf78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:51.838738 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60160b2b-e12f-4957-ace0-5e7e409bbf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:51.839012 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60160b2b-e12f-4957-ace0-5e7e409bbf78 admin admin] PATH_INFO: `/v3/projects/e809972ea5de42cdb9307d669cd0132a/users/c21b084c552e42938c8b6796a544f3c3/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:51.839826 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e5f38-2e91-4bd9-98c7-568ca411c231 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:51.858832 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60160b2b-e12f-4957-ace0-5e7e409bbf78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e809972ea5de42cdb9307d669cd0132a, user_id=c21b084c552e42938c8b6796a544f3c3, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:51.858832 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60160b2b-e12f-4957-ace0-5e7e409bbf78 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:51.958402 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1331/2637] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:51 2022] PUT /identity/v3/projects/3cef9b4fe1684e86a371412bb2ad5514/users/a344ed80f81143cca7368f3f323d9f1a/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:51.970312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132704b-e307-44a7-b573-725c89522ede None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:51.970648 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132704b-e307-44a7-b573-725c89522ede None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:51.970938 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132704b-e307-44a7-b573-725c89522ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:51.983941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1307/2638] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:51 2022] PUT /identity/v3/projects/e809972ea5de42cdb9307d669cd0132a/users/c21b084c552e42938c8b6796a544f3c3/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:51.996670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731df6c-8a71-4d6c-829a-b3441a897516 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:51.997068 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731df6c-8a71-4d6c-829a-b3441a897516 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:51.997310 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731df6c-8a71-4d6c-829a-b3441a897516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:52.001054 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-0132704b-e307-44a7-b573-725c89522ede None None] MFA Rules not processed for user `a344ed80f81143cca7368f3f323d9f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:52.002395 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0132704b-e307-44a7-b573-725c89522ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:52.027151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-c731df6c-8a71-4d6c-829a-b3441a897516 None None] MFA Rules not processed for user `c21b084c552e42938c8b6796a544f3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:52.028281 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-c731df6c-8a71-4d6c-829a-b3441a897516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:52.072618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1332/2639] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:52.078093 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132704b-e307-44a7-b573-725c89522ede None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:52.111839 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1308/2640] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:27:52.115142 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731df6c-8a71-4d6c-829a-b3441a897516 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:52.152802 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132704b-e307-44a7-b573-725c89522ede None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:52.157931 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61edd4-9ddc-4ed6-bb34-938812bba290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:52.158727 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61edd4-9ddc-4ed6-bb34-938812bba290 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:52.159078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61edd4-9ddc-4ed6-bb34-938812bba290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:52.159583 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61edd4-9ddc-4ed6-bb34-938812bba290 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:52.160187 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61edd4-9ddc-4ed6-bb34-938812bba290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:52.162159 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61edd4-9ddc-4ed6-bb34-938812bba290 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:52.182767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731df6c-8a71-4d6c-829a-b3441a897516 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:52.187592 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553df118-5e15-4960-8fbe-271759bc1448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:52.188228 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553df118-5e15-4960-8fbe-271759bc1448 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:52.188511 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553df118-5e15-4960-8fbe-271759bc1448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:52.188800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553df118-5e15-4960-8fbe-271759bc1448 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:52.189491 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553df118-5e15-4960-8fbe-271759bc1448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:52.191429 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553df118-5e15-4960-8fbe-271759bc1448 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:52.259436 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1333/2641] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:27:52 2022] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:52.262891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61edd4-9ddc-4ed6-bb34-938812bba290 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:52.285028 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1309/2642] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:27:52 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:27:52.287791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553df118-5e15-4960-8fbe-271759bc1448 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:52.334279 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61edd4-9ddc-4ed6-bb34-938812bba290 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:52.368106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553df118-5e15-4960-8fbe-271759bc1448 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:52.373549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2e041-8036-4e84-9b47-d2fc88502958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:52.374316 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2e041-8036-4e84-9b47-d2fc88502958 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:52.374765 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2e041-8036-4e84-9b47-d2fc88502958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:52.375111 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2e041-8036-4e84-9b47-d2fc88502958 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:52.375913 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2e041-8036-4e84-9b47-d2fc88502958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:52.377965 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2e041-8036-4e84-9b47-d2fc88502958 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:52.403514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82bc65-ccce-4849-9aa8-832d397d58fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:52.404263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82bc65-ccce-4849-9aa8-832d397d58fc admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:52.404462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82bc65-ccce-4849-9aa8-832d397d58fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:52.404741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82bc65-ccce-4849-9aa8-832d397d58fc admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:52.405436 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82bc65-ccce-4849-9aa8-832d397d58fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:52.407508 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82bc65-ccce-4849-9aa8-832d397d58fc admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:52.453619 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1310/2643] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:27:52 2022] POST /identity/v3/users => generated 296 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:27:52.454767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2e041-8036-4e84-9b47-d2fc88502958 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:52.464901 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2e041-8036-4e84-9b47-d2fc88502958 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:52.469624 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4687943-220a-4e37-afc5-af5e3ef3439b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:52.472482 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4687943-220a-4e37-afc5-af5e3ef3439b admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:52.472482 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4687943-220a-4e37-afc5-af5e3ef3439b admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:52.472482 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4687943-220a-4e37-afc5-af5e3ef3439b admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:52.472482 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4687943-220a-4e37-afc5-af5e3ef3439b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:52.473381 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4687943-220a-4e37-afc5-af5e3ef3439b admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:52.484235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1311/2644] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:52.488132 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4687943-220a-4e37-afc5-af5e3ef3439b admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:52.498536 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4687943-220a-4e37-afc5-af5e3ef3439b admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:52.503480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b162a6-8913-4540-8bfb-0b5c41b42c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:52.504363 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b162a6-8913-4540-8bfb-0b5c41b42c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:52.504648 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b162a6-8913-4540-8bfb-0b5c41b42c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:52.504927 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b162a6-8913-4540-8bfb-0b5c41b42c03 admin admin] PATH_INFO: `/v3/projects/8a6edccd4cb342328c6cdbfac5f0b11d/users/ad1fdccc26bf44deaa84532cb8073524/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:52.515495 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1334/2645] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:27:52 2022] POST /identity/v3/users => generated 297 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:27:52.519530 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82bc65-ccce-4849-9aa8-832d397d58fc admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:52.523807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b162a6-8913-4540-8bfb-0b5c41b42c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6edccd4cb342328c6cdbfac5f0b11d, user_id=ad1fdccc26bf44deaa84532cb8073524, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:52.526650 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b162a6-8913-4540-8bfb-0b5c41b42c03 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:52.529350 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82bc65-ccce-4849-9aa8-832d397d58fc admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:52.534242 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bfc83-e85a-4fcd-84d4-6b990ce61ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:52.535362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bfc83-e85a-4fcd-84d4-6b990ce61ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:52.535614 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bfc83-e85a-4fcd-84d4-6b990ce61ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:52.535891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bfc83-e85a-4fcd-84d4-6b990ce61ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:52.536619 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bfc83-e85a-4fcd-84d4-6b990ce61ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:52.538207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bfc83-e85a-4fcd-84d4-6b990ce61ee2 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:52.548941 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1335/2646] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:52.552932 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bfc83-e85a-4fcd-84d4-6b990ce61ee2 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:52.563019 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bfc83-e85a-4fcd-84d4-6b990ce61ee2 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:52.567816 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73639483-ec9a-4347-899c-a27b462ef21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:52.568661 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73639483-ec9a-4347-899c-a27b462ef21b admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:52.568990 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73639483-ec9a-4347-899c-a27b462ef21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:52.569271 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73639483-ec9a-4347-899c-a27b462ef21b admin admin] PATH_INFO: `/v3/projects/d7e6a664ba504476a12073bb40a5a033/users/13afe6ab1c3448bbb3f28daa26854bf5/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:52.582249 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1312/2647] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:52 2022] PUT /identity/v3/projects/8a6edccd4cb342328c6cdbfac5f0b11d/users/ad1fdccc26bf44deaa84532cb8073524/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:27:52.586064 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b162a6-8913-4540-8bfb-0b5c41b42c03 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:52.586348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73639483-ec9a-4347-899c-a27b462ef21b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e6a664ba504476a12073bb40a5a033, user_id=13afe6ab1c3448bbb3f28daa26854bf5, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:52.589479 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73639483-ec9a-4347-899c-a27b462ef21b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:52.645097 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1336/2648] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:52 2022] PUT /identity/v3/projects/d7e6a664ba504476a12073bb40a5a033/users/13afe6ab1c3448bbb3f28daa26854bf5/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:52.649035 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73639483-ec9a-4347-899c-a27b462ef21b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:52.651163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b162a6-8913-4540-8bfb-0b5c41b42c03 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:52.705606 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637cd44-ed79-45e2-9301-929e7c742457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:52.706377 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637cd44-ed79-45e2-9301-929e7c742457 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:52.706759 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637cd44-ed79-45e2-9301-929e7c742457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:52.707112 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637cd44-ed79-45e2-9301-929e7c742457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:52.707849 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637cd44-ed79-45e2-9301-929e7c742457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:52.709426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637cd44-ed79-45e2-9301-929e7c742457 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:52.709754 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73639483-ec9a-4347-899c-a27b462ef21b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:52.714682 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de10195-d3bd-4c9d-a32c-3a363c4dd8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:52.715346 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de10195-d3bd-4c9d-a32c-3a363c4dd8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:52.715749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de10195-d3bd-4c9d-a32c-3a363c4dd8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:52.716045 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de10195-d3bd-4c9d-a32c-3a363c4dd8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:52.716755 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de10195-d3bd-4c9d-a32c-3a363c4dd8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:52.718313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de10195-d3bd-4c9d-a32c-3a363c4dd8c4 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:52.719068 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1313/2649] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:27:52.723025 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637cd44-ed79-45e2-9301-929e7c742457 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:52.732207 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1337/2650] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:27:52.733233 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de10195-d3bd-4c9d-a32c-3a363c4dd8c4 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:52.733350 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637cd44-ed79-45e2-9301-929e7c742457 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:52.738009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ba25b-96f2-4406-bc7c-617a95cf89ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:52.738949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ba25b-96f2-4406-bc7c-617a95cf89ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:52.739237 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ba25b-96f2-4406-bc7c-617a95cf89ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:52.739520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ba25b-96f2-4406-bc7c-617a95cf89ce admin admin] PATH_INFO: `/v3/projects/8a6edccd4cb342328c6cdbfac5f0b11d/users/ad1fdccc26bf44deaa84532cb8073524/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:52.741497 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ba25b-96f2-4406-bc7c-617a95cf89ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6edccd4cb342328c6cdbfac5f0b11d, user_id=ad1fdccc26bf44deaa84532cb8073524, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:52.742568 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de10195-d3bd-4c9d-a32c-3a363c4dd8c4 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:52.744796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ba25b-96f2-4406-bc7c-617a95cf89ce admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:52.748125 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4a27b-b331-4b66-a1da-306c4c9e7832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:52.749034 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4a27b-b331-4b66-a1da-306c4c9e7832 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:52.749319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4a27b-b331-4b66-a1da-306c4c9e7832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:52.749595 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4a27b-b331-4b66-a1da-306c4c9e7832 admin admin] PATH_INFO: `/v3/projects/d7e6a664ba504476a12073bb40a5a033/users/13afe6ab1c3448bbb3f28daa26854bf5/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:52.751577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4a27b-b331-4b66-a1da-306c4c9e7832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e6a664ba504476a12073bb40a5a033, user_id=13afe6ab1c3448bbb3f28daa26854bf5, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:52.754155 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4a27b-b331-4b66-a1da-306c4c9e7832 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:52.754875 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1314/2651] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:52 2022] PUT /identity/v3/projects/8a6edccd4cb342328c6cdbfac5f0b11d/users/ad1fdccc26bf44deaa84532cb8073524/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:27:52.765330 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c44d1a-5f13-4d43-80d6-f65a2ef35ade None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:52.765625 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c44d1a-5f13-4d43-80d6-f65a2ef35ade None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:52.765912 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c44d1a-5f13-4d43-80d6-f65a2ef35ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:52.766230 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1338/2652] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:52 2022] PUT /identity/v3/projects/d7e6a664ba504476a12073bb40a5a033/users/13afe6ab1c3448bbb3f28daa26854bf5/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:52.777932 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea714d1-bf25-4a53-9188-c22285e1de86 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:52.778965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea714d1-bf25-4a53-9188-c22285e1de86 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:52.779469 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea714d1-bf25-4a53-9188-c22285e1de86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:52.795895 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-78c44d1a-5f13-4d43-80d6-f65a2ef35ade None None] MFA Rules not processed for user `ad1fdccc26bf44deaa84532cb8073524`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:52.797090 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-78c44d1a-5f13-4d43-80d6-f65a2ef35ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:52.810451 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-5ea714d1-bf25-4a53-9188-c22285e1de86 None None] MFA Rules not processed for user `13afe6ab1c3448bbb3f28daa26854bf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:52.811649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5ea714d1-bf25-4a53-9188-c22285e1de86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:52.871920 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1315/2653] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:27:52.879469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c44d1a-5f13-4d43-80d6-f65a2ef35ade None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:52.880894 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-78c44d1a-5f13-4d43-80d6-f65a2ef35ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:52.886122 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1339/2654] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:27:52.897799 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea714d1-bf25-4a53-9188-c22285e1de86 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:52.899153 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5ea714d1-bf25-4a53-9188-c22285e1de86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:52.940347 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c44d1a-5f13-4d43-80d6-f65a2ef35ade None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:52.944048 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aaae84-7ab2-4661-b7fc-94237ba5cc95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:52.944712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaae84-7ab2-4661-b7fc-94237ba5cc95 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:52.944973 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaae84-7ab2-4661-b7fc-94237ba5cc95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:52.945252 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaae84-7ab2-4661-b7fc-94237ba5cc95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:52.954496 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aaae84-7ab2-4661-b7fc-94237ba5cc95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:52.955934 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aaae84-7ab2-4661-b7fc-94237ba5cc95 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:52.956281 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea714d1-bf25-4a53-9188-c22285e1de86 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:52.960050 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fc6f6-5412-486a-ab37-91b24b747d46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:52.960715 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fc6f6-5412-486a-ab37-91b24b747d46 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:52.961003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fc6f6-5412-486a-ab37-91b24b747d46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:52.961280 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fc6f6-5412-486a-ab37-91b24b747d46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:52.966123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1316/2655] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:27:52.971241 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fc6f6-5412-486a-ab37-91b24b747d46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:52.972653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fc6f6-5412-486a-ab37-91b24b747d46 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:52.983485 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1340/2656] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:27:53.190110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aaae84-7ab2-4661-b7fc-94237ba5cc95 service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:53.199165 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aaae84-7ab2-4661-b7fc-94237ba5cc95 service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:53.203191 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696374d-36e7-4f6e-a4ef-f2a115e56017 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:53.203911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696374d-36e7-4f6e-a4ef-f2a115e56017 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:53.204260 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696374d-36e7-4f6e-a4ef-f2a115e56017 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:53.204600 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696374d-36e7-4f6e-a4ef-f2a115e56017 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:53.260829 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696374d-36e7-4f6e-a4ef-f2a115e56017 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:53.262248 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696374d-36e7-4f6e-a4ef-f2a115e56017 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:53.271311 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1317/2657] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:27:53.957877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fc6f6-5412-486a-ab37-91b24b747d46 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:53.967632 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fc6f6-5412-486a-ab37-91b24b747d46 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:53.972537 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47328b9c-e6b7-4322-b770-e3e9aacb8886 tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13afe6ab1c3448bbb3f28daa26854bf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7e6a664ba504476a12073bb40a5a033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:53.973198 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47328b9c-e6b7-4322-b770-e3e9aacb8886 tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:53.973488 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47328b9c-e6b7-4322-b770-e3e9aacb8886 tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:53.973770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47328b9c-e6b7-4322-b770-e3e9aacb8886 tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:53.974541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47328b9c-e6b7-4322-b770-e3e9aacb8886 tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:27:53.985274 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47328b9c-e6b7-4322-b770-e3e9aacb8886 tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:53.985274 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47328b9c-e6b7-4322-b770-e3e9aacb8886 tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:53.990477 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1341/2658] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:27:53.993050 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696374d-36e7-4f6e-a4ef-f2a115e56017 service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:54.003961 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696374d-36e7-4f6e-a4ef-f2a115e56017 service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:54.008400 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878ca24-992e-4d88-b024-0aad601efe8c tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13afe6ab1c3448bbb3f28daa26854bf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7e6a664ba504476a12073bb40a5a033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:54.011516 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878ca24-992e-4d88-b024-0aad601efe8c tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:54.011516 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878ca24-992e-4d88-b024-0aad601efe8c tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:54.011516 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878ca24-992e-4d88-b024-0aad601efe8c tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:54.011516 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878ca24-992e-4d88-b024-0aad601efe8c tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:54.012524 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878ca24-992e-4d88-b024-0aad601efe8c tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:54.109783 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1318/2659] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:27:53 2022] POST /identity/v3/projects => generated 355 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:54.113214 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47328b9c-e6b7-4322-b770-e3e9aacb8886 tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:54.124033 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47328b9c-e6b7-4322-b770-e3e9aacb8886 tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:54.177951 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c3417-4efc-4c4b-8911-6fd2fdd9a447 tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13afe6ab1c3448bbb3f28daa26854bf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7e6a664ba504476a12073bb40a5a033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:54.178641 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c3417-4efc-4c4b-8911-6fd2fdd9a447 tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:54.178930 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c3417-4efc-4c4b-8911-6fd2fdd9a447 tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:54.179209 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c3417-4efc-4c4b-8911-6fd2fdd9a447 tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:54.179928 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c3417-4efc-4c4b-8911-6fd2fdd9a447 tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:27:54.180240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c3417-4efc-4c4b-8911-6fd2fdd9a447 tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:54.182687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c3417-4efc-4c4b-8911-6fd2fdd9a447 tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:54.193820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1342/2660] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:27:54.230632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878ca24-992e-4d88-b024-0aad601efe8c tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:54.240851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878ca24-992e-4d88-b024-0aad601efe8c tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:54.246092 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99583339-b676-4bbf-b886-9d3490b8c02c tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13afe6ab1c3448bbb3f28daa26854bf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7e6a664ba504476a12073bb40a5a033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:54.246984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99583339-b676-4bbf-b886-9d3490b8c02c tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:54.247275 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99583339-b676-4bbf-b886-9d3490b8c02c tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:54.247552 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99583339-b676-4bbf-b886-9d3490b8c02c tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] PATH_INFO: `/v3/projects/768fb95ee6774b8ab8d248643951f17a` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:54.248733 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99583339-b676-4bbf-b886-9d3490b8c02c tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] RBAC: Authorizing `identity:delete_project(project_id=768fb95ee6774b8ab8d248643951f17a)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:54.250701 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99583339-b676-4bbf-b886-9d3490b8c02c tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:54.392802 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-99583339-b676-4bbf-b886-9d3490b8c02c tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '768fb95ee6774b8ab8d248643951f17a', 'request_id': 'req-99583339-b676-4bbf-b886-9d3490b8c02c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:54.461044 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-99583339-b676-4bbf-b886-9d3490b8c02c tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '768fb95ee6774b8ab8d248643951f17a', 'request_id': 'req-99583339-b676-4bbf-b886-9d3490b8c02c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:54.467254 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-99583339-b676-4bbf-b886-9d3490b8c02c tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '768fb95ee6774b8ab8d248643951f17a', 'request_id': 'req-99583339-b676-4bbf-b886-9d3490b8c02c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:54.478930 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-99583339-b676-4bbf-b886-9d3490b8c02c tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] The token cache is being invalidate because project 768fb95ee6774b8ab8d248643951f17a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:27:54.479216 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-99583339-b676-4bbf-b886-9d3490b8c02c tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:54.479853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-99583339-b676-4bbf-b886-9d3490b8c02c tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:54.481380 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1319/2661] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:27:54 2022] DELETE /identity/v3/projects/768fb95ee6774b8ab8d248643951f17a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:55.609001 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c3417-4efc-4c4b-8911-6fd2fdd9a447 tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:55.610870 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-273c3417-4efc-4c4b-8911-6fd2fdd9a447 tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:55.677382 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c3417-4efc-4c4b-8911-6fd2fdd9a447 tempest-VolumeQuotaClassesTest-1648703432 tempest-VolumeQuotaClassesTest-1648703432-project-admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:55.734808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95204bbd-dd34-4ded-b8a8-aafb6cea8604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:55.735588 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95204bbd-dd34-4ded-b8a8-aafb6cea8604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:55.735872 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95204bbd-dd34-4ded-b8a8-aafb6cea8604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:55.736149 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95204bbd-dd34-4ded-b8a8-aafb6cea8604 admin admin] PATH_INFO: `/v3/users/a344ed80f81143cca7368f3f323d9f1a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:55.737366 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95204bbd-dd34-4ded-b8a8-aafb6cea8604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a344ed80f81143cca7368f3f323d9f1a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:55.739320 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95204bbd-dd34-4ded-b8a8-aafb6cea8604 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:55.938700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-95204bbd-dd34-4ded-b8a8-aafb6cea8604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a344ed80f81143cca7368f3f323d9f1a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:55.939430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-95204bbd-dd34-4ded-b8a8-aafb6cea8604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a344ed80f81143cca7368f3f323d9f1a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:55.940171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-95204bbd-dd34-4ded-b8a8-aafb6cea8604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a344ed80f81143cca7368f3f323d9f1a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:55.952600 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-95204bbd-dd34-4ded-b8a8-aafb6cea8604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a344ed80f81143cca7368f3f323d9f1a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:55.959183 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-95204bbd-dd34-4ded-b8a8-aafb6cea8604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a344ed80f81143cca7368f3f323d9f1a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:56.016907 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1343/2662] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:27:55 2022] DELETE /identity/v3/users/a344ed80f81143cca7368f3f323d9f1a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:56.021501 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495a9b6-a686-410d-90e8-d676028a88bd None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:56.021971 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495a9b6-a686-410d-90e8-d676028a88bd None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:56.022126 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495a9b6-a686-410d-90e8-d676028a88bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:56.040424 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-e495a9b6-a686-410d-90e8-d676028a88bd None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:56.041921 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e495a9b6-a686-410d-90e8-d676028a88bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:56.105104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1320/2663] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:27:56.114984 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95204bbd-dd34-4ded-b8a8-aafb6cea8604 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:56.116413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-95204bbd-dd34-4ded-b8a8-aafb6cea8604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:56.174882 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95204bbd-dd34-4ded-b8a8-aafb6cea8604 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:56.178486 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c6d7a-e1e1-472f-8d45-1ee8e27ee38d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:56.179132 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c6d7a-e1e1-472f-8d45-1ee8e27ee38d service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:56.179416 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c6d7a-e1e1-472f-8d45-1ee8e27ee38d service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:56.179778 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c6d7a-e1e1-472f-8d45-1ee8e27ee38d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:56.188658 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c6d7a-e1e1-472f-8d45-1ee8e27ee38d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:56.190065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c6d7a-e1e1-472f-8d45-1ee8e27ee38d service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:56.199934 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1344/2664] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:27:56.598597 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495a9b6-a686-410d-90e8-d676028a88bd None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:56.600766 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e495a9b6-a686-410d-90e8-d676028a88bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:56.614810 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495a9b6-a686-410d-90e8-d676028a88bd None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:56.620006 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee0059-dc40-493d-8f98-db3d5f5c2ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:56.621136 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee0059-dc40-493d-8f98-db3d5f5c2ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:56.621604 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee0059-dc40-493d-8f98-db3d5f5c2ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:56.622535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee0059-dc40-493d-8f98-db3d5f5c2ff0 admin admin] PATH_INFO: `/v3/projects/3cef9b4fe1684e86a371412bb2ad5514` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:56.624840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee0059-dc40-493d-8f98-db3d5f5c2ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cef9b4fe1684e86a371412bb2ad5514)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:56.627706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee0059-dc40-493d-8f98-db3d5f5c2ff0 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:56.744520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-efee0059-dc40-493d-8f98-db3d5f5c2ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cef9b4fe1684e86a371412bb2ad5514', 'request_id': 'req-efee0059-dc40-493d-8f98-db3d5f5c2ff0'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:56.804425 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-efee0059-dc40-493d-8f98-db3d5f5c2ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cef9b4fe1684e86a371412bb2ad5514', 'request_id': 'req-efee0059-dc40-493d-8f98-db3d5f5c2ff0'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:56.810646 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-efee0059-dc40-493d-8f98-db3d5f5c2ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cef9b4fe1684e86a371412bb2ad5514', 'request_id': 'req-efee0059-dc40-493d-8f98-db3d5f5c2ff0'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:56.821905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-efee0059-dc40-493d-8f98-db3d5f5c2ff0 admin admin] The token cache is being invalidate because project 3cef9b4fe1684e86a371412bb2ad5514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:27:56.822411 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-efee0059-dc40-493d-8f98-db3d5f5c2ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:56.823282 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-efee0059-dc40-493d-8f98-db3d5f5c2ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:56.824819 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1321/2665] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:27:56 2022] DELETE /identity/v3/projects/3cef9b4fe1684e86a371412bb2ad5514 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:56.828743 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c6d7a-e1e1-472f-8d45-1ee8e27ee38d service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:56.839979 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c6d7a-e1e1-472f-8d45-1ee8e27ee38d service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:56.898330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566b77f-cc33-45e3-ad4b-ff8c53e81eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:56.899172 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566b77f-cc33-45e3-ad4b-ff8c53e81eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:56.900209 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566b77f-cc33-45e3-ad4b-ff8c53e81eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:56.900560 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566b77f-cc33-45e3-ad4b-ff8c53e81eb5 admin admin] PATH_INFO: `/v3/users/13afe6ab1c3448bbb3f28daa26854bf5` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:56.901869 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566b77f-cc33-45e3-ad4b-ff8c53e81eb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13afe6ab1c3448bbb3f28daa26854bf5)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:56.903811 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566b77f-cc33-45e3-ad4b-ff8c53e81eb5 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:57.064017 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9566b77f-cc33-45e3-ad4b-ff8c53e81eb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13afe6ab1c3448bbb3f28daa26854bf5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:57.064667 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9566b77f-cc33-45e3-ad4b-ff8c53e81eb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13afe6ab1c3448bbb3f28daa26854bf5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:57.065294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9566b77f-cc33-45e3-ad4b-ff8c53e81eb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13afe6ab1c3448bbb3f28daa26854bf5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:57.077049 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9566b77f-cc33-45e3-ad4b-ff8c53e81eb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13afe6ab1c3448bbb3f28daa26854bf5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:57.083664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9566b77f-cc33-45e3-ad4b-ff8c53e81eb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13afe6ab1c3448bbb3f28daa26854bf5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:57.147700 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1345/2666] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:27:56 2022] DELETE /identity/v3/users/13afe6ab1c3448bbb3f28daa26854bf5 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:57.526911 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee0059-dc40-493d-8f98-db3d5f5c2ff0 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:57.528473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-efee0059-dc40-493d-8f98-db3d5f5c2ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:57.542228 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee0059-dc40-493d-8f98-db3d5f5c2ff0 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:57.599941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e7644-833c-4a26-b3ca-e3486a6e2480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:57.600822 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e7644-833c-4a26-b3ca-e3486a6e2480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:57.601105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e7644-833c-4a26-b3ca-e3486a6e2480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:57.601379 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e7644-833c-4a26-b3ca-e3486a6e2480 admin admin] PATH_INFO: `/v3/projects/d7e6a664ba504476a12073bb40a5a033` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:57.602903 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e7644-833c-4a26-b3ca-e3486a6e2480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e6a664ba504476a12073bb40a5a033)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:57.604891 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e7644-833c-4a26-b3ca-e3486a6e2480 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:57.704944 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-216e7644-833c-4a26-b3ca-e3486a6e2480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e6a664ba504476a12073bb40a5a033', 'request_id': 'req-216e7644-833c-4a26-b3ca-e3486a6e2480'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:57.770889 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-216e7644-833c-4a26-b3ca-e3486a6e2480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e6a664ba504476a12073bb40a5a033', 'request_id': 'req-216e7644-833c-4a26-b3ca-e3486a6e2480'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:57.777806 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-216e7644-833c-4a26-b3ca-e3486a6e2480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e6a664ba504476a12073bb40a5a033', 'request_id': 'req-216e7644-833c-4a26-b3ca-e3486a6e2480'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:57.789225 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-216e7644-833c-4a26-b3ca-e3486a6e2480 admin admin] The token cache is being invalidate because project d7e6a664ba504476a12073bb40a5a033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:27:57.789531 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-216e7644-833c-4a26-b3ca-e3486a6e2480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:57.790278 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-216e7644-833c-4a26-b3ca-e3486a6e2480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:27:57.792004 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1322/2667] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:27:57 2022] DELETE /identity/v3/projects/d7e6a664ba504476a12073bb40a5a033 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:57.798127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59f5e7-5a34-4dd3-9c36-817430554b5f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:57.798424 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59f5e7-5a34-4dd3-9c36-817430554b5f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:57.798739 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59f5e7-5a34-4dd3-9c36-817430554b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:57.818369 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-af59f5e7-5a34-4dd3-9c36-817430554b5f None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:57.819701 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-af59f5e7-5a34-4dd3-9c36-817430554b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:57.877862 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1346/2668] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:57.886556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38654474-631e-4f7c-8a57-2040a57231e7 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:57.886849 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38654474-631e-4f7c-8a57-2040a57231e7 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:57.887123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38654474-631e-4f7c-8a57-2040a57231e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:57.905308 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-38654474-631e-4f7c-8a57-2040a57231e7 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:57.906526 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-38654474-631e-4f7c-8a57-2040a57231e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:57.914262 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1323/2669] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:57.918368 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59f5e7-5a34-4dd3-9c36-817430554b5f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:57.927864 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59f5e7-5a34-4dd3-9c36-817430554b5f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:57.933009 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c55e56-1e98-4f3e-8230-39cf13721e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:57.933787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c55e56-1e98-4f3e-8230-39cf13721e87 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:57.934008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c55e56-1e98-4f3e-8230-39cf13721e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:57.934296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c55e56-1e98-4f3e-8230-39cf13721e87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:57.935191 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c55e56-1e98-4f3e-8230-39cf13721e87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:27:57.935504 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c55e56-1e98-4f3e-8230-39cf13721e87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:57.937190 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c55e56-1e98-4f3e-8230-39cf13721e87 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:57.951039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1347/2670] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:27:57.955212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38654474-631e-4f7c-8a57-2040a57231e7 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:57.964897 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38654474-631e-4f7c-8a57-2040a57231e7 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:57.969466 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276a854-a15e-4ab2-acb8-e8210412e8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:57.970105 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276a854-a15e-4ab2-acb8-e8210412e8e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:57.970384 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276a854-a15e-4ab2-acb8-e8210412e8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:57.970690 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276a854-a15e-4ab2-acb8-e8210412e8e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:57.971372 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276a854-a15e-4ab2-acb8-e8210412e8e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:57.973235 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276a854-a15e-4ab2-acb8-e8210412e8e8 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:58.070008 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1324/2671] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:27:57 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:58.074840 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c55e56-1e98-4f3e-8230-39cf13721e87 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:58.084842 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c55e56-1e98-4f3e-8230-39cf13721e87 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:58.142987 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe2f43-e006-4c8e-be94-666e60e5c79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:58.143671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe2f43-e006-4c8e-be94-666e60e5c79e admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:58.143956 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe2f43-e006-4c8e-be94-666e60e5c79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:58.144235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe2f43-e006-4c8e-be94-666e60e5c79e admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:58.144951 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe2f43-e006-4c8e-be94-666e60e5c79e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:58.146992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe2f43-e006-4c8e-be94-666e60e5c79e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:58.238634 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1348/2672] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:27:58 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:27:58.242573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276a854-a15e-4ab2-acb8-e8210412e8e8 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:58.253730 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276a854-a15e-4ab2-acb8-e8210412e8e8 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:58.258598 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160fdee-bf97-472b-b981-c70647cddafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:58.259941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160fdee-bf97-472b-b981-c70647cddafe admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:58.260480 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160fdee-bf97-472b-b981-c70647cddafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:58.260760 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160fdee-bf97-472b-b981-c70647cddafe admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:58.261484 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160fdee-bf97-472b-b981-c70647cddafe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:58.263103 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160fdee-bf97-472b-b981-c70647cddafe admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:58.274165 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1325/2673] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:58.278362 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe2f43-e006-4c8e-be94-666e60e5c79e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:58.288682 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe2f43-e006-4c8e-be94-666e60e5c79e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:58.293806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2efcff-3aea-400a-8ace-f1faf1cbcb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:58.294515 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2efcff-3aea-400a-8ace-f1faf1cbcb2e admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:58.295080 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2efcff-3aea-400a-8ace-f1faf1cbcb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:58.295615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2efcff-3aea-400a-8ace-f1faf1cbcb2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:58.296483 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2efcff-3aea-400a-8ace-f1faf1cbcb2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:58.298250 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2efcff-3aea-400a-8ace-f1faf1cbcb2e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:58.309576 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1349/2674] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:27:58.314317 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160fdee-bf97-472b-b981-c70647cddafe admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:58.325463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160fdee-bf97-472b-b981-c70647cddafe admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:58.330397 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95e1cb-a59f-430b-be8e-164cbd365f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:58.331330 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95e1cb-a59f-430b-be8e-164cbd365f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:58.331619 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95e1cb-a59f-430b-be8e-164cbd365f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:58.331898 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95e1cb-a59f-430b-be8e-164cbd365f64 admin admin] PATH_INFO: `/v3/projects/0e0bf7b1bdbc494085b6c9eba7043347/users/59b9cfbfb9564e51bdf2aa3dde7154b7/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:58.346658 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95e1cb-a59f-430b-be8e-164cbd365f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0bf7b1bdbc494085b6c9eba7043347, user_id=59b9cfbfb9564e51bdf2aa3dde7154b7, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:58.349276 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95e1cb-a59f-430b-be8e-164cbd365f64 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:58.405859 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1326/2675] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:27:58 2022] PUT /identity/v3/projects/0e0bf7b1bdbc494085b6c9eba7043347/users/59b9cfbfb9564e51bdf2aa3dde7154b7/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:58.418041 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42d156-12f9-46fd-8a04-43bc9bcaf56f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:58.418340 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42d156-12f9-46fd-8a04-43bc9bcaf56f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:58.418652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42d156-12f9-46fd-8a04-43bc9bcaf56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:58.445953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-1d42d156-12f9-46fd-8a04-43bc9bcaf56f None None] MFA Rules not processed for user `59b9cfbfb9564e51bdf2aa3dde7154b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:27:58.447503 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1d42d156-12f9-46fd-8a04-43bc9bcaf56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:58.511068 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1350/2676] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:27:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:27:58.521499 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95e1cb-a59f-430b-be8e-164cbd365f64 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:58.523254 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-db95e1cb-a59f-430b-be8e-164cbd365f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:58.580758 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95e1cb-a59f-430b-be8e-164cbd365f64 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:58.584416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccb95c-851c-4bf8-9a8d-e10f5e6accfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:58.585059 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccb95c-851c-4bf8-9a8d-e10f5e6accfa service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:58.585339 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccb95c-851c-4bf8-9a8d-e10f5e6accfa service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:58.585612 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccb95c-851c-4bf8-9a8d-e10f5e6accfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:58.594067 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccb95c-851c-4bf8-9a8d-e10f5e6accfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:58.595523 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccb95c-851c-4bf8-9a8d-e10f5e6accfa service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:58.604721 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1327/2677] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:27:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:28:06.826908 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42d156-12f9-46fd-8a04-43bc9bcaf56f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:06.828300 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1d42d156-12f9-46fd-8a04-43bc9bcaf56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:06.902466 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42d156-12f9-46fd-8a04-43bc9bcaf56f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:06.908028 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404b4f7-6672-4066-8f23-d165ace76e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:06.908913 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404b4f7-6672-4066-8f23-d165ace76e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:06.909204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404b4f7-6672-4066-8f23-d165ace76e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:06.909485 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404b4f7-6672-4066-8f23-d165ace76e5e admin admin] PATH_INFO: `/v3/users/c21b084c552e42938c8b6796a544f3c3` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:06.910757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404b4f7-6672-4066-8f23-d165ace76e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21b084c552e42938c8b6796a544f3c3)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:06.912766 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404b4f7-6672-4066-8f23-d165ace76e5e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:07.081613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-0404b4f7-6672-4066-8f23-d165ace76e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21b084c552e42938c8b6796a544f3c3'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:07.082260 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-0404b4f7-6672-4066-8f23-d165ace76e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21b084c552e42938c8b6796a544f3c3'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:07.082896 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-0404b4f7-6672-4066-8f23-d165ace76e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21b084c552e42938c8b6796a544f3c3'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:07.094282 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-0404b4f7-6672-4066-8f23-d165ace76e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21b084c552e42938c8b6796a544f3c3'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:07.105729 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-0404b4f7-6672-4066-8f23-d165ace76e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21b084c552e42938c8b6796a544f3c3'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:07.170576 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1351/2678] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:28:06 2022] DELETE /identity/v3/users/c21b084c552e42938c8b6796a544f3c3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:07.175034 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430262e9-217d-4d27-a6eb-725e867fc50e None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:07.175491 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430262e9-217d-4d27-a6eb-725e867fc50e None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:07.175681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430262e9-217d-4d27-a6eb-725e867fc50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:07.195213 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-430262e9-217d-4d27-a6eb-725e867fc50e None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:07.196408 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-430262e9-217d-4d27-a6eb-725e867fc50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:07.256367 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1328/2679] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:07.269770 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404b4f7-6672-4066-8f23-d165ace76e5e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:07.271511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0404b4f7-6672-4066-8f23-d165ace76e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:07.332380 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404b4f7-6672-4066-8f23-d165ace76e5e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:07.336116 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e31d04-b224-433b-b59d-d5c5dd15c781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:07.336765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31d04-b224-433b-b59d-d5c5dd15c781 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:07.337049 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31d04-b224-433b-b59d-d5c5dd15c781 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:07.337326 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31d04-b224-433b-b59d-d5c5dd15c781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:07.348340 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e31d04-b224-433b-b59d-d5c5dd15c781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:07.350026 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e31d04-b224-433b-b59d-d5c5dd15c781 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:07.361026 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1352/2680] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:28:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:28:07.761988 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430262e9-217d-4d27-a6eb-725e867fc50e None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:07.763681 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-430262e9-217d-4d27-a6eb-725e867fc50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:07.777494 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430262e9-217d-4d27-a6eb-725e867fc50e None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:07.782940 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35164f-fd9d-4d15-a2be-b372c25cf107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:07.783815 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35164f-fd9d-4d15-a2be-b372c25cf107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:07.784091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35164f-fd9d-4d15-a2be-b372c25cf107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:07.784362 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35164f-fd9d-4d15-a2be-b372c25cf107 admin admin] PATH_INFO: `/v3/projects/e809972ea5de42cdb9307d669cd0132a` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:07.788406 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35164f-fd9d-4d15-a2be-b372c25cf107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e809972ea5de42cdb9307d669cd0132a)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:07.791309 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35164f-fd9d-4d15-a2be-b372c25cf107 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:07.908191 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4b35164f-fd9d-4d15-a2be-b372c25cf107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e809972ea5de42cdb9307d669cd0132a', 'request_id': 'req-4b35164f-fd9d-4d15-a2be-b372c25cf107'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:07.958879 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4b35164f-fd9d-4d15-a2be-b372c25cf107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e809972ea5de42cdb9307d669cd0132a', 'request_id': 'req-4b35164f-fd9d-4d15-a2be-b372c25cf107'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:07.965500 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4b35164f-fd9d-4d15-a2be-b372c25cf107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e809972ea5de42cdb9307d669cd0132a', 'request_id': 'req-4b35164f-fd9d-4d15-a2be-b372c25cf107'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:07.979622 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4b35164f-fd9d-4d15-a2be-b372c25cf107 admin admin] The token cache is being invalidate because project e809972ea5de42cdb9307d669cd0132a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:28:07.979908 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4b35164f-fd9d-4d15-a2be-b372c25cf107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:07.980573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-4b35164f-fd9d-4d15-a2be-b372c25cf107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:07.983123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1329/2681] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:28:07 2022] DELETE /identity/v3/projects/e809972ea5de42cdb9307d669cd0132a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:07.987095 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e31d04-b224-433b-b59d-d5c5dd15c781 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:07.997724 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e31d04-b224-433b-b59d-d5c5dd15c781 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:08.060246 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2014ce-c632-4668-912c-973acde94263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:08.061575 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2014ce-c632-4668-912c-973acde94263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:08.061880 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2014ce-c632-4668-912c-973acde94263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:08.062148 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2014ce-c632-4668-912c-973acde94263 admin admin] PATH_INFO: `/v3/users/ad1fdccc26bf44deaa84532cb8073524` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:08.063512 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2014ce-c632-4668-912c-973acde94263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad1fdccc26bf44deaa84532cb8073524)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:08.065412 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2014ce-c632-4668-912c-973acde94263 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:08.244626 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-4b2014ce-c632-4668-912c-973acde94263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad1fdccc26bf44deaa84532cb8073524'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:08.245299 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-4b2014ce-c632-4668-912c-973acde94263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad1fdccc26bf44deaa84532cb8073524'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:08.245949 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-4b2014ce-c632-4668-912c-973acde94263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad1fdccc26bf44deaa84532cb8073524'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:08.259005 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-4b2014ce-c632-4668-912c-973acde94263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad1fdccc26bf44deaa84532cb8073524'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:08.266890 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-4b2014ce-c632-4668-912c-973acde94263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad1fdccc26bf44deaa84532cb8073524'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:08.315030 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1353/2682] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:28:07 2022] DELETE /identity/v3/users/ad1fdccc26bf44deaa84532cb8073524 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:08.749591 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35164f-fd9d-4d15-a2be-b372c25cf107 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:08.751228 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-4b35164f-fd9d-4d15-a2be-b372c25cf107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:08.767306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35164f-fd9d-4d15-a2be-b372c25cf107 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:08.825861 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c63fe9-60f4-4447-add1-bc499ea50415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:08.826824 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c63fe9-60f4-4447-add1-bc499ea50415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:08.827155 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c63fe9-60f4-4447-add1-bc499ea50415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:08.827434 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c63fe9-60f4-4447-add1-bc499ea50415 admin admin] PATH_INFO: `/v3/projects/8a6edccd4cb342328c6cdbfac5f0b11d` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:08.828637 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c63fe9-60f4-4447-add1-bc499ea50415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a6edccd4cb342328c6cdbfac5f0b11d)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:08.830577 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c63fe9-60f4-4447-add1-bc499ea50415 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:08.919589 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-07c63fe9-60f4-4447-add1-bc499ea50415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a6edccd4cb342328c6cdbfac5f0b11d', 'request_id': 'req-07c63fe9-60f4-4447-add1-bc499ea50415'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:08.965587 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-07c63fe9-60f4-4447-add1-bc499ea50415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a6edccd4cb342328c6cdbfac5f0b11d', 'request_id': 'req-07c63fe9-60f4-4447-add1-bc499ea50415'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:08.974555 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-07c63fe9-60f4-4447-add1-bc499ea50415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a6edccd4cb342328c6cdbfac5f0b11d', 'request_id': 'req-07c63fe9-60f4-4447-add1-bc499ea50415'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:08.986000 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-07c63fe9-60f4-4447-add1-bc499ea50415 admin admin] The token cache is being invalidate because project 8a6edccd4cb342328c6cdbfac5f0b11d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:28:08.986369 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-07c63fe9-60f4-4447-add1-bc499ea50415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:08.987172 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-07c63fe9-60f4-4447-add1-bc499ea50415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:08.988705 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1330/2683] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:28:08 2022] DELETE /identity/v3/projects/8a6edccd4cb342328c6cdbfac5f0b11d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:08.993687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c346e-d719-4c39-8ea8-ba60f87d0016 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:08.994159 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c346e-d719-4c39-8ea8-ba60f87d0016 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:08.994352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c346e-d719-4c39-8ea8-ba60f87d0016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:09.013859 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-342c346e-d719-4c39-8ea8-ba60f87d0016 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:09.015088 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-342c346e-d719-4c39-8ea8-ba60f87d0016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:09.072134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1354/2684] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:09.080571 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a923194-63f5-4195-a671-714ce54b45b0 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:09.080859 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a923194-63f5-4195-a671-714ce54b45b0 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:09.081137 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a923194-63f5-4195-a671-714ce54b45b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:09.098754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-0a923194-63f5-4195-a671-714ce54b45b0 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:09.099934 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-0a923194-63f5-4195-a671-714ce54b45b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:09.107625 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1331/2685] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:09.111602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c346e-d719-4c39-8ea8-ba60f87d0016 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:09.121025 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c346e-d719-4c39-8ea8-ba60f87d0016 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:09.126271 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5998e-ce90-4463-b974-4a7bc0ab0d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:09.126954 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5998e-ce90-4463-b974-4a7bc0ab0d82 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:09.127237 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5998e-ce90-4463-b974-4a7bc0ab0d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:09.127511 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5998e-ce90-4463-b974-4a7bc0ab0d82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:09.128234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5998e-ce90-4463-b974-4a7bc0ab0d82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:28:09.128541 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5998e-ce90-4463-b974-4a7bc0ab0d82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:09.130105 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5998e-ce90-4463-b974-4a7bc0ab0d82 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:09.142368 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1355/2686] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:28:09.146670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a923194-63f5-4195-a671-714ce54b45b0 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:09.156399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a923194-63f5-4195-a671-714ce54b45b0 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:09.161013 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6887ba2-b68c-4442-80dc-ef7b578136bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:09.161660 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6887ba2-b68c-4442-80dc-ef7b578136bf admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:09.161941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6887ba2-b68c-4442-80dc-ef7b578136bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:09.162214 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6887ba2-b68c-4442-80dc-ef7b578136bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:09.162934 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6887ba2-b68c-4442-80dc-ef7b578136bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:09.164796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6887ba2-b68c-4442-80dc-ef7b578136bf admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:09.252351 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1332/2687] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:28:09 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:28:09.256442 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5998e-ce90-4463-b974-4a7bc0ab0d82 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:09.267609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5998e-ce90-4463-b974-4a7bc0ab0d82 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:09.321223 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06e3c1-6e31-4425-8233-d25b73c68e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:09.321884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06e3c1-6e31-4425-8233-d25b73c68e79 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:09.322251 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06e3c1-6e31-4425-8233-d25b73c68e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:09.322495 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06e3c1-6e31-4425-8233-d25b73c68e79 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:09.323234 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06e3c1-6e31-4425-8233-d25b73c68e79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:09.325631 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06e3c1-6e31-4425-8233-d25b73c68e79 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:09.380673 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6887ba2-b68c-4442-80dc-ef7b578136bf admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:09.382355 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-b6887ba2-b68c-4442-80dc-ef7b578136bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:09.395872 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6887ba2-b68c-4442-80dc-ef7b578136bf admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:09.400827 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d682c-fab5-4ddc-a7a6-86af66089bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:09.401707 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d682c-fab5-4ddc-a7a6-86af66089bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:09.402019 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d682c-fab5-4ddc-a7a6-86af66089bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:09.402298 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d682c-fab5-4ddc-a7a6-86af66089bf4 admin admin] PATH_INFO: `/v3/users/59b9cfbfb9564e51bdf2aa3dde7154b7` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:09.404258 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d682c-fab5-4ddc-a7a6-86af66089bf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59b9cfbfb9564e51bdf2aa3dde7154b7)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:09.406169 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d682c-fab5-4ddc-a7a6-86af66089bf4 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:09.456789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1356/2688] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:28:09 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:28:09.460909 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06e3c1-6e31-4425-8233-d25b73c68e79 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:09.470946 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06e3c1-6e31-4425-8233-d25b73c68e79 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:09.475582 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d3277-d925-493e-b61e-12f286d3d11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:09.476205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d3277-d925-493e-b61e-12f286d3d11b admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:09.476485 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d3277-d925-493e-b61e-12f286d3d11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:09.476992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d3277-d925-493e-b61e-12f286d3d11b admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:09.477545 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d3277-d925-493e-b61e-12f286d3d11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:09.479152 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d3277-d925-493e-b61e-12f286d3d11b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:09.488627 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1357/2689] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:28:09.492353 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d3277-d925-493e-b61e-12f286d3d11b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:09.501602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d3277-d925-493e-b61e-12f286d3d11b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:09.506106 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4231a2-f111-46dc-8b36-f872001e6fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:09.506744 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4231a2-f111-46dc-8b36-f872001e6fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:09.507030 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4231a2-f111-46dc-8b36-f872001e6fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:09.507306 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4231a2-f111-46dc-8b36-f872001e6fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:09.507991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4231a2-f111-46dc-8b36-f872001e6fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:09.509480 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4231a2-f111-46dc-8b36-f872001e6fb9 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:09.520606 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1358/2690] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:28:09.524411 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4231a2-f111-46dc-8b36-f872001e6fb9 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:09.534857 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4231a2-f111-46dc-8b36-f872001e6fb9 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:09.539534 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e1042-3c25-4619-bd4c-15a5dac13dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:09.540399 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e1042-3c25-4619-bd4c-15a5dac13dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:09.540683 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e1042-3c25-4619-bd4c-15a5dac13dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:09.540959 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e1042-3c25-4619-bd4c-15a5dac13dc2 admin admin] PATH_INFO: `/v3/projects/ace80814ab4643209f4cd44d31267fd3/users/33416170a6eb4b298aa3499cb963b9dc/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:09.555645 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e1042-3c25-4619-bd4c-15a5dac13dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace80814ab4643209f4cd44d31267fd3, user_id=33416170a6eb4b298aa3499cb963b9dc, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:09.558315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e1042-3c25-4619-bd4c-15a5dac13dc2 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:09.594624 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-469d682c-fab5-4ddc-a7a6-86af66089bf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59b9cfbfb9564e51bdf2aa3dde7154b7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:09.595319 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-469d682c-fab5-4ddc-a7a6-86af66089bf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59b9cfbfb9564e51bdf2aa3dde7154b7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:09.603946 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1359/2691] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:28:09 2022] PUT /identity/v3/projects/ace80814ab4643209f4cd44d31267fd3/users/33416170a6eb4b298aa3499cb963b9dc/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:28:09.608857 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a9683-1870-4c05-9645-dcedfa32441a None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:09.609159 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a9683-1870-4c05-9645-dcedfa32441a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:09.609441 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a9683-1870-4c05-9645-dcedfa32441a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:09.610674 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-469d682c-fab5-4ddc-a7a6-86af66089bf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59b9cfbfb9564e51bdf2aa3dde7154b7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:09.611451 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-469d682c-fab5-4ddc-a7a6-86af66089bf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59b9cfbfb9564e51bdf2aa3dde7154b7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:09.618531 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-469d682c-fab5-4ddc-a7a6-86af66089bf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59b9cfbfb9564e51bdf2aa3dde7154b7'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:09.626977 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-fc5a9683-1870-4c05-9645-dcedfa32441a None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:09.628211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fc5a9683-1870-4c05-9645-dcedfa32441a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:09.686822 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1360/2692] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:28:09.691016 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1333/2693] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:28:09 2022] DELETE /identity/v3/users/59b9cfbfb9564e51bdf2aa3dde7154b7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:28:09.696146 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a9683-1870-4c05-9645-dcedfa32441a None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:09.698229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fc5a9683-1870-4c05-9645-dcedfa32441a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:09.701887 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ad26c-a02a-4ac4-b600-51d534443127 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:09.702180 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ad26c-a02a-4ac4-b600-51d534443127 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:09.702485 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ad26c-a02a-4ac4-b600-51d534443127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:09.720473 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-461ad26c-a02a-4ac4-b600-51d534443127 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:09.721668 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-461ad26c-a02a-4ac4-b600-51d534443127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:09.752585 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a9683-1870-4c05-9645-dcedfa32441a None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:09.782031 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1334/2694] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:28:09.791574 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ad26c-a02a-4ac4-b600-51d534443127 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:09.799488 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1c3e6-10e2-45d6-9cfb-de00f50901f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:09.800133 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1c3e6-10e2-45d6-9cfb-de00f50901f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:09.800413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1c3e6-10e2-45d6-9cfb-de00f50901f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:09.800686 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1c3e6-10e2-45d6-9cfb-de00f50901f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:09.812348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1c3e6-10e2-45d6-9cfb-de00f50901f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:09.813845 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1c3e6-10e2-45d6-9cfb-de00f50901f6 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:09.823504 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1361/2695] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:28:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:28:09.849669 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ad26c-a02a-4ac4-b600-51d534443127 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:09.853692 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d874bb1-c5cf-4a98-ae70-5997b5567b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:09.859820 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d874bb1-c5cf-4a98-ae70-5997b5567b1c service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:09.859820 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d874bb1-c5cf-4a98-ae70-5997b5567b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:09.859820 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d874bb1-c5cf-4a98-ae70-5997b5567b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:09.865104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d874bb1-c5cf-4a98-ae70-5997b5567b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:09.866562 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d874bb1-c5cf-4a98-ae70-5997b5567b1c service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:09.876130 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1335/2696] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:28:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:28:10.549432 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1c3e6-10e2-45d6-9cfb-de00f50901f6 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:10.559260 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-25c1c3e6-10e2-45d6-9cfb-de00f50901f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:10.564357 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1c3e6-10e2-45d6-9cfb-de00f50901f6 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:10.569000 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3e73b-b45a-4118-b2f0-2037b21cf23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:10.569866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3e73b-b45a-4118-b2f0-2037b21cf23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:10.570151 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3e73b-b45a-4118-b2f0-2037b21cf23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:10.570426 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3e73b-b45a-4118-b2f0-2037b21cf23e admin admin] PATH_INFO: `/v3/projects/0e0bf7b1bdbc494085b6c9eba7043347` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:10.571657 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3e73b-b45a-4118-b2f0-2037b21cf23e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0bf7b1bdbc494085b6c9eba7043347)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:10.573555 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3e73b-b45a-4118-b2f0-2037b21cf23e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:10.662462 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ccb3e73b-b45a-4118-b2f0-2037b21cf23e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0bf7b1bdbc494085b6c9eba7043347', 'request_id': 'req-ccb3e73b-b45a-4118-b2f0-2037b21cf23e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:10.713168 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ccb3e73b-b45a-4118-b2f0-2037b21cf23e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0bf7b1bdbc494085b6c9eba7043347', 'request_id': 'req-ccb3e73b-b45a-4118-b2f0-2037b21cf23e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:10.720023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ccb3e73b-b45a-4118-b2f0-2037b21cf23e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0bf7b1bdbc494085b6c9eba7043347', 'request_id': 'req-ccb3e73b-b45a-4118-b2f0-2037b21cf23e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:10.733183 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ccb3e73b-b45a-4118-b2f0-2037b21cf23e admin admin] The token cache is being invalidate because project 0e0bf7b1bdbc494085b6c9eba7043347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:28:10.733475 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ccb3e73b-b45a-4118-b2f0-2037b21cf23e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:10.734141 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ccb3e73b-b45a-4118-b2f0-2037b21cf23e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:10.735884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1362/2697] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:28:10 2022] DELETE /identity/v3/projects/0e0bf7b1bdbc494085b6c9eba7043347 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:10.741566 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304632a5-2f6a-4533-ab27-66fabacdb2ed None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:10.743460 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304632a5-2f6a-4533-ab27-66fabacdb2ed None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:10.743909 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304632a5-2f6a-4533-ab27-66fabacdb2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:10.764448 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-304632a5-2f6a-4533-ab27-66fabacdb2ed None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:10.765666 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-304632a5-2f6a-4533-ab27-66fabacdb2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:10.834426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1336/2698] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:10.844323 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a914de-fd38-4f5e-85bd-bf6c4cfc8c0c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:10.846774 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a914de-fd38-4f5e-85bd-bf6c4cfc8c0c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:10.847153 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a914de-fd38-4f5e-85bd-bf6c4cfc8c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:10.874397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-52a914de-fd38-4f5e-85bd-bf6c4cfc8c0c None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:10.875671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-52a914de-fd38-4f5e-85bd-bf6c4cfc8c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:10.883663 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1363/2699] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:10.888726 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304632a5-2f6a-4533-ab27-66fabacdb2ed None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:10.898267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304632a5-2f6a-4533-ab27-66fabacdb2ed None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:10.902845 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0f74f-7c68-4479-8b7d-089fb725f772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:10.904140 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0f74f-7c68-4479-8b7d-089fb725f772 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:10.904561 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0f74f-7c68-4479-8b7d-089fb725f772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:10.904837 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0f74f-7c68-4479-8b7d-089fb725f772 admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:10.905591 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0f74f-7c68-4479-8b7d-089fb725f772 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:28:10.905896 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0f74f-7c68-4479-8b7d-089fb725f772 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:10.907488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0f74f-7c68-4479-8b7d-089fb725f772 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:10.918580 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1337/2700] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:28:10.922992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a914de-fd38-4f5e-85bd-bf6c4cfc8c0c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:10.932211 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a914de-fd38-4f5e-85bd-bf6c4cfc8c0c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:10.937106 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38294a93-af64-426e-9984-b2f55e535d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:10.937765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38294a93-af64-426e-9984-b2f55e535d0f admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:10.938062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38294a93-af64-426e-9984-b2f55e535d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:10.938342 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38294a93-af64-426e-9984-b2f55e535d0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:10.939087 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38294a93-af64-426e-9984-b2f55e535d0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:10.940979 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38294a93-af64-426e-9984-b2f55e535d0f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:11.012161 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1364/2701] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:28:10 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:28:11.016710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0f74f-7c68-4479-8b7d-089fb725f772 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:11.026773 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0f74f-7c68-4479-8b7d-089fb725f772 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:11.080789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c8e27-c9e5-4b00-b49c-6fb2496d1b38 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:11.081065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c8e27-c9e5-4b00-b49c-6fb2496d1b38 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:11.081358 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c8e27-c9e5-4b00-b49c-6fb2496d1b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:11.092805 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269742ad-6259-471f-8501-ff57389d65f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:11.093596 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269742ad-6259-471f-8501-ff57389d65f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:11.093876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269742ad-6259-471f-8501-ff57389d65f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:11.094152 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269742ad-6259-471f-8501-ff57389d65f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:11.095300 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269742ad-6259-471f-8501-ff57389d65f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:11.101161 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269742ad-6259-471f-8501-ff57389d65f2 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:11.115301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-5a2c8e27-c9e5-4b00-b49c-6fb2496d1b38 None None] MFA Rules not processed for user `33416170a6eb4b298aa3499cb963b9dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:11.116516 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5a2c8e27-c9e5-4b00-b49c-6fb2496d1b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:11.177532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1338/2702] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:28:11 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:28:11.181503 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269742ad-6259-471f-8501-ff57389d65f2 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:11.191635 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269742ad-6259-471f-8501-ff57389d65f2 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:11.199663 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1365/2703] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:28:11.199850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98710b1-ec55-4ed1-95bd-0ca34f3e8ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:11.199850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98710b1-ec55-4ed1-95bd-0ca34f3e8ffb admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:11.199850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98710b1-ec55-4ed1-95bd-0ca34f3e8ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:11.199850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98710b1-ec55-4ed1-95bd-0ca34f3e8ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:11.200295 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98710b1-ec55-4ed1-95bd-0ca34f3e8ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:11.200295 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98710b1-ec55-4ed1-95bd-0ca34f3e8ffb admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:11.202032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c8e27-c9e5-4b00-b49c-6fb2496d1b38 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:11.203463 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5a2c8e27-c9e5-4b00-b49c-6fb2496d1b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:11.210776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1339/2704] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:28:11.214639 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98710b1-ec55-4ed1-95bd-0ca34f3e8ffb admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:11.217727 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c8e27-c9e5-4b00-b49c-6fb2496d1b38 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:11.222360 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedee52-e24c-4f51-ba25-7c1b8bcb3be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:11.223057 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedee52-e24c-4f51-ba25-7c1b8bcb3be9 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:11.223345 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedee52-e24c-4f51-ba25-7c1b8bcb3be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:11.223624 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedee52-e24c-4f51-ba25-7c1b8bcb3be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:11.224329 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedee52-e24c-4f51-ba25-7c1b8bcb3be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:11.225007 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98710b1-ec55-4ed1-95bd-0ca34f3e8ffb admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:11.226253 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedee52-e24c-4f51-ba25-7c1b8bcb3be9 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:11.229533 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0a3fa-3b2b-4701-bcbe-fce88e442382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:11.230180 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0a3fa-3b2b-4701-bcbe-fce88e442382 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:11.230484 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0a3fa-3b2b-4701-bcbe-fce88e442382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:11.230763 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0a3fa-3b2b-4701-bcbe-fce88e442382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:11.231698 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0a3fa-3b2b-4701-bcbe-fce88e442382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:11.233765 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0a3fa-3b2b-4701-bcbe-fce88e442382 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:11.244138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1340/2705] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:28:11.248158 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0a3fa-3b2b-4701-bcbe-fce88e442382 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:11.257651 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0a3fa-3b2b-4701-bcbe-fce88e442382 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:11.262625 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc04d73-4aa4-4dc6-befa-28ed44e867d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:11.263645 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc04d73-4aa4-4dc6-befa-28ed44e867d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:11.263929 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc04d73-4aa4-4dc6-befa-28ed44e867d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:11.264207 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc04d73-4aa4-4dc6-befa-28ed44e867d4 admin admin] PATH_INFO: `/v3/projects/415f92d0a65741baae4c810488ef6257/users/f01710c3ca694528ba304854e1406d40/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:11.278957 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc04d73-4aa4-4dc6-befa-28ed44e867d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=415f92d0a65741baae4c810488ef6257, user_id=f01710c3ca694528ba304854e1406d40, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:11.281567 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc04d73-4aa4-4dc6-befa-28ed44e867d4 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:11.319842 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1366/2706] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:28:11 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:28:11.323739 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedee52-e24c-4f51-ba25-7c1b8bcb3be9 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:11.384849 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedee52-e24c-4f51-ba25-7c1b8bcb3be9 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:11.389819 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215ccbf-26ac-429d-871d-b866e17eed61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:11.390514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215ccbf-26ac-429d-871d-b866e17eed61 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:11.390806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215ccbf-26ac-429d-871d-b866e17eed61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:11.391084 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215ccbf-26ac-429d-871d-b866e17eed61 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:11.391798 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215ccbf-26ac-429d-871d-b866e17eed61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:11.393463 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1341/2707] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:28:11 2022] PUT /identity/v3/projects/415f92d0a65741baae4c810488ef6257/users/f01710c3ca694528ba304854e1406d40/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:28:11.395791 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215ccbf-26ac-429d-871d-b866e17eed61 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:11.412004 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab66e2d-9da0-43fe-8eee-75373bc7b0c2 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:11.412296 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab66e2d-9da0-43fe-8eee-75373bc7b0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:11.412575 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab66e2d-9da0-43fe-8eee-75373bc7b0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:11.439343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-aab66e2d-9da0-43fe-8eee-75373bc7b0c2 None None] MFA Rules not processed for user `f01710c3ca694528ba304854e1406d40`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:11.440545 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-aab66e2d-9da0-43fe-8eee-75373bc7b0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:11.485105 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1367/2708] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:28:11 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:28:11.488896 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215ccbf-26ac-429d-871d-b866e17eed61 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:11.498530 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215ccbf-26ac-429d-871d-b866e17eed61 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:11.503459 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1342/2709] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:28:11.507903 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab66e2d-9da0-43fe-8eee-75373bc7b0c2 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:11.553851 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50926828-dedc-4c40-a82c-9aa67b98b2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:11.554562 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50926828-dedc-4c40-a82c-9aa67b98b2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:11.554879 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50926828-dedc-4c40-a82c-9aa67b98b2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:11.555164 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50926828-dedc-4c40-a82c-9aa67b98b2e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:11.555897 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50926828-dedc-4c40-a82c-9aa67b98b2e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:11.557513 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50926828-dedc-4c40-a82c-9aa67b98b2e8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:11.567844 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1368/2710] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:28:11.568137 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab66e2d-9da0-43fe-8eee-75373bc7b0c2 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:11.571883 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50926828-dedc-4c40-a82c-9aa67b98b2e8 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:11.572812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2ef0f-0e09-4b90-98df-7ac464941ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:11.573580 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2ef0f-0e09-4b90-98df-7ac464941ddc admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:11.573872 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2ef0f-0e09-4b90-98df-7ac464941ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:11.574151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2ef0f-0e09-4b90-98df-7ac464941ddc admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:11.574887 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2ef0f-0e09-4b90-98df-7ac464941ddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:11.577366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2ef0f-0e09-4b90-98df-7ac464941ddc admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:11.582531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50926828-dedc-4c40-a82c-9aa67b98b2e8 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:11.587157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86918c9-1f0d-4dba-9ed3-282a54711b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:11.588019 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86918c9-1f0d-4dba-9ed3-282a54711b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:11.588305 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86918c9-1f0d-4dba-9ed3-282a54711b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:11.588584 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86918c9-1f0d-4dba-9ed3-282a54711b96 admin admin] PATH_INFO: `/v3/projects/ecff0e786dc145cebfe45617e1595dd6/users/0ebb91e51a5e4e62aa168ace22bcef91/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:11.603435 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86918c9-1f0d-4dba-9ed3-282a54711b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecff0e786dc145cebfe45617e1595dd6, user_id=0ebb91e51a5e4e62aa168ace22bcef91, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:11.608293 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86918c9-1f0d-4dba-9ed3-282a54711b96 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:11.663064 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1343/2711] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:28:11 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:28:11.667158 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2ef0f-0e09-4b90-98df-7ac464941ddc admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:11.684872 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1369/2712] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:28:11 2022] PUT /identity/v3/projects/ecff0e786dc145cebfe45617e1595dd6/users/0ebb91e51a5e4e62aa168ace22bcef91/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:28:11.688653 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86918c9-1f0d-4dba-9ed3-282a54711b96 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:11.728012 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2ef0f-0e09-4b90-98df-7ac464941ddc admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:11.748067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86918c9-1f0d-4dba-9ed3-282a54711b96 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:11.752746 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373ce78-d29e-4bd0-8655-d044822b69e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:11.753348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373ce78-d29e-4bd0-8655-d044822b69e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:11.753630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373ce78-d29e-4bd0-8655-d044822b69e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:11.753906 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373ce78-d29e-4bd0-8655-d044822b69e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:11.754662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373ce78-d29e-4bd0-8655-d044822b69e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:11.756262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373ce78-d29e-4bd0-8655-d044822b69e1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:11.766664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1370/2713] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:28:11.770688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373ce78-d29e-4bd0-8655-d044822b69e1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:11.781053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373ce78-d29e-4bd0-8655-d044822b69e1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:11.783978 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c483a8-e514-4ded-b7ac-347dcac5430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:11.784665 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c483a8-e514-4ded-b7ac-347dcac5430d admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:11.784950 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c483a8-e514-4ded-b7ac-347dcac5430d admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:11.785284 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c483a8-e514-4ded-b7ac-347dcac5430d admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:11.785946 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c483a8-e514-4ded-b7ac-347dcac5430d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:11.786058 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512ba16-1fb8-42e7-b18d-a25be29450ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:11.786884 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512ba16-1fb8-42e7-b18d-a25be29450ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:11.787174 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512ba16-1fb8-42e7-b18d-a25be29450ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:11.787481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512ba16-1fb8-42e7-b18d-a25be29450ee admin admin] PATH_INFO: `/v3/projects/ecff0e786dc145cebfe45617e1595dd6/users/0ebb91e51a5e4e62aa168ace22bcef91/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:11.787879 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c483a8-e514-4ded-b7ac-347dcac5430d admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:11.789518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512ba16-1fb8-42e7-b18d-a25be29450ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecff0e786dc145cebfe45617e1595dd6, user_id=0ebb91e51a5e4e62aa168ace22bcef91, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:11.792344 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512ba16-1fb8-42e7-b18d-a25be29450ee admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:11.803321 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1371/2714] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:28:11 2022] PUT /identity/v3/projects/ecff0e786dc145cebfe45617e1595dd6/users/0ebb91e51a5e4e62aa168ace22bcef91/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:11.858288 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1344/2715] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:28:11 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:28:11.862196 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512ba16-1fb8-42e7-b18d-a25be29450ee admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:11.924135 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512ba16-1fb8-42e7-b18d-a25be29450ee admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:11.928838 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f1d56-b1f6-4864-8f3a-a3987af4f303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:11.929510 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f1d56-b1f6-4864-8f3a-a3987af4f303 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:11.929797 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f1d56-b1f6-4864-8f3a-a3987af4f303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:11.930077 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f1d56-b1f6-4864-8f3a-a3987af4f303 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:11.930840 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f1d56-b1f6-4864-8f3a-a3987af4f303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:11.932424 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f1d56-b1f6-4864-8f3a-a3987af4f303 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:11.943572 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1372/2716] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:28:11.947399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c483a8-e514-4ded-b7ac-347dcac5430d admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:11.958239 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c483a8-e514-4ded-b7ac-347dcac5430d admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:11.962998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475f6f0-707a-4dad-9b69-efcf8e150c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:11.963657 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475f6f0-707a-4dad-9b69-efcf8e150c1a admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:11.963943 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475f6f0-707a-4dad-9b69-efcf8e150c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:11.964219 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475f6f0-707a-4dad-9b69-efcf8e150c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:11.964946 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475f6f0-707a-4dad-9b69-efcf8e150c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:11.966627 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475f6f0-707a-4dad-9b69-efcf8e150c1a admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:11.976516 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1345/2717] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:28:11.980830 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f1d56-b1f6-4864-8f3a-a3987af4f303 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:11.990822 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f1d56-b1f6-4864-8f3a-a3987af4f303 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:11.995475 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e977aa1-b4c2-4b73-887f-ddc8310141fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:11.996350 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e977aa1-b4c2-4b73-887f-ddc8310141fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:11.996633 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e977aa1-b4c2-4b73-887f-ddc8310141fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:11.997451 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e977aa1-b4c2-4b73-887f-ddc8310141fb admin admin] PATH_INFO: `/v3/projects/216e563c675b42b1a5aa1e4d305e43ea/users/fd57f56e506b47df914ff2d1f975c3dc/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:12.012415 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e977aa1-b4c2-4b73-887f-ddc8310141fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=216e563c675b42b1a5aa1e4d305e43ea, user_id=fd57f56e506b47df914ff2d1f975c3dc, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:12.015667 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e977aa1-b4c2-4b73-887f-ddc8310141fb admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:12.079714 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1373/2718] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:28:11 2022] PUT /identity/v3/projects/216e563c675b42b1a5aa1e4d305e43ea/users/fd57f56e506b47df914ff2d1f975c3dc/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:12.090034 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd46fd-49b8-4786-a990-eff177a9cb49 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:12.090329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd46fd-49b8-4786-a990-eff177a9cb49 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:12.090729 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd46fd-49b8-4786-a990-eff177a9cb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:12.117618 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-77dd46fd-49b8-4786-a990-eff177a9cb49 None None] MFA Rules not processed for user `fd57f56e506b47df914ff2d1f975c3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:12.118881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-77dd46fd-49b8-4786-a990-eff177a9cb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:12.184094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1346/2719] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:12.189454 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e977aa1-b4c2-4b73-887f-ddc8310141fb admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:12.249641 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e977aa1-b4c2-4b73-887f-ddc8310141fb admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:12.254394 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36971a10-7ddd-4bf1-846b-90f6f9071341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:12.255076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36971a10-7ddd-4bf1-846b-90f6f9071341 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:12.255361 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36971a10-7ddd-4bf1-846b-90f6f9071341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:12.255641 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36971a10-7ddd-4bf1-846b-90f6f9071341 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:12.256339 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36971a10-7ddd-4bf1-846b-90f6f9071341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:12.258229 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36971a10-7ddd-4bf1-846b-90f6f9071341 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:12.348436 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1374/2720] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:28:12 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:28:12.349603 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd46fd-49b8-4786-a990-eff177a9cb49 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:12.361771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd46fd-49b8-4786-a990-eff177a9cb49 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:12.421372 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab210c-52a5-41ac-a228-257b3dad374f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:12.422084 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab210c-52a5-41ac-a228-257b3dad374f admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:12.422346 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab210c-52a5-41ac-a228-257b3dad374f admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:12.422673 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab210c-52a5-41ac-a228-257b3dad374f admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:12.423372 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab210c-52a5-41ac-a228-257b3dad374f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:12.425303 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab210c-52a5-41ac-a228-257b3dad374f admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:12.511086 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1347/2721] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:28:12 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:28:12.513311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36971a10-7ddd-4bf1-846b-90f6f9071341 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:12.523753 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36971a10-7ddd-4bf1-846b-90f6f9071341 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:12.528992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968b710-a8ca-4faf-8a86-45dbd8d60673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:12.529810 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968b710-a8ca-4faf-8a86-45dbd8d60673 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:12.530097 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968b710-a8ca-4faf-8a86-45dbd8d60673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:12.530380 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968b710-a8ca-4faf-8a86-45dbd8d60673 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:12.531208 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968b710-a8ca-4faf-8a86-45dbd8d60673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:12.532738 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968b710-a8ca-4faf-8a86-45dbd8d60673 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:12.543330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1375/2722] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:28:12.547775 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab210c-52a5-41ac-a228-257b3dad374f admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:12.558009 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab210c-52a5-41ac-a228-257b3dad374f admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:12.563369 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cf96e-40ac-4e5b-ade9-98a07e0ca05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:12.567452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cf96e-40ac-4e5b-ade9-98a07e0ca05b admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:12.567452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cf96e-40ac-4e5b-ade9-98a07e0ca05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:12.567452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cf96e-40ac-4e5b-ade9-98a07e0ca05b admin admin] PATH_INFO: `/v3/projects/b0d9b0da407847478e0876fb21696fc2/users/c3fe3cff93054fb1b69204692729f071/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:12.580370 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cf96e-40ac-4e5b-ade9-98a07e0ca05b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d9b0da407847478e0876fb21696fc2, user_id=c3fe3cff93054fb1b69204692729f071, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:12.583046 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cf96e-40ac-4e5b-ade9-98a07e0ca05b admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:12.711184 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1348/2723] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:28:12 2022] PUT /identity/v3/projects/b0d9b0da407847478e0876fb21696fc2/users/c3fe3cff93054fb1b69204692729f071/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:28:12.712934 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968b710-a8ca-4faf-8a86-45dbd8d60673 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:12.723758 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968b710-a8ca-4faf-8a86-45dbd8d60673 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:12.778841 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272d7d0-db3c-47bc-b189-855bcd12d7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:12.779506 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272d7d0-db3c-47bc-b189-855bcd12d7cd admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:12.779791 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272d7d0-db3c-47bc-b189-855bcd12d7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:12.780066 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272d7d0-db3c-47bc-b189-855bcd12d7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:12.780787 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272d7d0-db3c-47bc-b189-855bcd12d7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:12.782395 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272d7d0-db3c-47bc-b189-855bcd12d7cd admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:12.791751 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1376/2724] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:28:12.796113 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cf96e-40ac-4e5b-ade9-98a07e0ca05b admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:12.806160 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cf96e-40ac-4e5b-ade9-98a07e0ca05b admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:12.811665 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd74571-c5c6-41fe-b0da-d55383f1e819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:12.812538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd74571-c5c6-41fe-b0da-d55383f1e819 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:12.812823 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd74571-c5c6-41fe-b0da-d55383f1e819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:12.813096 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd74571-c5c6-41fe-b0da-d55383f1e819 admin admin] PATH_INFO: `/v3/projects/b0d9b0da407847478e0876fb21696fc2/users/c3fe3cff93054fb1b69204692729f071/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:12.815104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd74571-c5c6-41fe-b0da-d55383f1e819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d9b0da407847478e0876fb21696fc2, user_id=c3fe3cff93054fb1b69204692729f071, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:12.817710 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd74571-c5c6-41fe-b0da-d55383f1e819 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:12.828960 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1349/2725] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:28:12 2022] PUT /identity/v3/projects/b0d9b0da407847478e0876fb21696fc2/users/c3fe3cff93054fb1b69204692729f071/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:12.839075 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b20125-3735-4728-9669-750191b95090 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:12.839372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b20125-3735-4728-9669-750191b95090 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:12.839652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b20125-3735-4728-9669-750191b95090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:12.865348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-42b20125-3735-4728-9669-750191b95090 None None] MFA Rules not processed for user `c3fe3cff93054fb1b69204692729f071`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:12.866577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-42b20125-3735-4728-9669-750191b95090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:12.935646 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1377/2726] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:28:12.947408 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd74571-c5c6-41fe-b0da-d55383f1e819 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:12.949138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-cdd74571-c5c6-41fe-b0da-d55383f1e819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:13.016983 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd74571-c5c6-41fe-b0da-d55383f1e819 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:13.029325 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e7d8e-b009-43a6-8a50-1027fe74b0b6 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:13.029644 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e7d8e-b009-43a6-8a50-1027fe74b0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:13.029933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e7d8e-b009-43a6-8a50-1027fe74b0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:13.030060 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f61c51-3af1-4a9a-9473-1e52fcc3483c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:13.030778 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f61c51-3af1-4a9a-9473-1e52fcc3483c service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:13.031255 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f61c51-3af1-4a9a-9473-1e52fcc3483c service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:13.031603 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f61c51-3af1-4a9a-9473-1e52fcc3483c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:13.060155 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-1b9e7d8e-b009-43a6-8a50-1027fe74b0b6 None None] MFA Rules not processed for user `0ebb91e51a5e4e62aa168ace22bcef91`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:13.061661 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1b9e7d8e-b009-43a6-8a50-1027fe74b0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:13.094860 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f61c51-3af1-4a9a-9473-1e52fcc3483c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:13.096297 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f61c51-3af1-4a9a-9473-1e52fcc3483c service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:13.108296 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1350/2727] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:28:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:28:13.136261 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1378/2728] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:13 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:13.147372 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f61c51-3af1-4a9a-9473-1e52fcc3483c service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:13.149052 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-f5f61c51-3af1-4a9a-9473-1e52fcc3483c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:13.160461 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f61c51-3af1-4a9a-9473-1e52fcc3483c service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:13.164418 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa32c7-3f01-4e0e-b28d-ca9f42fd4a83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:13.165060 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa32c7-3f01-4e0e-b28d-ca9f42fd4a83 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:13.165342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa32c7-3f01-4e0e-b28d-ca9f42fd4a83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:13.165616 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa32c7-3f01-4e0e-b28d-ca9f42fd4a83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:13.223910 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa32c7-3f01-4e0e-b28d-ca9f42fd4a83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:13.225336 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa32c7-3f01-4e0e-b28d-ca9f42fd4a83 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:13.235028 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1351/2729] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:28:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:28:15.079365 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e7d8e-b009-43a6-8a50-1027fe74b0b6 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:15.089576 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e7d8e-b009-43a6-8a50-1027fe74b0b6 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:15.093522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d2c46-f6cd-48cc-be68-3cfb3bc042cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:15.093905 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d2c46-f6cd-48cc-be68-3cfb3bc042cf service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:15.094190 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d2c46-f6cd-48cc-be68-3cfb3bc042cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:15.094499 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d2c46-f6cd-48cc-be68-3cfb3bc042cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:15.103577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d2c46-f6cd-48cc-be68-3cfb3bc042cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:15.104978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d2c46-f6cd-48cc-be68-3cfb3bc042cf service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:15.114430 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1379/2730] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:28:15 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:28:15.295828 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa32c7-3f01-4e0e-b28d-ca9f42fd4a83 service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:15.304469 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa32c7-3f01-4e0e-b28d-ca9f42fd4a83 service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:15.308156 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f2663-c3f4-4578-b6f1-70707f4cf2be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:15.308800 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f2663-c3f4-4578-b6f1-70707f4cf2be service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:15.309081 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f2663-c3f4-4578-b6f1-70707f4cf2be service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:15.309359 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f2663-c3f4-4578-b6f1-70707f4cf2be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:15.366102 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f2663-c3f4-4578-b6f1-70707f4cf2be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:15.367489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f2663-c3f4-4578-b6f1-70707f4cf2be service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:15.377521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1352/2731] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:28:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:28:16.856828 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d2c46-f6cd-48cc-be68-3cfb3bc042cf service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:16.865367 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d2c46-f6cd-48cc-be68-3cfb3bc042cf service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:16.869044 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d4e57-f171-49a3-b763-c560a3656300 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:16.874860 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d4e57-f171-49a3-b763-c560a3656300 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:16.874860 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d4e57-f171-49a3-b763-c560a3656300 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:16.874860 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d4e57-f171-49a3-b763-c560a3656300 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:16.879345 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d4e57-f171-49a3-b763-c560a3656300 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:16.880760 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d4e57-f171-49a3-b763-c560a3656300 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:16.890939 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1380/2732] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:28:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:28:21.654670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f2663-c3f4-4578-b6f1-70707f4cf2be service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:21.717986 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f2663-c3f4-4578-b6f1-70707f4cf2be service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:21.722715 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a98dc6-94f5-4600-a0de-d2f3d13dfa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:21.723940 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a98dc6-94f5-4600-a0de-d2f3d13dfa5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:21.723940 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a98dc6-94f5-4600-a0de-d2f3d13dfa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:21.724358 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a98dc6-94f5-4600-a0de-d2f3d13dfa5e admin admin] PATH_INFO: `/v3/users/f01710c3ca694528ba304854e1406d40` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:21.725664 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a98dc6-94f5-4600-a0de-d2f3d13dfa5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01710c3ca694528ba304854e1406d40)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:21.727573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a98dc6-94f5-4600-a0de-d2f3d13dfa5e admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:21.956186 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c8a98dc6-94f5-4600-a0de-d2f3d13dfa5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01710c3ca694528ba304854e1406d40'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:21.956934 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c8a98dc6-94f5-4600-a0de-d2f3d13dfa5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01710c3ca694528ba304854e1406d40'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:21.970683 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c8a98dc6-94f5-4600-a0de-d2f3d13dfa5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01710c3ca694528ba304854e1406d40'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:21.971443 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c8a98dc6-94f5-4600-a0de-d2f3d13dfa5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01710c3ca694528ba304854e1406d40'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:21.978755 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c8a98dc6-94f5-4600-a0de-d2f3d13dfa5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01710c3ca694528ba304854e1406d40'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:22.055639 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1353/2733] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:28:21 2022] DELETE /identity/v3/users/f01710c3ca694528ba304854e1406d40 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:22.060319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2b281-8538-4ba5-b5a8-b6ec47faddb4 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:22.061165 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2b281-8538-4ba5-b5a8-b6ec47faddb4 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:22.061454 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2b281-8538-4ba5-b5a8-b6ec47faddb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:22.079271 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-aac2b281-8538-4ba5-b5a8-b6ec47faddb4 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:22.080456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-aac2b281-8538-4ba5-b5a8-b6ec47faddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:22.138311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1381/2734] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:22.148597 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a98dc6-94f5-4600-a0de-d2f3d13dfa5e admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:22.150027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-c8a98dc6-94f5-4600-a0de-d2f3d13dfa5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:22.206001 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a98dc6-94f5-4600-a0de-d2f3d13dfa5e admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:22.209560 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02609ba-c5c1-42ce-ab6a-ef232ef218fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:22.210204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02609ba-c5c1-42ce-ab6a-ef232ef218fa service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:22.210517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02609ba-c5c1-42ce-ab6a-ef232ef218fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:22.210796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02609ba-c5c1-42ce-ab6a-ef232ef218fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:22.220206 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02609ba-c5c1-42ce-ab6a-ef232ef218fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:22.221720 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02609ba-c5c1-42ce-ab6a-ef232ef218fa service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:22.231763 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1354/2735] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:28:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:28:22.641613 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2b281-8538-4ba5-b5a8-b6ec47faddb4 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:22.644001 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-aac2b281-8538-4ba5-b5a8-b6ec47faddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:22.660579 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2b281-8538-4ba5-b5a8-b6ec47faddb4 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:22.665490 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fda3f-8a8f-472f-96b2-d54ea8140daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:22.666221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fda3f-8a8f-472f-96b2-d54ea8140daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:22.666566 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fda3f-8a8f-472f-96b2-d54ea8140daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:22.666814 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fda3f-8a8f-472f-96b2-d54ea8140daf admin admin] PATH_INFO: `/v3/projects/415f92d0a65741baae4c810488ef6257` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:22.668001 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fda3f-8a8f-472f-96b2-d54ea8140daf admin admin] RBAC: Authorizing `identity:delete_project(project_id=415f92d0a65741baae4c810488ef6257)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:22.669902 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fda3f-8a8f-472f-96b2-d54ea8140daf admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:22.752863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ed9fda3f-8a8f-472f-96b2-d54ea8140daf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '415f92d0a65741baae4c810488ef6257', 'request_id': 'req-ed9fda3f-8a8f-472f-96b2-d54ea8140daf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:22.849986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ed9fda3f-8a8f-472f-96b2-d54ea8140daf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '415f92d0a65741baae4c810488ef6257', 'request_id': 'req-ed9fda3f-8a8f-472f-96b2-d54ea8140daf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:22.853903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ed9fda3f-8a8f-472f-96b2-d54ea8140daf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '415f92d0a65741baae4c810488ef6257', 'request_id': 'req-ed9fda3f-8a8f-472f-96b2-d54ea8140daf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:22.867021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ed9fda3f-8a8f-472f-96b2-d54ea8140daf admin admin] The token cache is being invalidate because project 415f92d0a65741baae4c810488ef6257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:28:22.867312 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ed9fda3f-8a8f-472f-96b2-d54ea8140daf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:22.867986 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ed9fda3f-8a8f-472f-96b2-d54ea8140daf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:22.869588 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1382/2736] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:28:22 2022] DELETE /identity/v3/projects/415f92d0a65741baae4c810488ef6257 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:22.873599 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02609ba-c5c1-42ce-ab6a-ef232ef218fa service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:22.883853 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02609ba-c5c1-42ce-ab6a-ef232ef218fa service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:22.941321 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b478c91-e1fb-4393-b1e9-87d713f79a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:22.942194 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b478c91-e1fb-4393-b1e9-87d713f79a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:22.942500 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b478c91-e1fb-4393-b1e9-87d713f79a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:22.942775 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b478c91-e1fb-4393-b1e9-87d713f79a97 admin admin] PATH_INFO: `/v3/users/fd57f56e506b47df914ff2d1f975c3dc` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:22.943949 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b478c91-e1fb-4393-b1e9-87d713f79a97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd57f56e506b47df914ff2d1f975c3dc)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:22.945839 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b478c91-e1fb-4393-b1e9-87d713f79a97 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:23.160409 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6b478c91-e1fb-4393-b1e9-87d713f79a97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd57f56e506b47df914ff2d1f975c3dc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:23.161057 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6b478c91-e1fb-4393-b1e9-87d713f79a97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd57f56e506b47df914ff2d1f975c3dc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:23.172858 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6b478c91-e1fb-4393-b1e9-87d713f79a97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd57f56e506b47df914ff2d1f975c3dc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:23.173489 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6b478c91-e1fb-4393-b1e9-87d713f79a97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd57f56e506b47df914ff2d1f975c3dc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:23.180133 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-6b478c91-e1fb-4393-b1e9-87d713f79a97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd57f56e506b47df914ff2d1f975c3dc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:23.243873 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1355/2737] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:28:22 2022] DELETE /identity/v3/users/fd57f56e506b47df914ff2d1f975c3dc => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:23.645923 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fda3f-8a8f-472f-96b2-d54ea8140daf admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:23.647522 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ed9fda3f-8a8f-472f-96b2-d54ea8140daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:23.663829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fda3f-8a8f-472f-96b2-d54ea8140daf admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:23.720953 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c1ceb-35ba-45ec-ac32-d7b51da2fa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:23.721815 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c1ceb-35ba-45ec-ac32-d7b51da2fa7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:23.722104 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c1ceb-35ba-45ec-ac32-d7b51da2fa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:23.722381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c1ceb-35ba-45ec-ac32-d7b51da2fa7d admin admin] PATH_INFO: `/v3/projects/216e563c675b42b1a5aa1e4d305e43ea` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:23.723723 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c1ceb-35ba-45ec-ac32-d7b51da2fa7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=216e563c675b42b1a5aa1e4d305e43ea)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:23.725682 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c1ceb-35ba-45ec-ac32-d7b51da2fa7d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:23.804412 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5e9c1ceb-35ba-45ec-ac32-d7b51da2fa7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216e563c675b42b1a5aa1e4d305e43ea', 'request_id': 'req-5e9c1ceb-35ba-45ec-ac32-d7b51da2fa7d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:23.849546 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5e9c1ceb-35ba-45ec-ac32-d7b51da2fa7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216e563c675b42b1a5aa1e4d305e43ea', 'request_id': 'req-5e9c1ceb-35ba-45ec-ac32-d7b51da2fa7d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:23.855191 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5e9c1ceb-35ba-45ec-ac32-d7b51da2fa7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216e563c675b42b1a5aa1e4d305e43ea', 'request_id': 'req-5e9c1ceb-35ba-45ec-ac32-d7b51da2fa7d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:23.866792 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5e9c1ceb-35ba-45ec-ac32-d7b51da2fa7d admin admin] The token cache is being invalidate because project 216e563c675b42b1a5aa1e4d305e43ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:28:23.870089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5e9c1ceb-35ba-45ec-ac32-d7b51da2fa7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:23.870089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5e9c1ceb-35ba-45ec-ac32-d7b51da2fa7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:23.870089 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1383/2738] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:28:23 2022] DELETE /identity/v3/projects/216e563c675b42b1a5aa1e4d305e43ea => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:23.873333 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b478c91-e1fb-4393-b1e9-87d713f79a97 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:23.875030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-6b478c91-e1fb-4393-b1e9-87d713f79a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:23.887896 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b478c91-e1fb-4393-b1e9-87d713f79a97 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:23.942546 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7433c-45b7-48a9-81ad-5b8909d0d0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:23.943338 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7433c-45b7-48a9-81ad-5b8909d0d0db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:23.943616 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7433c-45b7-48a9-81ad-5b8909d0d0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:23.943884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7433c-45b7-48a9-81ad-5b8909d0d0db admin admin] PATH_INFO: `/v3/users/c3fe3cff93054fb1b69204692729f071` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:23.945052 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7433c-45b7-48a9-81ad-5b8909d0d0db admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3fe3cff93054fb1b69204692729f071)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:23.947230 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7433c-45b7-48a9-81ad-5b8909d0d0db admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:24.130878 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3ee7433c-45b7-48a9-81ad-5b8909d0d0db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3fe3cff93054fb1b69204692729f071'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:24.131520 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3ee7433c-45b7-48a9-81ad-5b8909d0d0db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3fe3cff93054fb1b69204692729f071'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:24.143825 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3ee7433c-45b7-48a9-81ad-5b8909d0d0db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3fe3cff93054fb1b69204692729f071'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:24.144445 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3ee7433c-45b7-48a9-81ad-5b8909d0d0db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3fe3cff93054fb1b69204692729f071'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:24.151035 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-3ee7433c-45b7-48a9-81ad-5b8909d0d0db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3fe3cff93054fb1b69204692729f071'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:24.232245 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1356/2739] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:28:23 2022] DELETE /identity/v3/users/c3fe3cff93054fb1b69204692729f071 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:24.634465 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c1ceb-35ba-45ec-ac32-d7b51da2fa7d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:24.636142 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5e9c1ceb-35ba-45ec-ac32-d7b51da2fa7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:24.649272 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c1ceb-35ba-45ec-ac32-d7b51da2fa7d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:24.704239 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be43d75-bc39-4d55-b45e-6c43a382a6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:24.705093 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be43d75-bc39-4d55-b45e-6c43a382a6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:24.705374 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be43d75-bc39-4d55-b45e-6c43a382a6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:24.705675 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be43d75-bc39-4d55-b45e-6c43a382a6a8 admin admin] PATH_INFO: `/v3/projects/b0d9b0da407847478e0876fb21696fc2` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:24.706867 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be43d75-bc39-4d55-b45e-6c43a382a6a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d9b0da407847478e0876fb21696fc2)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:24.708768 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be43d75-bc39-4d55-b45e-6c43a382a6a8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:24.804188 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5be43d75-bc39-4d55-b45e-6c43a382a6a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d9b0da407847478e0876fb21696fc2', 'request_id': 'req-5be43d75-bc39-4d55-b45e-6c43a382a6a8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:24.861694 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5be43d75-bc39-4d55-b45e-6c43a382a6a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d9b0da407847478e0876fb21696fc2', 'request_id': 'req-5be43d75-bc39-4d55-b45e-6c43a382a6a8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:24.867931 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5be43d75-bc39-4d55-b45e-6c43a382a6a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d9b0da407847478e0876fb21696fc2', 'request_id': 'req-5be43d75-bc39-4d55-b45e-6c43a382a6a8'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:24.879066 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5be43d75-bc39-4d55-b45e-6c43a382a6a8 admin admin] The token cache is being invalidate because project b0d9b0da407847478e0876fb21696fc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:28:24.879352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5be43d75-bc39-4d55-b45e-6c43a382a6a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:24.879988 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5be43d75-bc39-4d55-b45e-6c43a382a6a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:24.881548 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1384/2740] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:28:24 2022] DELETE /identity/v3/projects/b0d9b0da407847478e0876fb21696fc2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:24.886669 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23931996-8f18-473c-85bc-330a94fc4582 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:24.887142 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23931996-8f18-473c-85bc-330a94fc4582 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:24.887241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23931996-8f18-473c-85bc-330a94fc4582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:24.906092 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-23931996-8f18-473c-85bc-330a94fc4582 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:24.907311 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-23931996-8f18-473c-85bc-330a94fc4582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:24.964348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1357/2741] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:24.973760 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cadf58-bb1c-4f3e-ad75-98e8a393526d None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:24.974054 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cadf58-bb1c-4f3e-ad75-98e8a393526d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:24.974336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cadf58-bb1c-4f3e-ad75-98e8a393526d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:24.992402 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-13cadf58-bb1c-4f3e-ad75-98e8a393526d None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:24.993610 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-13cadf58-bb1c-4f3e-ad75-98e8a393526d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:25.001795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1385/2742] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:25.006175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23931996-8f18-473c-85bc-330a94fc4582 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:25.016771 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23931996-8f18-473c-85bc-330a94fc4582 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:25.021301 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e858c44-c2ce-444d-ab04-4edbb75aabb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:25.021957 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e858c44-c2ce-444d-ab04-4edbb75aabb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:25.022241 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e858c44-c2ce-444d-ab04-4edbb75aabb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:25.022553 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e858c44-c2ce-444d-ab04-4edbb75aabb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:25.023285 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e858c44-c2ce-444d-ab04-4edbb75aabb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:28:25.023596 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e858c44-c2ce-444d-ab04-4edbb75aabb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:25.025200 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e858c44-c2ce-444d-ab04-4edbb75aabb5 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:25.037330 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1358/2743] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:28:25.041805 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cadf58-bb1c-4f3e-ad75-98e8a393526d None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:25.051757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cadf58-bb1c-4f3e-ad75-98e8a393526d None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:25.056377 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad48e3-4d4d-4f7e-b90a-84b5df292e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:25.056959 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad48e3-4d4d-4f7e-b90a-84b5df292e42 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:25.057241 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad48e3-4d4d-4f7e-b90a-84b5df292e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:25.057514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad48e3-4d4d-4f7e-b90a-84b5df292e42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:25.058201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad48e3-4d4d-4f7e-b90a-84b5df292e42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:25.060254 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad48e3-4d4d-4f7e-b90a-84b5df292e42 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:25.159466 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1386/2744] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:28:25 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:28:25.163531 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e858c44-c2ce-444d-ab04-4edbb75aabb5 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:25.174259 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e858c44-c2ce-444d-ab04-4edbb75aabb5 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:25.228138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4f1b9-ca45-4665-9e79-7eaf7564a777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:25.228808 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4f1b9-ca45-4665-9e79-7eaf7564a777 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:25.229092 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4f1b9-ca45-4665-9e79-7eaf7564a777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:25.229368 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4f1b9-ca45-4665-9e79-7eaf7564a777 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:25.230064 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4f1b9-ca45-4665-9e79-7eaf7564a777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:25.232003 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4f1b9-ca45-4665-9e79-7eaf7564a777 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:25.333665 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1359/2745] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:28:25 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:28:25.334836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad48e3-4d4d-4f7e-b90a-84b5df292e42 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:25.345549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad48e3-4d4d-4f7e-b90a-84b5df292e42 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:25.350197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a9f15-71ca-443b-81e0-2257c61f426e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:25.350943 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a9f15-71ca-443b-81e0-2257c61f426e admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:25.351167 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a9f15-71ca-443b-81e0-2257c61f426e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:25.351449 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a9f15-71ca-443b-81e0-2257c61f426e admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:25.352177 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a9f15-71ca-443b-81e0-2257c61f426e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:25.353759 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a9f15-71ca-443b-81e0-2257c61f426e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:25.364688 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1387/2746] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:28:25.368630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4f1b9-ca45-4665-9e79-7eaf7564a777 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:25.378628 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4f1b9-ca45-4665-9e79-7eaf7564a777 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:25.383548 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad388d-b6fd-4511-9f33-394ffa188fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:25.384214 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad388d-b6fd-4511-9f33-394ffa188fdb admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:25.387652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad388d-b6fd-4511-9f33-394ffa188fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:25.387652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad388d-b6fd-4511-9f33-394ffa188fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:25.387652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad388d-b6fd-4511-9f33-394ffa188fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:25.387652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad388d-b6fd-4511-9f33-394ffa188fdb admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:25.398490 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1360/2747] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:28:25.401886 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a9f15-71ca-443b-81e0-2257c61f426e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:25.415480 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a9f15-71ca-443b-81e0-2257c61f426e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:25.421185 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615791cd-a0a4-4801-b6b6-ec64b4c389f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:25.422073 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615791cd-a0a4-4801-b6b6-ec64b4c389f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:25.422504 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615791cd-a0a4-4801-b6b6-ec64b4c389f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:25.422820 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615791cd-a0a4-4801-b6b6-ec64b4c389f5 admin admin] PATH_INFO: `/v3/projects/15572e56d4a546f3894200515cf2c253/users/b7fffd42ed684488a5278e33340bab0c/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:25.441126 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615791cd-a0a4-4801-b6b6-ec64b4c389f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15572e56d4a546f3894200515cf2c253, user_id=b7fffd42ed684488a5278e33340bab0c, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:25.444064 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615791cd-a0a4-4801-b6b6-ec64b4c389f5 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:25.554047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1388/2748] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:28:25 2022] PUT /identity/v3/projects/15572e56d4a546f3894200515cf2c253/users/b7fffd42ed684488a5278e33340bab0c/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:25.565075 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718d8ff-bf38-4657-8dfb-9a0acaf84efa None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:25.565446 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718d8ff-bf38-4657-8dfb-9a0acaf84efa None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:25.565728 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718d8ff-bf38-4657-8dfb-9a0acaf84efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:25.592767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-5718d8ff-bf38-4657-8dfb-9a0acaf84efa None None] MFA Rules not processed for user `b7fffd42ed684488a5278e33340bab0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:25.593880 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-5718d8ff-bf38-4657-8dfb-9a0acaf84efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:25.657667 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1361/2749] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:25.670483 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615791cd-a0a4-4801-b6b6-ec64b4c389f5 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:25.677738 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-615791cd-a0a4-4801-b6b6-ec64b4c389f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:25.729352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615791cd-a0a4-4801-b6b6-ec64b4c389f5 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:25.733821 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155e7dd-cbf7-4b64-b90f-fc37496c404e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:25.734502 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155e7dd-cbf7-4b64-b90f-fc37496c404e service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:25.734794 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155e7dd-cbf7-4b64-b90f-fc37496c404e service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:25.735076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155e7dd-cbf7-4b64-b90f-fc37496c404e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:25.743329 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155e7dd-cbf7-4b64-b90f-fc37496c404e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:25.744747 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155e7dd-cbf7-4b64-b90f-fc37496c404e service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:25.754998 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1389/2750] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:28:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:28:30.787223 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718d8ff-bf38-4657-8dfb-9a0acaf84efa None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:30.850621 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718d8ff-bf38-4657-8dfb-9a0acaf84efa None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:30.855465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984690a0-4a07-4596-878d-cbc66ce57e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:30.856353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984690a0-4a07-4596-878d-cbc66ce57e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:30.856632 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984690a0-4a07-4596-878d-cbc66ce57e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:30.856902 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984690a0-4a07-4596-878d-cbc66ce57e45 admin admin] PATH_INFO: `/v3/users/b7fffd42ed684488a5278e33340bab0c` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:30.858134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984690a0-4a07-4596-878d-cbc66ce57e45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7fffd42ed684488a5278e33340bab0c)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:30.860070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984690a0-4a07-4596-878d-cbc66ce57e45 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:31.052508 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-984690a0-4a07-4596-878d-cbc66ce57e45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7fffd42ed684488a5278e33340bab0c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:31.053247 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-984690a0-4a07-4596-878d-cbc66ce57e45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7fffd42ed684488a5278e33340bab0c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:31.065722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-984690a0-4a07-4596-878d-cbc66ce57e45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7fffd42ed684488a5278e33340bab0c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:31.066665 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-984690a0-4a07-4596-878d-cbc66ce57e45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7fffd42ed684488a5278e33340bab0c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:31.073162 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-984690a0-4a07-4596-878d-cbc66ce57e45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7fffd42ed684488a5278e33340bab0c'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:31.142095 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1362/2751] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:28:30 2022] DELETE /identity/v3/users/b7fffd42ed684488a5278e33340bab0c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:31.149151 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde4f04-26b1-4e64-a70a-b491a442e1eb None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:31.149632 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde4f04-26b1-4e64-a70a-b491a442e1eb None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:31.149728 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde4f04-26b1-4e64-a70a-b491a442e1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:31.167514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7bde4f04-26b1-4e64-a70a-b491a442e1eb None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:31.168736 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7bde4f04-26b1-4e64-a70a-b491a442e1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:31.226629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1390/2752] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:31.236811 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984690a0-4a07-4596-878d-cbc66ce57e45 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:31.238335 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-984690a0-4a07-4596-878d-cbc66ce57e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:31.297126 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984690a0-4a07-4596-878d-cbc66ce57e45 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:31.300780 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef234ca-5bc5-4972-bcfe-69bdde4eecb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:31.301429 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef234ca-5bc5-4972-bcfe-69bdde4eecb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:31.301706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef234ca-5bc5-4972-bcfe-69bdde4eecb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:31.301976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef234ca-5bc5-4972-bcfe-69bdde4eecb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:31.311396 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef234ca-5bc5-4972-bcfe-69bdde4eecb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:31.313005 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef234ca-5bc5-4972-bcfe-69bdde4eecb0 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:31.322967 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1363/2753] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:28:31.754615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde4f04-26b1-4e64-a70a-b491a442e1eb None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:31.756040 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7bde4f04-26b1-4e64-a70a-b491a442e1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:31.769151 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde4f04-26b1-4e64-a70a-b491a442e1eb None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:31.774018 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04d7c1-fc63-4dd6-a19b-a768ae847396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:31.775022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04d7c1-fc63-4dd6-a19b-a768ae847396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:31.775614 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04d7c1-fc63-4dd6-a19b-a768ae847396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:31.775614 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04d7c1-fc63-4dd6-a19b-a768ae847396 admin admin] PATH_INFO: `/v3/projects/15572e56d4a546f3894200515cf2c253` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:31.776779 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04d7c1-fc63-4dd6-a19b-a768ae847396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15572e56d4a546f3894200515cf2c253)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:31.778741 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04d7c1-fc63-4dd6-a19b-a768ae847396 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:31.861429 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-7e04d7c1-fc63-4dd6-a19b-a768ae847396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15572e56d4a546f3894200515cf2c253', 'request_id': 'req-7e04d7c1-fc63-4dd6-a19b-a768ae847396'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:31.924526 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-7e04d7c1-fc63-4dd6-a19b-a768ae847396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15572e56d4a546f3894200515cf2c253', 'request_id': 'req-7e04d7c1-fc63-4dd6-a19b-a768ae847396'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:31.930296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-7e04d7c1-fc63-4dd6-a19b-a768ae847396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15572e56d4a546f3894200515cf2c253', 'request_id': 'req-7e04d7c1-fc63-4dd6-a19b-a768ae847396'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:31.941369 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-7e04d7c1-fc63-4dd6-a19b-a768ae847396 admin admin] The token cache is being invalidate because project 15572e56d4a546f3894200515cf2c253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:28:31.941618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-7e04d7c1-fc63-4dd6-a19b-a768ae847396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:31.942271 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-7e04d7c1-fc63-4dd6-a19b-a768ae847396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:31.943859 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1391/2754] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:28:31 2022] DELETE /identity/v3/projects/15572e56d4a546f3894200515cf2c253 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:37.102307 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef234ca-5bc5-4972-bcfe-69bdde4eecb0 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:37.103801 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-3ef234ca-5bc5-4972-bcfe-69bdde4eecb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:37.117365 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef234ca-5bc5-4972-bcfe-69bdde4eecb0 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:37.174036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1bf6a-83fa-46fa-a9d8-ea978a0859ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:37.175019 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1bf6a-83fa-46fa-a9d8-ea978a0859ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:37.175306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1bf6a-83fa-46fa-a9d8-ea978a0859ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:37.175584 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1bf6a-83fa-46fa-a9d8-ea978a0859ae admin admin] PATH_INFO: `/v3/users/33416170a6eb4b298aa3499cb963b9dc` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:37.176808 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1bf6a-83fa-46fa-a9d8-ea978a0859ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=33416170a6eb4b298aa3499cb963b9dc)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:37.178738 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1bf6a-83fa-46fa-a9d8-ea978a0859ae admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:37.354741 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-0cc1bf6a-83fa-46fa-a9d8-ea978a0859ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33416170a6eb4b298aa3499cb963b9dc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:37.355390 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-0cc1bf6a-83fa-46fa-a9d8-ea978a0859ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33416170a6eb4b298aa3499cb963b9dc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:37.367436 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-0cc1bf6a-83fa-46fa-a9d8-ea978a0859ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33416170a6eb4b298aa3499cb963b9dc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:37.374634 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-0cc1bf6a-83fa-46fa-a9d8-ea978a0859ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33416170a6eb4b298aa3499cb963b9dc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:37.375356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-0cc1bf6a-83fa-46fa-a9d8-ea978a0859ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33416170a6eb4b298aa3499cb963b9dc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:37.472413 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1364/2755] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:28:37 2022] DELETE /identity/v3/users/33416170a6eb4b298aa3499cb963b9dc => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:37.675101 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04d7c1-fc63-4dd6-a19b-a768ae847396 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:37.676597 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7e04d7c1-fc63-4dd6-a19b-a768ae847396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:37.692353 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04d7c1-fc63-4dd6-a19b-a768ae847396 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:37.751290 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabb679-dcf0-458a-a0a5-8c33a54304e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:37.752158 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabb679-dcf0-458a-a0a5-8c33a54304e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:37.752446 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabb679-dcf0-458a-a0a5-8c33a54304e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:37.752722 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabb679-dcf0-458a-a0a5-8c33a54304e1 admin admin] PATH_INFO: `/v3/projects/ace80814ab4643209f4cd44d31267fd3` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:37.753899 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabb679-dcf0-458a-a0a5-8c33a54304e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace80814ab4643209f4cd44d31267fd3)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:37.755818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabb679-dcf0-458a-a0a5-8c33a54304e1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:37.833253 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-cdabb679-dcf0-458a-a0a5-8c33a54304e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace80814ab4643209f4cd44d31267fd3', 'request_id': 'req-cdabb679-dcf0-458a-a0a5-8c33a54304e1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:37.878892 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-cdabb679-dcf0-458a-a0a5-8c33a54304e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace80814ab4643209f4cd44d31267fd3', 'request_id': 'req-cdabb679-dcf0-458a-a0a5-8c33a54304e1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:37.884855 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-cdabb679-dcf0-458a-a0a5-8c33a54304e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace80814ab4643209f4cd44d31267fd3', 'request_id': 'req-cdabb679-dcf0-458a-a0a5-8c33a54304e1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:37.897524 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-cdabb679-dcf0-458a-a0a5-8c33a54304e1 admin admin] The token cache is being invalidate because project ace80814ab4643209f4cd44d31267fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:28:37.897875 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-cdabb679-dcf0-458a-a0a5-8c33a54304e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:37.898673 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-cdabb679-dcf0-458a-a0a5-8c33a54304e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:37.900329 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1392/2756] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:28:37 2022] DELETE /identity/v3/projects/ace80814ab4643209f4cd44d31267fd3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:37.904277 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1bf6a-83fa-46fa-a9d8-ea978a0859ae admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:37.905870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-0cc1bf6a-83fa-46fa-a9d8-ea978a0859ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:37.918476 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1bf6a-83fa-46fa-a9d8-ea978a0859ae admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:37.975846 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22e4c9-3bfc-4c29-8325-180f38ccc30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:37.978256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22e4c9-3bfc-4c29-8325-180f38ccc30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:37.978256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22e4c9-3bfc-4c29-8325-180f38ccc30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:37.978256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22e4c9-3bfc-4c29-8325-180f38ccc30d admin admin] PATH_INFO: `/v3/users/0ebb91e51a5e4e62aa168ace22bcef91` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:37.978796 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22e4c9-3bfc-4c29-8325-180f38ccc30d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ebb91e51a5e4e62aa168ace22bcef91)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:37.980725 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22e4c9-3bfc-4c29-8325-180f38ccc30d admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:38.182542 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-ef22e4c9-3bfc-4c29-8325-180f38ccc30d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ebb91e51a5e4e62aa168ace22bcef91'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:38.183216 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-ef22e4c9-3bfc-4c29-8325-180f38ccc30d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ebb91e51a5e4e62aa168ace22bcef91'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:38.194722 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-ef22e4c9-3bfc-4c29-8325-180f38ccc30d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ebb91e51a5e4e62aa168ace22bcef91'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:38.195369 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-ef22e4c9-3bfc-4c29-8325-180f38ccc30d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ebb91e51a5e4e62aa168ace22bcef91'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:38.202655 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-ef22e4c9-3bfc-4c29-8325-180f38ccc30d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ebb91e51a5e4e62aa168ace22bcef91'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:38.306923 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1365/2757] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:28:37 2022] DELETE /identity/v3/users/0ebb91e51a5e4e62aa168ace22bcef91 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:38.554069 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabb679-dcf0-458a-a0a5-8c33a54304e1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:38.555543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-cdabb679-dcf0-458a-a0a5-8c33a54304e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:38.568361 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabb679-dcf0-458a-a0a5-8c33a54304e1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:38.627721 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e0278-1db2-4adc-aec3-93ac10586fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:38.628584 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e0278-1db2-4adc-aec3-93ac10586fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:38.628871 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e0278-1db2-4adc-aec3-93ac10586fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:38.629149 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e0278-1db2-4adc-aec3-93ac10586fd6 admin admin] PATH_INFO: `/v3/projects/ecff0e786dc145cebfe45617e1595dd6` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:38.630484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e0278-1db2-4adc-aec3-93ac10586fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecff0e786dc145cebfe45617e1595dd6)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:38.632415 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e0278-1db2-4adc-aec3-93ac10586fd6 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:38.765709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-554e0278-1db2-4adc-aec3-93ac10586fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecff0e786dc145cebfe45617e1595dd6', 'request_id': 'req-554e0278-1db2-4adc-aec3-93ac10586fd6'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:38.832990 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-554e0278-1db2-4adc-aec3-93ac10586fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecff0e786dc145cebfe45617e1595dd6', 'request_id': 'req-554e0278-1db2-4adc-aec3-93ac10586fd6'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:38.840215 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-554e0278-1db2-4adc-aec3-93ac10586fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecff0e786dc145cebfe45617e1595dd6', 'request_id': 'req-554e0278-1db2-4adc-aec3-93ac10586fd6'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:38.855337 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-554e0278-1db2-4adc-aec3-93ac10586fd6 admin admin] The token cache is being invalidate because project ecff0e786dc145cebfe45617e1595dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:28:38.855630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-554e0278-1db2-4adc-aec3-93ac10586fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:38.856299 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-554e0278-1db2-4adc-aec3-93ac10586fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:38.858004 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1393/2758] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:28:38 2022] DELETE /identity/v3/projects/ecff0e786dc145cebfe45617e1595dd6 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:38.863215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d745e1-9f63-4a79-84ea-43c6713e61fa None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:38.863519 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d745e1-9f63-4a79-84ea-43c6713e61fa None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:38.863803 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d745e1-9f63-4a79-84ea-43c6713e61fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:38.883534 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-88d745e1-9f63-4a79-84ea-43c6713e61fa None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:38.884754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-88d745e1-9f63-4a79-84ea-43c6713e61fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:38.945678 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1366/2759] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:38.955173 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b29aa-48bb-47c8-b99f-75740ea58eb9 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:38.955463 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b29aa-48bb-47c8-b99f-75740ea58eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:38.955742 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b29aa-48bb-47c8-b99f-75740ea58eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:38.973456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f61b29aa-48bb-47c8-b99f-75740ea58eb9 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:38.974682 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f61b29aa-48bb-47c8-b99f-75740ea58eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:38.982535 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1394/2760] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:38.986878 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d745e1-9f63-4a79-84ea-43c6713e61fa None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:38.996324 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d745e1-9f63-4a79-84ea-43c6713e61fa None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:39.002123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50df06-be97-4dab-be23-9cf313329803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:39.002426 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50df06-be97-4dab-be23-9cf313329803 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:39.002851 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50df06-be97-4dab-be23-9cf313329803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:39.003121 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50df06-be97-4dab-be23-9cf313329803 admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:39.003843 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50df06-be97-4dab-be23-9cf313329803 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:28:39.004144 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50df06-be97-4dab-be23-9cf313329803 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:39.005763 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50df06-be97-4dab-be23-9cf313329803 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:39.018727 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1367/2761] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:28:39.022762 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b29aa-48bb-47c8-b99f-75740ea58eb9 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:39.032185 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b29aa-48bb-47c8-b99f-75740ea58eb9 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:39.036978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829a9d1-a303-4623-b917-ff125bcb43b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:39.037731 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829a9d1-a303-4623-b917-ff125bcb43b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:39.038105 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829a9d1-a303-4623-b917-ff125bcb43b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:39.038386 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829a9d1-a303-4623-b917-ff125bcb43b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:39.039131 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829a9d1-a303-4623-b917-ff125bcb43b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:39.041075 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829a9d1-a303-4623-b917-ff125bcb43b4 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:39.177222 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1395/2762] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:28:39 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:28:39.181414 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50df06-be97-4dab-be23-9cf313329803 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:39.192287 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50df06-be97-4dab-be23-9cf313329803 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:39.246570 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52946c5-b7a7-4c93-bfc1-dc621a264b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:39.247267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52946c5-b7a7-4c93-bfc1-dc621a264b6c admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:39.247549 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52946c5-b7a7-4c93-bfc1-dc621a264b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:39.247829 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52946c5-b7a7-4c93-bfc1-dc621a264b6c admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:39.249145 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52946c5-b7a7-4c93-bfc1-dc621a264b6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:39.251081 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52946c5-b7a7-4c93-bfc1-dc621a264b6c admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:39.353091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1368/2763] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:28:39 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:28:39.357110 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829a9d1-a303-4623-b917-ff125bcb43b4 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:39.371514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829a9d1-a303-4623-b917-ff125bcb43b4 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:39.378106 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a2a9b-3bc6-4edd-9257-6d728b6a2973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:39.378551 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a2a9b-3bc6-4edd-9257-6d728b6a2973 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:39.378839 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a2a9b-3bc6-4edd-9257-6d728b6a2973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:39.380910 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a2a9b-3bc6-4edd-9257-6d728b6a2973 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:39.380910 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a2a9b-3bc6-4edd-9257-6d728b6a2973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:39.381635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a2a9b-3bc6-4edd-9257-6d728b6a2973 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:39.392982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1396/2764] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:28:39.397114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52946c5-b7a7-4c93-bfc1-dc621a264b6c admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:39.407745 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52946c5-b7a7-4c93-bfc1-dc621a264b6c admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:39.412664 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353138e3-2763-4e74-8611-8d0655f410fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:39.413386 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353138e3-2763-4e74-8611-8d0655f410fa admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:39.413733 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353138e3-2763-4e74-8611-8d0655f410fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:39.414271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353138e3-2763-4e74-8611-8d0655f410fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:39.430665 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353138e3-2763-4e74-8611-8d0655f410fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:39.430665 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353138e3-2763-4e74-8611-8d0655f410fa admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:39.430665 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1369/2765] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:28:39.431696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a2a9b-3bc6-4edd-9257-6d728b6a2973 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:39.442424 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a2a9b-3bc6-4edd-9257-6d728b6a2973 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:39.447313 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560263f7-5d37-4d30-a605-1fe8b85131f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:39.448168 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560263f7-5d37-4d30-a605-1fe8b85131f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:39.448461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560263f7-5d37-4d30-a605-1fe8b85131f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:39.451709 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560263f7-5d37-4d30-a605-1fe8b85131f8 admin admin] PATH_INFO: `/v3/projects/799642d036984b02b987fc2371cc65a2/users/e65e06849c8c4d4c828ed51e1c058ed2/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:39.462952 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560263f7-5d37-4d30-a605-1fe8b85131f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=799642d036984b02b987fc2371cc65a2, user_id=e65e06849c8c4d4c828ed51e1c058ed2, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:39.465568 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560263f7-5d37-4d30-a605-1fe8b85131f8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:39.524968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1397/2766] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:28:39 2022] PUT /identity/v3/projects/799642d036984b02b987fc2371cc65a2/users/e65e06849c8c4d4c828ed51e1c058ed2/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:39.536648 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0f753-9cc5-49d6-9a41-4b87bdbdeec3 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:39.536941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0f753-9cc5-49d6-9a41-4b87bdbdeec3 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:39.537220 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0f753-9cc5-49d6-9a41-4b87bdbdeec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:39.565114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-99d0f753-9cc5-49d6-9a41-4b87bdbdeec3 None None] MFA Rules not processed for user `e65e06849c8c4d4c828ed51e1c058ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:39.566312 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-99d0f753-9cc5-49d6-9a41-4b87bdbdeec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:39.628033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1370/2767] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:39.632542 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560263f7-5d37-4d30-a605-1fe8b85131f8 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:39.691394 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560263f7-5d37-4d30-a605-1fe8b85131f8 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:39.695990 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10578811-ed7f-4ea2-a2a7-791e2ac9c487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:39.696646 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10578811-ed7f-4ea2-a2a7-791e2ac9c487 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:39.697066 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10578811-ed7f-4ea2-a2a7-791e2ac9c487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:39.697353 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10578811-ed7f-4ea2-a2a7-791e2ac9c487 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:39.698060 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10578811-ed7f-4ea2-a2a7-791e2ac9c487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:39.700007 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10578811-ed7f-4ea2-a2a7-791e2ac9c487 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:39.801167 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1398/2768] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:28:39 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:28:39.805165 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0f753-9cc5-49d6-9a41-4b87bdbdeec3 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:39.816574 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0f753-9cc5-49d6-9a41-4b87bdbdeec3 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:39.874669 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659145c5-0444-47e2-845a-ed736522edaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:39.875346 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659145c5-0444-47e2-845a-ed736522edaf admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:39.875630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659145c5-0444-47e2-845a-ed736522edaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:39.875913 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659145c5-0444-47e2-845a-ed736522edaf admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:39.876596 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659145c5-0444-47e2-845a-ed736522edaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:39.878592 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659145c5-0444-47e2-845a-ed736522edaf admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:39.970348 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1371/2769] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:28:39 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:28:39.974406 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10578811-ed7f-4ea2-a2a7-791e2ac9c487 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:39.985095 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10578811-ed7f-4ea2-a2a7-791e2ac9c487 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:39.989674 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4736354-7731-4a3f-86a6-efaa114ff97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:39.990330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4736354-7731-4a3f-86a6-efaa114ff97e admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:39.990652 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4736354-7731-4a3f-86a6-efaa114ff97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:39.990988 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4736354-7731-4a3f-86a6-efaa114ff97e admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:39.991786 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4736354-7731-4a3f-86a6-efaa114ff97e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:39.993372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4736354-7731-4a3f-86a6-efaa114ff97e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:40.005245 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1399/2770] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:28:40.009293 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659145c5-0444-47e2-845a-ed736522edaf admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:40.019926 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659145c5-0444-47e2-845a-ed736522edaf admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:40.024626 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbacc9-61d2-4597-9372-7b56e6b36c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:40.025501 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbacc9-61d2-4597-9372-7b56e6b36c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:40.025786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbacc9-61d2-4597-9372-7b56e6b36c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:40.026102 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbacc9-61d2-4597-9372-7b56e6b36c22 admin admin] PATH_INFO: `/v3/projects/80aed43aab7d4728bc30b40984c7217c/users/dfa3f4ccb15d44fab7c8f4e7652745d6/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:40.041323 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbacc9-61d2-4597-9372-7b56e6b36c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80aed43aab7d4728bc30b40984c7217c, user_id=dfa3f4ccb15d44fab7c8f4e7652745d6, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:40.043995 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbacc9-61d2-4597-9372-7b56e6b36c22 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:40.142298 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1372/2771] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:28:40 2022] PUT /identity/v3/projects/80aed43aab7d4728bc30b40984c7217c/users/dfa3f4ccb15d44fab7c8f4e7652745d6/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:40.146118 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4736354-7731-4a3f-86a6-efaa114ff97e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:40.156660 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4736354-7731-4a3f-86a6-efaa114ff97e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:40.211464 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d3064-8d9c-4781-b4bc-9329f98c0076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:40.212136 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d3064-8d9c-4781-b4bc-9329f98c0076 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:40.212419 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d3064-8d9c-4781-b4bc-9329f98c0076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:40.212698 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d3064-8d9c-4781-b4bc-9329f98c0076 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:40.213421 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d3064-8d9c-4781-b4bc-9329f98c0076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:40.215015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d3064-8d9c-4781-b4bc-9329f98c0076 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:40.225562 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1400/2772] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:28:40.229747 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbacc9-61d2-4597-9372-7b56e6b36c22 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:40.240143 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbacc9-61d2-4597-9372-7b56e6b36c22 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:40.244809 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778c409-0e59-4e49-9e76-769e6ab8da91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:40.245691 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778c409-0e59-4e49-9e76-769e6ab8da91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:40.245976 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778c409-0e59-4e49-9e76-769e6ab8da91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:40.246253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778c409-0e59-4e49-9e76-769e6ab8da91 admin admin] PATH_INFO: `/v3/projects/80aed43aab7d4728bc30b40984c7217c/users/dfa3f4ccb15d44fab7c8f4e7652745d6/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:40.248984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778c409-0e59-4e49-9e76-769e6ab8da91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80aed43aab7d4728bc30b40984c7217c, user_id=dfa3f4ccb15d44fab7c8f4e7652745d6, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:40.251663 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778c409-0e59-4e49-9e76-769e6ab8da91 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:40.261981 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1373/2773] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:28:40 2022] PUT /identity/v3/projects/80aed43aab7d4728bc30b40984c7217c/users/dfa3f4ccb15d44fab7c8f4e7652745d6/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:40.277107 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddda615-95fe-43cb-a644-8b63ce329262 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:40.277396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddda615-95fe-43cb-a644-8b63ce329262 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:40.277680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddda615-95fe-43cb-a644-8b63ce329262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:40.303247 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-4ddda615-95fe-43cb-a644-8b63ce329262 None None] MFA Rules not processed for user `dfa3f4ccb15d44fab7c8f4e7652745d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:40.304444 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4ddda615-95fe-43cb-a644-8b63ce329262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:40.369497 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1401/2774] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:40.381190 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778c409-0e59-4e49-9e76-769e6ab8da91 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:40.382942 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-3778c409-0e59-4e49-9e76-769e6ab8da91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:40.439481 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778c409-0e59-4e49-9e76-769e6ab8da91 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:40.443941 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44308b18-6a50-40f4-857a-17d63a9c394e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:40.444588 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44308b18-6a50-40f4-857a-17d63a9c394e service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:40.444872 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44308b18-6a50-40f4-857a-17d63a9c394e service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:40.445149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44308b18-6a50-40f4-857a-17d63a9c394e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:40.501290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44308b18-6a50-40f4-857a-17d63a9c394e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:40.502788 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44308b18-6a50-40f4-857a-17d63a9c394e service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:40.511870 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1374/2775] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:28:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:28:43.521800 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddda615-95fe-43cb-a644-8b63ce329262 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:43.523264 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4ddda615-95fe-43cb-a644-8b63ce329262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:43.589348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddda615-95fe-43cb-a644-8b63ce329262 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:43.594403 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a6499-25a6-4f2b-ad76-f8016ec504ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a13ad1e10ff44c4b870b45b7416b70f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:43.597662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a6499-25a6-4f2b-ad76-f8016ec504ab service placement] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:43.597662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a6499-25a6-4f2b-ad76-f8016ec504ab service placement] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:43.597662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a6499-25a6-4f2b-ad76-f8016ec504ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:43.597662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-140a6499-25a6-4f2b-ad76-f8016ec504ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:43.603321 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44308b18-6a50-40f4-857a-17d63a9c394e service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:43.609469 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a6499-25a6-4f2b-ad76-f8016ec504ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:43.611078 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a6499-25a6-4f2b-ad76-f8016ec504ab service placement] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:43.620966 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1402/2776] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:28:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:28:43.666952 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44308b18-6a50-40f4-857a-17d63a9c394e service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:43.672233 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2dde8c-6fae-48e7-a219-b9d14eb3d6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:43.673242 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2dde8c-6fae-48e7-a219-b9d14eb3d6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:43.673403 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2dde8c-6fae-48e7-a219-b9d14eb3d6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:43.673664 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2dde8c-6fae-48e7-a219-b9d14eb3d6bf admin admin] PATH_INFO: `/v3/users/e65e06849c8c4d4c828ed51e1c058ed2` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:43.674903 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2dde8c-6fae-48e7-a219-b9d14eb3d6bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e65e06849c8c4d4c828ed51e1c058ed2)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:43.676845 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2dde8c-6fae-48e7-a219-b9d14eb3d6bf admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:43.823257 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7a2dde8c-6fae-48e7-a219-b9d14eb3d6bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e65e06849c8c4d4c828ed51e1c058ed2'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:43.823910 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7a2dde8c-6fae-48e7-a219-b9d14eb3d6bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e65e06849c8c4d4c828ed51e1c058ed2'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:43.841088 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7a2dde8c-6fae-48e7-a219-b9d14eb3d6bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e65e06849c8c4d4c828ed51e1c058ed2'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:43.841088 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7a2dde8c-6fae-48e7-a219-b9d14eb3d6bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e65e06849c8c4d4c828ed51e1c058ed2'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:43.844988 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-7a2dde8c-6fae-48e7-a219-b9d14eb3d6bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e65e06849c8c4d4c828ed51e1c058ed2'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:43.981050 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1375/2777] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:28:43 2022] DELETE /identity/v3/users/e65e06849c8c4d4c828ed51e1c058ed2 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:28:43.986157 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3e72e-c4c4-4a74-ae8e-d478e5ad9b18 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:43.986475 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3e72e-c4c4-4a74-ae8e-d478e5ad9b18 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:43.986760 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3e72e-c4c4-4a74-ae8e-d478e5ad9b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:44.004082 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-07c3e72e-c4c4-4a74-ae8e-d478e5ad9b18 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:44.005256 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-07c3e72e-c4c4-4a74-ae8e-d478e5ad9b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:44.061213 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1403/2778] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:44.070929 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2dde8c-6fae-48e7-a219-b9d14eb3d6bf admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:44.072334 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-7a2dde8c-6fae-48e7-a219-b9d14eb3d6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:44.130130 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2dde8c-6fae-48e7-a219-b9d14eb3d6bf admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:44.133817 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e35624-7d60-4d2e-ae9f-29024c15f317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:44.134515 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e35624-7d60-4d2e-ae9f-29024c15f317 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:44.134805 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e35624-7d60-4d2e-ae9f-29024c15f317 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:44.135331 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e35624-7d60-4d2e-ae9f-29024c15f317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:44.146535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e35624-7d60-4d2e-ae9f-29024c15f317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:44.147971 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e35624-7d60-4d2e-ae9f-29024c15f317 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:44.157461 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1376/2779] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:28:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:28:44.566949 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3e72e-c4c4-4a74-ae8e-d478e5ad9b18 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:44.568378 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-07c3e72e-c4c4-4a74-ae8e-d478e5ad9b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:44.581925 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3e72e-c4c4-4a74-ae8e-d478e5ad9b18 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:44.592431 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291447dd-7509-489d-9390-ea133161d8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:44.592739 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291447dd-7509-489d-9390-ea133161d8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:44.593020 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291447dd-7509-489d-9390-ea133161d8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:44.593389 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291447dd-7509-489d-9390-ea133161d8a3 admin admin] PATH_INFO: `/v3/projects/799642d036984b02b987fc2371cc65a2` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:44.594808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291447dd-7509-489d-9390-ea133161d8a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=799642d036984b02b987fc2371cc65a2)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:44.596663 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291447dd-7509-489d-9390-ea133161d8a3 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:44.680480 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-291447dd-7509-489d-9390-ea133161d8a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '799642d036984b02b987fc2371cc65a2', 'request_id': 'req-291447dd-7509-489d-9390-ea133161d8a3'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:44.741483 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-291447dd-7509-489d-9390-ea133161d8a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '799642d036984b02b987fc2371cc65a2', 'request_id': 'req-291447dd-7509-489d-9390-ea133161d8a3'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:44.747527 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-291447dd-7509-489d-9390-ea133161d8a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '799642d036984b02b987fc2371cc65a2', 'request_id': 'req-291447dd-7509-489d-9390-ea133161d8a3'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:44.759219 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-291447dd-7509-489d-9390-ea133161d8a3 admin admin] The token cache is being invalidate because project 799642d036984b02b987fc2371cc65a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:28:44.759506 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-291447dd-7509-489d-9390-ea133161d8a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:44.760396 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-291447dd-7509-489d-9390-ea133161d8a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:44.761968 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1404/2780] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:28:44 2022] DELETE /identity/v3/projects/799642d036984b02b987fc2371cc65a2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:44.765992 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e35624-7d60-4d2e-ae9f-29024c15f317 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:44.775472 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e35624-7d60-4d2e-ae9f-29024c15f317 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:44.831728 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbd938-e091-4f0f-b95e-8c164434691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:44.832600 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbd938-e091-4f0f-b95e-8c164434691e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:44.832884 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbd938-e091-4f0f-b95e-8c164434691e admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:44.833162 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbd938-e091-4f0f-b95e-8c164434691e admin admin] PATH_INFO: `/v3/users/dfa3f4ccb15d44fab7c8f4e7652745d6` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:44.834336 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbd938-e091-4f0f-b95e-8c164434691e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa3f4ccb15d44fab7c8f4e7652745d6)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:44.836271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbd938-e091-4f0f-b95e-8c164434691e admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:45.023532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c0bbd938-e091-4f0f-b95e-8c164434691e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa3f4ccb15d44fab7c8f4e7652745d6'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:45.024180 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c0bbd938-e091-4f0f-b95e-8c164434691e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa3f4ccb15d44fab7c8f4e7652745d6'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:45.036135 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c0bbd938-e091-4f0f-b95e-8c164434691e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa3f4ccb15d44fab7c8f4e7652745d6'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:45.036760 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c0bbd938-e091-4f0f-b95e-8c164434691e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa3f4ccb15d44fab7c8f4e7652745d6'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:45.043378 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-c0bbd938-e091-4f0f-b95e-8c164434691e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa3f4ccb15d44fab7c8f4e7652745d6'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:45.100927 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1377/2781] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:28:44 2022] DELETE /identity/v3/users/dfa3f4ccb15d44fab7c8f4e7652745d6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:45.508593 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291447dd-7509-489d-9390-ea133161d8a3 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:45.510032 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-291447dd-7509-489d-9390-ea133161d8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:45.524055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291447dd-7509-489d-9390-ea133161d8a3 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:45.580403 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff0e85-107c-4180-94b4-4a1856dc1fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:45.581296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff0e85-107c-4180-94b4-4a1856dc1fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:45.581581 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff0e85-107c-4180-94b4-4a1856dc1fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:45.581858 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff0e85-107c-4180-94b4-4a1856dc1fe6 admin admin] PATH_INFO: `/v3/projects/80aed43aab7d4728bc30b40984c7217c` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:45.583061 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff0e85-107c-4180-94b4-4a1856dc1fe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80aed43aab7d4728bc30b40984c7217c)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:45.584928 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff0e85-107c-4180-94b4-4a1856dc1fe6 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:45.707024 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-02ff0e85-107c-4180-94b4-4a1856dc1fe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80aed43aab7d4728bc30b40984c7217c', 'request_id': 'req-02ff0e85-107c-4180-94b4-4a1856dc1fe6'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:45.792443 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-02ff0e85-107c-4180-94b4-4a1856dc1fe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80aed43aab7d4728bc30b40984c7217c', 'request_id': 'req-02ff0e85-107c-4180-94b4-4a1856dc1fe6'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:45.799680 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-02ff0e85-107c-4180-94b4-4a1856dc1fe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80aed43aab7d4728bc30b40984c7217c', 'request_id': 'req-02ff0e85-107c-4180-94b4-4a1856dc1fe6'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:45.810566 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-02ff0e85-107c-4180-94b4-4a1856dc1fe6 admin admin] The token cache is being invalidate because project 80aed43aab7d4728bc30b40984c7217c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:28:45.810856 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-02ff0e85-107c-4180-94b4-4a1856dc1fe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:45.811497 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-02ff0e85-107c-4180-94b4-4a1856dc1fe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:28:45.813033 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1405/2782] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:28:45 2022] DELETE /identity/v3/projects/80aed43aab7d4728bc30b40984c7217c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:28:45.817809 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27767a63-3973-4d89-b478-9b00488c8265 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:45.818295 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27767a63-3973-4d89-b478-9b00488c8265 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:45.818406 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27767a63-3973-4d89-b478-9b00488c8265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:45.836256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-27767a63-3973-4d89-b478-9b00488c8265 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:45.837432 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-27767a63-3973-4d89-b478-9b00488c8265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:45.895155 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1378/2783] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:45.903947 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c2cc4-fccc-434c-af15-2f5e2033a833 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:45.904848 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c2cc4-fccc-434c-af15-2f5e2033a833 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:45.905133 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c2cc4-fccc-434c-af15-2f5e2033a833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:45.923127 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-c28c2cc4-fccc-434c-af15-2f5e2033a833 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:45.924320 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c28c2cc4-fccc-434c-af15-2f5e2033a833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:45.932353 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1406/2784] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:45.936755 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27767a63-3973-4d89-b478-9b00488c8265 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:45.946327 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27767a63-3973-4d89-b478-9b00488c8265 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:45.950917 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e326131-0a9f-4c14-b4a3-37566bbf7718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:45.952089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e326131-0a9f-4c14-b4a3-37566bbf7718 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:45.952371 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e326131-0a9f-4c14-b4a3-37566bbf7718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:45.952652 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e326131-0a9f-4c14-b4a3-37566bbf7718 admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:45.953374 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e326131-0a9f-4c14-b4a3-37566bbf7718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:28:45.953680 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e326131-0a9f-4c14-b4a3-37566bbf7718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:45.955280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e326131-0a9f-4c14-b4a3-37566bbf7718 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:45.966591 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1379/2785] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:28:45.971294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c2cc4-fccc-434c-af15-2f5e2033a833 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:45.980257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c2cc4-fccc-434c-af15-2f5e2033a833 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:45.985030 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca360b01-def0-4de2-b26c-439eb34328ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:45.985676 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca360b01-def0-4de2-b26c-439eb34328ef admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:45.985961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca360b01-def0-4de2-b26c-439eb34328ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:45.986240 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca360b01-def0-4de2-b26c-439eb34328ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:45.986985 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca360b01-def0-4de2-b26c-439eb34328ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:45.988855 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca360b01-def0-4de2-b26c-439eb34328ef admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:46.091400 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1407/2786] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:28:45 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:28:46.096055 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e326131-0a9f-4c14-b4a3-37566bbf7718 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:46.105694 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e326131-0a9f-4c14-b4a3-37566bbf7718 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:46.160120 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f79bf7-b49c-45f0-a4c0-4f34296ee8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:46.160789 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f79bf7-b49c-45f0-a4c0-4f34296ee8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:46.161073 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f79bf7-b49c-45f0-a4c0-4f34296ee8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:46.161350 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f79bf7-b49c-45f0-a4c0-4f34296ee8b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:46.162045 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f79bf7-b49c-45f0-a4c0-4f34296ee8b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:46.163979 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f79bf7-b49c-45f0-a4c0-4f34296ee8b7 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:46.272791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1380/2787] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:28:46 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:28:46.276854 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca360b01-def0-4de2-b26c-439eb34328ef admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:46.287749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca360b01-def0-4de2-b26c-439eb34328ef admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:46.292391 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94310e3e-5f8f-40d8-8508-794ae44f521a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:46.293050 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94310e3e-5f8f-40d8-8508-794ae44f521a admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:46.293338 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94310e3e-5f8f-40d8-8508-794ae44f521a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:46.293618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94310e3e-5f8f-40d8-8508-794ae44f521a admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:46.294343 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94310e3e-5f8f-40d8-8508-794ae44f521a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:46.296696 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94310e3e-5f8f-40d8-8508-794ae44f521a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:46.306864 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1408/2788] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:28:46.310753 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f79bf7-b49c-45f0-a4c0-4f34296ee8b7 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:46.320719 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f79bf7-b49c-45f0-a4c0-4f34296ee8b7 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:46.325418 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4438b6-4784-478a-8b8d-6cdebf3a9614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:46.326133 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4438b6-4784-478a-8b8d-6cdebf3a9614 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:46.326565 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4438b6-4784-478a-8b8d-6cdebf3a9614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:46.326854 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4438b6-4784-478a-8b8d-6cdebf3a9614 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:46.327596 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4438b6-4784-478a-8b8d-6cdebf3a9614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:46.329216 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4438b6-4784-478a-8b8d-6cdebf3a9614 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:46.338836 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1381/2789] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:28:46.343404 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94310e3e-5f8f-40d8-8508-794ae44f521a admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:46.353090 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94310e3e-5f8f-40d8-8508-794ae44f521a admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:46.358821 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b85f8c-c419-4264-a97c-26e312dc7407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:46.359705 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b85f8c-c419-4264-a97c-26e312dc7407 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:46.359994 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b85f8c-c419-4264-a97c-26e312dc7407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:46.360273 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b85f8c-c419-4264-a97c-26e312dc7407 admin admin] PATH_INFO: `/v3/projects/ea060bca7aa9440ba37d2093af6e9d16/users/ca75f3a5742c42e6a1ddeb117df6f01e/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:46.375863 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b85f8c-c419-4264-a97c-26e312dc7407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea060bca7aa9440ba37d2093af6e9d16, user_id=ca75f3a5742c42e6a1ddeb117df6f01e, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:46.378518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b85f8c-c419-4264-a97c-26e312dc7407 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:46.495494 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1409/2790] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:28:46 2022] PUT /identity/v3/projects/ea060bca7aa9440ba37d2093af6e9d16/users/ca75f3a5742c42e6a1ddeb117df6f01e/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:28:46.500603 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07896a3f-9a31-4dfd-a173-a4db74a6e3b5 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:46.500900 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07896a3f-9a31-4dfd-a173-a4db74a6e3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:46.501179 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07896a3f-9a31-4dfd-a173-a4db74a6e3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:46.519531 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-07896a3f-9a31-4dfd-a173-a4db74a6e3b5 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:46.520712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-07896a3f-9a31-4dfd-a173-a4db74a6e3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:46.579671 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1382/2791] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:46.589233 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b85f8c-c419-4264-a97c-26e312dc7407 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:46.590933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-31b85f8c-c419-4264-a97c-26e312dc7407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:46.646763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b85f8c-c419-4264-a97c-26e312dc7407 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:46.650377 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e3df8-85a9-493c-ae26-9824ed13dd7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:46.651050 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e3df8-85a9-493c-ae26-9824ed13dd7f service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:46.651330 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e3df8-85a9-493c-ae26-9824ed13dd7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:46.651602 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e3df8-85a9-493c-ae26-9824ed13dd7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:46.661221 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e3df8-85a9-493c-ae26-9824ed13dd7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:46.662658 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e3df8-85a9-493c-ae26-9824ed13dd7f service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:46.672295 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1410/2792] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:28:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:28:47.782514 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051172b-3f25-4b07-8609-1f5b4634f5cb None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:47.783086 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051172b-3f25-4b07-8609-1f5b4634f5cb None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:47.783086 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051172b-3f25-4b07-8609-1f5b4634f5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:47.810189 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-a051172b-3f25-4b07-8609-1f5b4634f5cb None None] MFA Rules not processed for user `ca75f3a5742c42e6a1ddeb117df6f01e`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:47.811654 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a051172b-3f25-4b07-8609-1f5b4634f5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:47.882676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1383/2793] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:47.904033 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e3df8-85a9-493c-ae26-9824ed13dd7f service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:47.905726 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fc4e3df8-85a9-493c-ae26-9824ed13dd7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:47.963023 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e3df8-85a9-493c-ae26-9824ed13dd7f service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:47.966976 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba889bbe-6adc-4da5-971a-3a1ddecae778 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:47.967616 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba889bbe-6adc-4da5-971a-3a1ddecae778 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:47.967902 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba889bbe-6adc-4da5-971a-3a1ddecae778 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:47.968179 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba889bbe-6adc-4da5-971a-3a1ddecae778 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:47.976380 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba889bbe-6adc-4da5-971a-3a1ddecae778 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:47.977797 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba889bbe-6adc-4da5-971a-3a1ddecae778 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:47.986593 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1411/2794] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:28:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:28:49.615108 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f2919-228a-41e2-9c2e-b2964e1d3ae0 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:49.615631 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f2919-228a-41e2-9c2e-b2964e1d3ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:49.615738 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f2919-228a-41e2-9c2e-b2964e1d3ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:49.633906 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-e49f2919-228a-41e2-9c2e-b2964e1d3ae0 None None] MFA Rules not processed for user `ca75f3a5742c42e6a1ddeb117df6f01e`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:49.635465 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e49f2919-228a-41e2-9c2e-b2964e1d3ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:49.643169 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1384/2795] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:28:52.655315 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263244d-5f83-4e63-a046-814bb2fbd1f5 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:52.655858 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263244d-5f83-4e63-a046-814bb2fbd1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:52.655858 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263244d-5f83-4e63-a046-814bb2fbd1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:52.672784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a263244d-5f83-4e63-a046-814bb2fbd1f5 None None] MFA Rules not processed for user `618beebad5b645c9a30632bd0677658e`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:28:52.673971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a263244d-5f83-4e63-a046-814bb2fbd1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:52.725374 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1412/2796] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:28:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:29:12.229075 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1d0b2-eb1a-45a3-ab44-91a58f50c30c None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:29:12.229592 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1d0b2-eb1a-45a3-ab44-91a58f50c30c None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:29:12.229706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1d0b2-eb1a-45a3-ab44-91a58f50c30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:29:12.247383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-14d1d0b2-eb1a-45a3-ab44-91a58f50c30c None None] MFA Rules not processed for user `ca75f3a5742c42e6a1ddeb117df6f01e`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:29:12.249342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-14d1d0b2-eb1a-45a3-ab44-91a58f50c30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:29:12.256163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1385/2797] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:29:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:29:42.963922 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb993ea3-ad46-4a51-a80c-4c3f9cfa7f40 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:29:42.964349 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb993ea3-ad46-4a51-a80c-4c3f9cfa7f40 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:29:42.964487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb993ea3-ad46-4a51-a80c-4c3f9cfa7f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:29:42.982762 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-cb993ea3-ad46-4a51-a80c-4c3f9cfa7f40 None None] MFA Rules not processed for user `c0fc3052af194b48b7ce036ff605ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:29:42.984012 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-cb993ea3-ad46-4a51-a80c-4c3f9cfa7f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:29:43.038201 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1413/2798] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 10 21:29:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:29:43.184387 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1d0b2-eb1a-45a3-ab44-91a58f50c30c None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:29:43.185781 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-14d1d0b2-eb1a-45a3-ab44-91a58f50c30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:29:43.255683 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1d0b2-eb1a-45a3-ab44-91a58f50c30c None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:29:43.260994 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121e390-a0d2-4b83-838d-d7d5f2eae321 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76040882d4374087bb7458fd8b5c1d8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:29:43.261643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121e390-a0d2-4b83-838d-d7d5f2eae321 service swift] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:29:43.261929 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121e390-a0d2-4b83-838d-d7d5f2eae321 service swift] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:29:43.262205 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121e390-a0d2-4b83-838d-d7d5f2eae321 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:29:43.271388 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121e390-a0d2-4b83-838d-d7d5f2eae321 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:29:43.272977 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121e390-a0d2-4b83-838d-d7d5f2eae321 service swift] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:29:43.280934 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1386/2799] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 10 21:29:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 21:29:59.998609 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb993ea3-ad46-4a51-a80c-4c3f9cfa7f40 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:00.000213 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-cb993ea3-ad46-4a51-a80c-4c3f9cfa7f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:00.015484 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb993ea3-ad46-4a51-a80c-4c3f9cfa7f40 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:00.020927 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3a564-bc7d-4b5b-9024-cbae7c4dbefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:00.021802 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3a564-bc7d-4b5b-9024-cbae7c4dbefd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:00.024599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3a564-bc7d-4b5b-9024-cbae7c4dbefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:00.024599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3a564-bc7d-4b5b-9024-cbae7c4dbefd admin admin] PATH_INFO: `/v3/users/618beebad5b645c9a30632bd0677658e` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:00.024599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3a564-bc7d-4b5b-9024-cbae7c4dbefd admin admin] RBAC: Authorizing `identity:delete_user(user_id=618beebad5b645c9a30632bd0677658e)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:00.025590 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3a564-bc7d-4b5b-9024-cbae7c4dbefd admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:00.193531 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-71d3a564-bc7d-4b5b-9024-cbae7c4dbefd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '618beebad5b645c9a30632bd0677658e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:00.194205 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-71d3a564-bc7d-4b5b-9024-cbae7c4dbefd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '618beebad5b645c9a30632bd0677658e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:00.194837 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-71d3a564-bc7d-4b5b-9024-cbae7c4dbefd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '618beebad5b645c9a30632bd0677658e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:00.206393 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-71d3a564-bc7d-4b5b-9024-cbae7c4dbefd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '618beebad5b645c9a30632bd0677658e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:00.212944 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-71d3a564-bc7d-4b5b-9024-cbae7c4dbefd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '618beebad5b645c9a30632bd0677658e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:00.282526 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1414/2800] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:29:59 2022] DELETE /identity/v3/users/618beebad5b645c9a30632bd0677658e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:30:00.536662 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121e390-a0d2-4b83-838d-d7d5f2eae321 service swift] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:00.547557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121e390-a0d2-4b83-838d-d7d5f2eae321 service swift] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:00.604539 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f983dad-bc53-4519-b578-43bc9b3d488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:00.605391 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f983dad-bc53-4519-b578-43bc9b3d488a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:00.605670 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f983dad-bc53-4519-b578-43bc9b3d488a admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:00.605942 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f983dad-bc53-4519-b578-43bc9b3d488a admin admin] PATH_INFO: `/v3/projects/95545f74981b44aeb69f246159088da1` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:00.607134 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f983dad-bc53-4519-b578-43bc9b3d488a admin admin] RBAC: Authorizing `identity:delete_project(project_id=95545f74981b44aeb69f246159088da1)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:00.609074 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f983dad-bc53-4519-b578-43bc9b3d488a admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:00.693792 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9f983dad-bc53-4519-b578-43bc9b3d488a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95545f74981b44aeb69f246159088da1', 'request_id': 'req-9f983dad-bc53-4519-b578-43bc9b3d488a'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:00.734020 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9f983dad-bc53-4519-b578-43bc9b3d488a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95545f74981b44aeb69f246159088da1', 'request_id': 'req-9f983dad-bc53-4519-b578-43bc9b3d488a'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:00.739636 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9f983dad-bc53-4519-b578-43bc9b3d488a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95545f74981b44aeb69f246159088da1', 'request_id': 'req-9f983dad-bc53-4519-b578-43bc9b3d488a'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:00.750212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9f983dad-bc53-4519-b578-43bc9b3d488a admin admin] The token cache is being invalidate because project 95545f74981b44aeb69f246159088da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:30:00.750538 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9f983dad-bc53-4519-b578-43bc9b3d488a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:00.751168 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9f983dad-bc53-4519-b578-43bc9b3d488a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:00.752695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1387/2801] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:30:00 2022] DELETE /identity/v3/projects/95545f74981b44aeb69f246159088da1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:30:00.758106 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f764a-808e-4d53-bec2-eb13887074d5 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:00.758398 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f764a-808e-4d53-bec2-eb13887074d5 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:00.758710 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f764a-808e-4d53-bec2-eb13887074d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:00.777504 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-875f764a-808e-4d53-bec2-eb13887074d5 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:30:00.778725 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-875f764a-808e-4d53-bec2-eb13887074d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:00.838722 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1415/2802] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:30:00.847253 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaedbd5-dae3-41ce-a990-f99e628b6a19 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:00.847603 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaedbd5-dae3-41ce-a990-f99e628b6a19 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:00.847998 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaedbd5-dae3-41ce-a990-f99e628b6a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:00.867608 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-8eaedbd5-dae3-41ce-a990-f99e628b6a19 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:30:00.868805 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-8eaedbd5-dae3-41ce-a990-f99e628b6a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:00.877110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1388/2803] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:30:00.881046 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f764a-808e-4d53-bec2-eb13887074d5 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:00.883224 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82901c7-1bb7-4f28-a73a-37cc410be643 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:00.883583 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82901c7-1bb7-4f28-a73a-37cc410be643 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:00.883930 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82901c7-1bb7-4f28-a73a-37cc410be643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:00.891254 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f764a-808e-4d53-bec2-eb13887074d5 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:00.896832 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b8164-8513-43cf-bf7f-a969eb274195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:00.897493 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b8164-8513-43cf-bf7f-a969eb274195 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:00.897784 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b8164-8513-43cf-bf7f-a969eb274195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:00.898065 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b8164-8513-43cf-bf7f-a969eb274195 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:00.898833 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b8164-8513-43cf-bf7f-a969eb274195 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:30:00.899150 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b8164-8513-43cf-bf7f-a969eb274195 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:00.900746 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b8164-8513-43cf-bf7f-a969eb274195 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:00.902232 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-a82901c7-1bb7-4f28-a73a-37cc410be643 None None] MFA Rules not processed for user `c0fc3052af194b48b7ce036ff605ff25`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:30:00.903485 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a82901c7-1bb7-4f28-a73a-37cc410be643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:00.912971 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1416/2804] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:30:00.917215 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b8164-8513-43cf-bf7f-a969eb274195 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:00.926995 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b8164-8513-43cf-bf7f-a969eb274195 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:00.931667 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83693b-b807-4644-9bb6-97eb9274ae8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:00.932296 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83693b-b807-4644-9bb6-97eb9274ae8b admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:00.932586 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83693b-b807-4644-9bb6-97eb9274ae8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:00.932868 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83693b-b807-4644-9bb6-97eb9274ae8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:00.933555 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83693b-b807-4644-9bb6-97eb9274ae8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:00.935447 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83693b-b807-4644-9bb6-97eb9274ae8b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:00.957593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1389/2805] 10.222.0.25 () {58 vars in 967 bytes} [Tue May 10 21:30:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:30:00.970089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82901c7-1bb7-4f28-a73a-37cc410be643 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:00.972356 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a82901c7-1bb7-4f28-a73a-37cc410be643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:01.015336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1417/2806] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:30:00 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:30:01.019894 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83693b-b807-4644-9bb6-97eb9274ae8b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:01.044047 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82901c7-1bb7-4f28-a73a-37cc410be643 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:01.078815 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83693b-b807-4644-9bb6-97eb9274ae8b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:01.084662 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e07077-6bb2-43a3-bd07-4375c7639dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:01.085335 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e07077-6bb2-43a3-bd07-4375c7639dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:01.085621 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e07077-6bb2-43a3-bd07-4375c7639dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:01.085901 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e07077-6bb2-43a3-bd07-4375c7639dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:01.086656 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e07077-6bb2-43a3-bd07-4375c7639dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:01.088553 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e07077-6bb2-43a3-bd07-4375c7639dd3 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:01.102873 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27de36-d547-497f-8ddf-a78c782c6397 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76040882d4374087bb7458fd8b5c1d8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:01.103529 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27de36-d547-497f-8ddf-a78c782c6397 service swift] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:01.103813 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27de36-d547-497f-8ddf-a78c782c6397 service swift] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:01.104093 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27de36-d547-497f-8ddf-a78c782c6397 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:01.158191 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27de36-d547-497f-8ddf-a78c782c6397 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:01.159841 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27de36-d547-497f-8ddf-a78c782c6397 service swift] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:01.167676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1390/2807] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 10 21:30:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 21:30:01.188535 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1418/2808] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:30:01 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:30:01.189751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27de36-d547-497f-8ddf-a78c782c6397 service swift] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:01.200909 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27de36-d547-497f-8ddf-a78c782c6397 service swift] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:01.205592 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec0dea-5328-4cd7-9df6-5383d64d46fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:01.207110 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec0dea-5328-4cd7-9df6-5383d64d46fc admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:01.207442 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec0dea-5328-4cd7-9df6-5383d64d46fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:01.207724 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec0dea-5328-4cd7-9df6-5383d64d46fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:01.208449 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec0dea-5328-4cd7-9df6-5383d64d46fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:01.210027 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec0dea-5328-4cd7-9df6-5383d64d46fc admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:01.219867 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1391/2809] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:30:01.224016 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e07077-6bb2-43a3-bd07-4375c7639dd3 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:01.233930 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e07077-6bb2-43a3-bd07-4375c7639dd3 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:01.238847 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f745176-bac5-4389-ab88-99ddee1f67d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:01.239502 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f745176-bac5-4389-ab88-99ddee1f67d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:01.239788 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f745176-bac5-4389-ab88-99ddee1f67d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:01.240067 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f745176-bac5-4389-ab88-99ddee1f67d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:01.240829 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f745176-bac5-4389-ab88-99ddee1f67d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:01.242451 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f745176-bac5-4389-ab88-99ddee1f67d7 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:01.252052 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1419/2810] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:30:01.256639 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec0dea-5328-4cd7-9df6-5383d64d46fc admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:01.266786 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec0dea-5328-4cd7-9df6-5383d64d46fc admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:01.272290 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfee09a-3d27-44d3-8b30-5307a01fea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:01.273182 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfee09a-3d27-44d3-8b30-5307a01fea11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:01.273470 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfee09a-3d27-44d3-8b30-5307a01fea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:01.273751 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfee09a-3d27-44d3-8b30-5307a01fea11 admin admin] PATH_INFO: `/v3/projects/419939c78a2449e6a958b430e0e14d04/users/efdf21c4f62e44cca32de43efd532418/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:01.293036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfee09a-3d27-44d3-8b30-5307a01fea11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=419939c78a2449e6a958b430e0e14d04, user_id=efdf21c4f62e44cca32de43efd532418, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:01.293036 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfee09a-3d27-44d3-8b30-5307a01fea11 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:01.386617 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1392/2811] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:30:01 2022] PUT /identity/v3/projects/419939c78a2449e6a958b430e0e14d04/users/efdf21c4f62e44cca32de43efd532418/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:30:01.391826 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54969252-1b5d-432f-a4ad-622ea66dcf5b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:01.392128 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54969252-1b5d-432f-a4ad-622ea66dcf5b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:01.392410 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54969252-1b5d-432f-a4ad-622ea66dcf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:01.413838 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-54969252-1b5d-432f-a4ad-622ea66dcf5b None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:30:01.413838 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-54969252-1b5d-432f-a4ad-622ea66dcf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:01.471272 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1420/2812] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:30:01.480690 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfee09a-3d27-44d3-8b30-5307a01fea11 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:01.482377 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-9dfee09a-3d27-44d3-8b30-5307a01fea11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:01.542129 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfee09a-3d27-44d3-8b30-5307a01fea11 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:01.545730 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ae4bc-3102-40f2-9bc7-6bb15d821ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:01.546377 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ae4bc-3102-40f2-9bc7-6bb15d821ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:01.546704 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ae4bc-3102-40f2-9bc7-6bb15d821ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:01.550838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ae4bc-3102-40f2-9bc7-6bb15d821ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:01.556468 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ae4bc-3102-40f2-9bc7-6bb15d821ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:01.557876 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ae4bc-3102-40f2-9bc7-6bb15d821ba1 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:01.567777 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1393/2813] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:30:04.382779 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54969252-1b5d-432f-a4ad-622ea66dcf5b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:04.384319 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-54969252-1b5d-432f-a4ad-622ea66dcf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:04.397363 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54969252-1b5d-432f-a4ad-622ea66dcf5b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:04.407961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5586b36-3097-4a26-accf-f5e75b0c3c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:04.407961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5586b36-3097-4a26-accf-f5e75b0c3c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:04.407961 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5586b36-3097-4a26-accf-f5e75b0c3c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:04.409481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5586b36-3097-4a26-accf-f5e75b0c3c2c admin admin] PATH_INFO: `/v3/users/ca75f3a5742c42e6a1ddeb117df6f01e` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:04.412043 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5586b36-3097-4a26-accf-f5e75b0c3c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca75f3a5742c42e6a1ddeb117df6f01e)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:04.415028 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5586b36-3097-4a26-accf-f5e75b0c3c2c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:04.579721 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e5586b36-3097-4a26-accf-f5e75b0c3c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca75f3a5742c42e6a1ddeb117df6f01e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:04.581547 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e5586b36-3097-4a26-accf-f5e75b0c3c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca75f3a5742c42e6a1ddeb117df6f01e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:04.582461 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e5586b36-3097-4a26-accf-f5e75b0c3c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca75f3a5742c42e6a1ddeb117df6f01e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:04.597374 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e5586b36-3097-4a26-accf-f5e75b0c3c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca75f3a5742c42e6a1ddeb117df6f01e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:04.607455 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e5586b36-3097-4a26-accf-f5e75b0c3c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca75f3a5742c42e6a1ddeb117df6f01e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:04.694275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1421/2814] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:30:04 2022] DELETE /identity/v3/users/ca75f3a5742c42e6a1ddeb117df6f01e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:30:04.985361 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ae4bc-3102-40f2-9bc7-6bb15d821ba1 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:04.997209 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ae4bc-3102-40f2-9bc7-6bb15d821ba1 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:05.081451 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabbf33-6cee-4a1a-8070-a0c9bc8c79f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:05.082724 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabbf33-6cee-4a1a-8070-a0c9bc8c79f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:05.083069 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabbf33-6cee-4a1a-8070-a0c9bc8c79f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:05.083598 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabbf33-6cee-4a1a-8070-a0c9bc8c79f4 admin admin] PATH_INFO: `/v3/projects/ea060bca7aa9440ba37d2093af6e9d16` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:05.084840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabbf33-6cee-4a1a-8070-a0c9bc8c79f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea060bca7aa9440ba37d2093af6e9d16)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:05.087051 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabbf33-6cee-4a1a-8070-a0c9bc8c79f4 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:05.194481 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2fabbf33-6cee-4a1a-8070-a0c9bc8c79f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea060bca7aa9440ba37d2093af6e9d16', 'request_id': 'req-2fabbf33-6cee-4a1a-8070-a0c9bc8c79f4'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:05.249013 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2fabbf33-6cee-4a1a-8070-a0c9bc8c79f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea060bca7aa9440ba37d2093af6e9d16', 'request_id': 'req-2fabbf33-6cee-4a1a-8070-a0c9bc8c79f4'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:05.256534 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2fabbf33-6cee-4a1a-8070-a0c9bc8c79f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea060bca7aa9440ba37d2093af6e9d16', 'request_id': 'req-2fabbf33-6cee-4a1a-8070-a0c9bc8c79f4'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:05.270840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2fabbf33-6cee-4a1a-8070-a0c9bc8c79f4 admin admin] The token cache is being invalidate because project ea060bca7aa9440ba37d2093af6e9d16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:30:05.271420 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2fabbf33-6cee-4a1a-8070-a0c9bc8c79f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:05.272301 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-2fabbf33-6cee-4a1a-8070-a0c9bc8c79f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:05.274261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1394/2815] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:30:04 2022] DELETE /identity/v3/projects/ea060bca7aa9440ba37d2093af6e9d16 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:30:05.279376 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161292af-5f53-49a3-a3d0-7606e379c7e9 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:05.280009 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161292af-5f53-49a3-a3d0-7606e379c7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:05.280309 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161292af-5f53-49a3-a3d0-7606e379c7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:05.302336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-161292af-5f53-49a3-a3d0-7606e379c7e9 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:30:05.305131 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-161292af-5f53-49a3-a3d0-7606e379c7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:05.375836 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1422/2816] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:30:05.395094 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20238f9b-a665-4e9a-970b-1e10f41f2888 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:05.395419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20238f9b-a665-4e9a-970b-1e10f41f2888 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:05.396368 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20238f9b-a665-4e9a-970b-1e10f41f2888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:05.419130 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-20238f9b-a665-4e9a-970b-1e10f41f2888 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:30:05.420441 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-20238f9b-a665-4e9a-970b-1e10f41f2888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:05.435910 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1395/2817] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:30:05.436951 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161292af-5f53-49a3-a3d0-7606e379c7e9 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:05.447805 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161292af-5f53-49a3-a3d0-7606e379c7e9 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:05.453287 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089f7b7-7753-42ff-b5ef-3df1978e94c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:05.454060 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089f7b7-7753-42ff-b5ef-3df1978e94c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:05.454549 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089f7b7-7753-42ff-b5ef-3df1978e94c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:05.454830 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089f7b7-7753-42ff-b5ef-3df1978e94c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:05.455581 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089f7b7-7753-42ff-b5ef-3df1978e94c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:30:05.456275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089f7b7-7753-42ff-b5ef-3df1978e94c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:05.457895 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089f7b7-7753-42ff-b5ef-3df1978e94c7 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:05.470992 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1423/2818] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:30:05.476280 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20238f9b-a665-4e9a-970b-1e10f41f2888 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:05.485175 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20238f9b-a665-4e9a-970b-1e10f41f2888 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:05.490630 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498f226-6baa-4524-bdfd-3f6a002b77ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:05.491934 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498f226-6baa-4524-bdfd-3f6a002b77ae admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:05.492216 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498f226-6baa-4524-bdfd-3f6a002b77ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:05.492523 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498f226-6baa-4524-bdfd-3f6a002b77ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:05.493182 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498f226-6baa-4524-bdfd-3f6a002b77ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:05.495107 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498f226-6baa-4524-bdfd-3f6a002b77ae admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:05.593305 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1396/2819] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:30:05 2022] POST /identity/v3/projects => generated 399 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:30:05.597807 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089f7b7-7753-42ff-b5ef-3df1978e94c7 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:05.608275 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089f7b7-7753-42ff-b5ef-3df1978e94c7 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:05.671204 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132cdd8-0e4b-40df-87b2-b72e08a4b145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:05.672281 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132cdd8-0e4b-40df-87b2-b72e08a4b145 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:05.672782 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132cdd8-0e4b-40df-87b2-b72e08a4b145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:05.673235 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132cdd8-0e4b-40df-87b2-b72e08a4b145 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:05.674092 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132cdd8-0e4b-40df-87b2-b72e08a4b145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:05.676833 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132cdd8-0e4b-40df-87b2-b72e08a4b145 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:05.780467 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1424/2820] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:30:05 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:30:05.785335 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498f226-6baa-4524-bdfd-3f6a002b77ae admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:05.797717 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498f226-6baa-4524-bdfd-3f6a002b77ae admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:05.803430 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f8cf8-1288-4695-b2ca-654df8022f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:05.804104 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f8cf8-1288-4695-b2ca-654df8022f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:05.810642 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f8cf8-1288-4695-b2ca-654df8022f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:05.810642 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f8cf8-1288-4695-b2ca-654df8022f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:05.810642 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f8cf8-1288-4695-b2ca-654df8022f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:05.810642 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f8cf8-1288-4695-b2ca-654df8022f39 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:05.820474 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1397/2821] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:30:05.821671 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132cdd8-0e4b-40df-87b2-b72e08a4b145 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:05.832512 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132cdd8-0e4b-40df-87b2-b72e08a4b145 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:05.839684 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922976a9-8dad-40df-8e97-6ae50567e482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:05.840623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922976a9-8dad-40df-8e97-6ae50567e482 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:05.841105 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922976a9-8dad-40df-8e97-6ae50567e482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:05.841618 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922976a9-8dad-40df-8e97-6ae50567e482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:05.842372 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922976a9-8dad-40df-8e97-6ae50567e482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:05.844749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922976a9-8dad-40df-8e97-6ae50567e482 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:05.863636 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1425/2822] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:30:05.865040 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f8cf8-1288-4695-b2ca-654df8022f39 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:05.874986 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f8cf8-1288-4695-b2ca-654df8022f39 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:05.879874 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b177a0d-c0a7-42e5-8f09-35a21c156cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:05.880759 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b177a0d-c0a7-42e5-8f09-35a21c156cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:05.881040 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b177a0d-c0a7-42e5-8f09-35a21c156cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:05.881312 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b177a0d-c0a7-42e5-8f09-35a21c156cb9 admin admin] PATH_INFO: `/v3/projects/b4001a747bd54c28b460ff8fe65d22fc/users/2230e10636464872aab58be727c8746d/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:05.896595 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b177a0d-c0a7-42e5-8f09-35a21c156cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4001a747bd54c28b460ff8fe65d22fc, user_id=2230e10636464872aab58be727c8746d, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:05.899515 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b177a0d-c0a7-42e5-8f09-35a21c156cb9 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:05.981914 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1398/2823] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:30:05 2022] PUT /identity/v3/projects/b4001a747bd54c28b460ff8fe65d22fc/users/2230e10636464872aab58be727c8746d/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:30:05.993413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf9d17-1f54-45da-a2f2-ffb3d45a70e0 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:05.993676 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf9d17-1f54-45da-a2f2-ffb3d45a70e0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:05.994997 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf9d17-1f54-45da-a2f2-ffb3d45a70e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:06.024828 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-c4bf9d17-1f54-45da-a2f2-ffb3d45a70e0 None None] MFA Rules not processed for user `2230e10636464872aab58be727c8746d`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:30:06.025603 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c4bf9d17-1f54-45da-a2f2-ffb3d45a70e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:06.090095 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1426/2824] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:30:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:30:06.102573 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b177a0d-c0a7-42e5-8f09-35a21c156cb9 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:06.104569 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-0b177a0d-c0a7-42e5-8f09-35a21c156cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:06.162416 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b177a0d-c0a7-42e5-8f09-35a21c156cb9 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:06.166423 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d48ea-b297-4ce2-baad-1b1ac2bee31e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:06.167366 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d48ea-b297-4ce2-baad-1b1ac2bee31e service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:06.167860 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d48ea-b297-4ce2-baad-1b1ac2bee31e service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:06.168336 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d48ea-b297-4ce2-baad-1b1ac2bee31e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:06.178901 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d48ea-b297-4ce2-baad-1b1ac2bee31e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:06.180554 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d48ea-b297-4ce2-baad-1b1ac2bee31e service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:06.195840 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1399/2825] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:30:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:30:07.197693 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8eda9-252e-4375-816b-967a92cde499 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:07.198806 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8eda9-252e-4375-816b-967a92cde499 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:07.199145 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8eda9-252e-4375-816b-967a92cde499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:07.243639 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2af8eda9-252e-4375-816b-967a92cde499 None None] MFA Rules not processed for user `efdf21c4f62e44cca32de43efd532418`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:30:07.245055 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2af8eda9-252e-4375-816b-967a92cde499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:07.341001 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1427/2826] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:30:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:30:07.347109 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d48ea-b297-4ce2-baad-1b1ac2bee31e service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:07.349866 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-811d48ea-b297-4ce2-baad-1b1ac2bee31e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:07.435215 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d48ea-b297-4ce2-baad-1b1ac2bee31e service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:07.440692 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b34b34-d7e0-48e3-a7d6-a7fb34211e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:07.441984 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b34b34-d7e0-48e3-a7d6-a7fb34211e5a admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:07.443357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b34b34-d7e0-48e3-a7d6-a7fb34211e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:07.443357 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b34b34-d7e0-48e3-a7d6-a7fb34211e5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:07.443623 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b34b34-d7e0-48e3-a7d6-a7fb34211e5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:07.445541 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b34b34-d7e0-48e3-a7d6-a7fb34211e5a admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:07.571813 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1400/2827] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:30:07 2022] POST /identity/v3/projects => generated 371 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:30:07.576003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8eda9-252e-4375-816b-967a92cde499 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:07.587066 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8eda9-252e-4375-816b-967a92cde499 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:07.645733 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13a255-ed4b-45ba-8a57-03a5f0e47c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:07.646413 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13a255-ed4b-45ba-8a57-03a5f0e47c79 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:07.646736 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13a255-ed4b-45ba-8a57-03a5f0e47c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:07.647053 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13a255-ed4b-45ba-8a57-03a5f0e47c79 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:07.647713 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13a255-ed4b-45ba-8a57-03a5f0e47c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:07.649641 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13a255-ed4b-45ba-8a57-03a5f0e47c79 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:07.786306 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1428/2828] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:30:07 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:30:07.790381 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b34b34-d7e0-48e3-a7d6-a7fb34211e5a admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:07.801373 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b34b34-d7e0-48e3-a7d6-a7fb34211e5a admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:07.806073 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cc448-f829-4b12-b7f0-1d67fd527d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:07.806799 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cc448-f829-4b12-b7f0-1d67fd527d95 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:07.807084 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cc448-f829-4b12-b7f0-1d67fd527d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:07.807360 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cc448-f829-4b12-b7f0-1d67fd527d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:07.808089 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cc448-f829-4b12-b7f0-1d67fd527d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:07.809669 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cc448-f829-4b12-b7f0-1d67fd527d95 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:07.821164 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1401/2829] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:30:07.825328 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13a255-ed4b-45ba-8a57-03a5f0e47c79 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:07.835224 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13a255-ed4b-45ba-8a57-03a5f0e47c79 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:07.839963 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521dd1ac-aec5-443d-a226-36d58d2c5580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:07.841457 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dd1ac-aec5-443d-a226-36d58d2c5580 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:07.841457 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dd1ac-aec5-443d-a226-36d58d2c5580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:07.841457 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dd1ac-aec5-443d-a226-36d58d2c5580 admin admin] PATH_INFO: `/v3/projects/d5242698b26845a0bc9ba1376f8652cd/users/e8ba270eb49f499cb948129b85601bfc/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:07.858039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521dd1ac-aec5-443d-a226-36d58d2c5580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5242698b26845a0bc9ba1376f8652cd, user_id=e8ba270eb49f499cb948129b85601bfc, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:07.860982 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521dd1ac-aec5-443d-a226-36d58d2c5580 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:07.946348 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1429/2830] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:30:07 2022] PUT /identity/v3/projects/d5242698b26845a0bc9ba1376f8652cd/users/e8ba270eb49f499cb948129b85601bfc/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:30:07.950244 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cc448-f829-4b12-b7f0-1d67fd527d95 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:07.960352 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cc448-f829-4b12-b7f0-1d67fd527d95 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:08.015866 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118ceda-99cd-415c-9342-183311bbfdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:08.016530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118ceda-99cd-415c-9342-183311bbfdfb admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:08.016813 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118ceda-99cd-415c-9342-183311bbfdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:08.017090 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118ceda-99cd-415c-9342-183311bbfdfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:08.017812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118ceda-99cd-415c-9342-183311bbfdfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:08.020101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118ceda-99cd-415c-9342-183311bbfdfb admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:08.029490 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1402/2831] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:30:08.033640 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521dd1ac-aec5-443d-a226-36d58d2c5580 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:08.044022 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521dd1ac-aec5-443d-a226-36d58d2c5580 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:08.048616 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84473f-0cdc-4bf0-9c80-063ddaeb8583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:08.049557 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84473f-0cdc-4bf0-9c80-063ddaeb8583 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:08.050000 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84473f-0cdc-4bf0-9c80-063ddaeb8583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:08.050306 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84473f-0cdc-4bf0-9c80-063ddaeb8583 admin admin] PATH_INFO: `/v3/projects/d5242698b26845a0bc9ba1376f8652cd/users/e8ba270eb49f499cb948129b85601bfc/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:08.052317 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84473f-0cdc-4bf0-9c80-063ddaeb8583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5242698b26845a0bc9ba1376f8652cd, user_id=e8ba270eb49f499cb948129b85601bfc, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:08.054962 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84473f-0cdc-4bf0-9c80-063ddaeb8583 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:08.064978 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1430/2832] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:30:08 2022] PUT /identity/v3/projects/d5242698b26845a0bc9ba1376f8652cd/users/e8ba270eb49f499cb948129b85601bfc/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:30:14.086986 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75770b3e-3359-48f7-8dce-2983cce7116f None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:14.087570 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75770b3e-3359-48f7-8dce-2983cce7116f None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:14.087570 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75770b3e-3359-48f7-8dce-2983cce7116f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:14.116603 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-75770b3e-3359-48f7-8dce-2983cce7116f None None] MFA Rules not processed for user `e8ba270eb49f499cb948129b85601bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:30:14.118033 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-75770b3e-3359-48f7-8dce-2983cce7116f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:14.206874 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1403/2833] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:30:14 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:30:14.220267 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84473f-0cdc-4bf0-9c80-063ddaeb8583 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:14.223225 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fd84473f-0cdc-4bf0-9c80-063ddaeb8583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:14.353783 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84473f-0cdc-4bf0-9c80-063ddaeb8583 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:14.355227 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75770b3e-3359-48f7-8dce-2983cce7116f None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:14.366051 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f47b74-c5a8-4f5d-9c78-ca0afb632010 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:14.366786 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f47b74-c5a8-4f5d-9c78-ca0afb632010 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:14.367070 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f47b74-c5a8-4f5d-9c78-ca0afb632010 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:14.367354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f47b74-c5a8-4f5d-9c78-ca0afb632010 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:14.433643 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f47b74-c5a8-4f5d-9c78-ca0afb632010 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:14.435208 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f47b74-c5a8-4f5d-9c78-ca0afb632010 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:14.436747 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75770b3e-3359-48f7-8dce-2983cce7116f None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:14.443322 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e45c5c-2461-4020-9def-d9d2d3a39a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:14.444316 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e45c5c-2461-4020-9def-d9d2d3a39a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:14.444677 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e45c5c-2461-4020-9def-d9d2d3a39a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:14.445012 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e45c5c-2461-4020-9def-d9d2d3a39a78 admin admin] PATH_INFO: `/v3/users/2230e10636464872aab58be727c8746d` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:14.446286 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e45c5c-2461-4020-9def-d9d2d3a39a78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2230e10636464872aab58be727c8746d)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:14.448292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e45c5c-2461-4020-9def-d9d2d3a39a78 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:14.459050 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1431/2834] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:30:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:30:14.659445 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-04e45c5c-2461-4020-9def-d9d2d3a39a78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2230e10636464872aab58be727c8746d'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:14.660193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-04e45c5c-2461-4020-9def-d9d2d3a39a78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2230e10636464872aab58be727c8746d'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:14.673113 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-04e45c5c-2461-4020-9def-d9d2d3a39a78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2230e10636464872aab58be727c8746d'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:14.674495 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-04e45c5c-2461-4020-9def-d9d2d3a39a78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2230e10636464872aab58be727c8746d'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:14.686333 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-04e45c5c-2461-4020-9def-d9d2d3a39a78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2230e10636464872aab58be727c8746d'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:14.772479 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1404/2835] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:30:14 2022] DELETE /identity/v3/users/2230e10636464872aab58be727c8746d => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:30:14.777074 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2cbf5-0090-41d6-914e-f4946d7adf0a None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:14.777449 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2cbf5-0090-41d6-914e-f4946d7adf0a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:14.777814 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2cbf5-0090-41d6-914e-f4946d7adf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:14.803717 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-38d2cbf5-0090-41d6-914e-f4946d7adf0a None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:30:14.805212 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-38d2cbf5-0090-41d6-914e-f4946d7adf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:14.880195 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1432/2836] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:30:14.897177 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e45c5c-2461-4020-9def-d9d2d3a39a78 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:14.899937 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-04e45c5c-2461-4020-9def-d9d2d3a39a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:14.970905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e45c5c-2461-4020-9def-d9d2d3a39a78 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:14.975488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a629a-7f7f-4bd7-a152-38c75f4357ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:14.976152 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a629a-7f7f-4bd7-a152-38c75f4357ab service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:14.976440 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a629a-7f7f-4bd7-a152-38c75f4357ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:14.976763 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a629a-7f7f-4bd7-a152-38c75f4357ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:14.991004 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a629a-7f7f-4bd7-a152-38c75f4357ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:14.992502 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a629a-7f7f-4bd7-a152-38c75f4357ab service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:15.010488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1405/2837] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:30:15.533008 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2cbf5-0090-41d6-914e-f4946d7adf0a None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:15.535735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-38d2cbf5-0090-41d6-914e-f4946d7adf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:15.582888 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2cbf5-0090-41d6-914e-f4946d7adf0a None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:15.617076 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd40e1-f136-430b-af46-62f3bfd38cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:15.618171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd40e1-f136-430b-af46-62f3bfd38cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:15.618749 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd40e1-f136-430b-af46-62f3bfd38cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:15.619190 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd40e1-f136-430b-af46-62f3bfd38cbd admin admin] PATH_INFO: `/v3/projects/b4001a747bd54c28b460ff8fe65d22fc` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:15.620667 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd40e1-f136-430b-af46-62f3bfd38cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4001a747bd54c28b460ff8fe65d22fc)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:15.622636 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd40e1-f136-430b-af46-62f3bfd38cbd admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:15.735596 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bedd40e1-f136-430b-af46-62f3bfd38cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4001a747bd54c28b460ff8fe65d22fc', 'request_id': 'req-bedd40e1-f136-430b-af46-62f3bfd38cbd'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:15.814735 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bedd40e1-f136-430b-af46-62f3bfd38cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4001a747bd54c28b460ff8fe65d22fc', 'request_id': 'req-bedd40e1-f136-430b-af46-62f3bfd38cbd'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:15.820850 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bedd40e1-f136-430b-af46-62f3bfd38cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4001a747bd54c28b460ff8fe65d22fc', 'request_id': 'req-bedd40e1-f136-430b-af46-62f3bfd38cbd'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:15.832508 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bedd40e1-f136-430b-af46-62f3bfd38cbd admin admin] The token cache is being invalidate because project b4001a747bd54c28b460ff8fe65d22fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:30:15.832799 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bedd40e1-f136-430b-af46-62f3bfd38cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:15.833453 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bedd40e1-f136-430b-af46-62f3bfd38cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:30:15.835047 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1433/2838] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:30:15 2022] DELETE /identity/v3/projects/b4001a747bd54c28b460ff8fe65d22fc => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:30:15.840270 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7180c-12b6-4d0d-b669-0e7ab0a474f6 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:15.840704 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7180c-12b6-4d0d-b669-0e7ab0a474f6 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:15.841077 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7180c-12b6-4d0d-b669-0e7ab0a474f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:15.868180 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-a7f7180c-12b6-4d0d-b669-0e7ab0a474f6 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:30:15.869730 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a7f7180c-12b6-4d0d-b669-0e7ab0a474f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:15.932575 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1406/2839] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:30:15.940581 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fca69-0949-4065-97e7-4b4bbbacd9c6 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:15.942498 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fca69-0949-4065-97e7-4b4bbbacd9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:15.942498 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fca69-0949-4065-97e7-4b4bbbacd9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:15.973483 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-131fca69-0949-4065-97e7-4b4bbbacd9c6 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:30:15.975527 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-131fca69-0949-4065-97e7-4b4bbbacd9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:16.005672 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1434/2840] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:30:16.005857 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7180c-12b6-4d0d-b669-0e7ab0a474f6 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:16.006376 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7180c-12b6-4d0d-b669-0e7ab0a474f6 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:16.012859 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d9cb4-bf6d-47a7-9dba-656767d50c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:16.013729 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d9cb4-bf6d-47a7-9dba-656767d50c70 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:16.014081 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d9cb4-bf6d-47a7-9dba-656767d50c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:16.014712 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d9cb4-bf6d-47a7-9dba-656767d50c70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:16.015994 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d9cb4-bf6d-47a7-9dba-656767d50c70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:30:16.016521 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d9cb4-bf6d-47a7-9dba-656767d50c70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:16.019487 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d9cb4-bf6d-47a7-9dba-656767d50c70 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:16.034542 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1407/2841] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 10 21:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:30:16.039098 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fca69-0949-4065-97e7-4b4bbbacd9c6 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:16.051993 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fca69-0949-4065-97e7-4b4bbbacd9c6 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:16.056789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1818644-e802-4fed-9c81-0725f939473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:16.057449 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1818644-e802-4fed-9c81-0725f939473f admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:16.057731 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1818644-e802-4fed-9c81-0725f939473f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:16.058062 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1818644-e802-4fed-9c81-0725f939473f admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:16.058764 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1818644-e802-4fed-9c81-0725f939473f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:16.060654 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1818644-e802-4fed-9c81-0725f939473f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:16.202478 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1435/2842] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:30:16 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:30:16.204019 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d9cb4-bf6d-47a7-9dba-656767d50c70 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:16.218506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d9cb4-bf6d-47a7-9dba-656767d50c70 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:16.273970 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc75c5-23d4-4278-b199-c568cdcf7cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:16.274595 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc75c5-23d4-4278-b199-c568cdcf7cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:16.274885 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc75c5-23d4-4278-b199-c568cdcf7cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:16.275164 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc75c5-23d4-4278-b199-c568cdcf7cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:16.275893 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc75c5-23d4-4278-b199-c568cdcf7cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:16.277791 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc75c5-23d4-4278-b199-c568cdcf7cc8 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:16.380269 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1408/2843] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:30:16 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:30:16.384594 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1818644-e802-4fed-9c81-0725f939473f admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:16.395699 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1818644-e802-4fed-9c81-0725f939473f admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:16.400393 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba62e3-3b44-48ce-9081-1243ebe93677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:16.401087 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba62e3-3b44-48ce-9081-1243ebe93677 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:16.401373 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba62e3-3b44-48ce-9081-1243ebe93677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:16.401670 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba62e3-3b44-48ce-9081-1243ebe93677 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:16.402397 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba62e3-3b44-48ce-9081-1243ebe93677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:16.403996 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba62e3-3b44-48ce-9081-1243ebe93677 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:16.414765 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1436/2844] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:30:16.420486 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc75c5-23d4-4278-b199-c568cdcf7cc8 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:16.431381 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc75c5-23d4-4278-b199-c568cdcf7cc8 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:16.436365 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7fc3b-7eb5-48cf-b59a-b723b9b494bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:16.437152 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7fc3b-7eb5-48cf-b59a-b723b9b494bf admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:16.437402 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7fc3b-7eb5-48cf-b59a-b723b9b494bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:16.437676 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7fc3b-7eb5-48cf-b59a-b723b9b494bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:16.438405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7fc3b-7eb5-48cf-b59a-b723b9b494bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:16.440552 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7fc3b-7eb5-48cf-b59a-b723b9b494bf admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:16.451151 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1409/2845] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:30:16.455360 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba62e3-3b44-48ce-9081-1243ebe93677 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:16.465910 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba62e3-3b44-48ce-9081-1243ebe93677 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:16.470903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb094ec-0cc6-4453-82ad-df0e0f3cb997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:16.471907 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb094ec-0cc6-4453-82ad-df0e0f3cb997 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:16.472289 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb094ec-0cc6-4453-82ad-df0e0f3cb997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:16.472630 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb094ec-0cc6-4453-82ad-df0e0f3cb997 admin admin] PATH_INFO: `/v3/projects/dd6f673d1cfd41028e5ed60d4d204666/users/6802e5cde5bb48e2958124c88a7501d9/roles/390d715fbb0f4d029b222894fa3ac65b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:16.488141 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb094ec-0cc6-4453-82ad-df0e0f3cb997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd6f673d1cfd41028e5ed60d4d204666, user_id=6802e5cde5bb48e2958124c88a7501d9, role_id=390d715fbb0f4d029b222894fa3ac65b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:16.490801 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb094ec-0cc6-4453-82ad-df0e0f3cb997 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:16.591881 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1437/2846] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:30:16 2022] PUT /identity/v3/projects/dd6f673d1cfd41028e5ed60d4d204666/users/6802e5cde5bb48e2958124c88a7501d9/roles/390d715fbb0f4d029b222894fa3ac65b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:30:16.597245 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad92c01-4aef-4096-8244-f1ee13e050c9 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:16.597540 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad92c01-4aef-4096-8244-f1ee13e050c9 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:16.597993 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad92c01-4aef-4096-8244-f1ee13e050c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:16.619871 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-2ad92c01-4aef-4096-8244-f1ee13e050c9 None None] MFA Rules not processed for user `94be445c202a4e67aef3505af25af405`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:30:16.621070 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-2ad92c01-4aef-4096-8244-f1ee13e050c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:16.681083 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1410/2847] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:30:16.692015 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb094ec-0cc6-4453-82ad-df0e0f3cb997 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:16.693791 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8cb094ec-0cc6-4453-82ad-df0e0f3cb997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:16.749573 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb094ec-0cc6-4453-82ad-df0e0f3cb997 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:16.753918 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6dd4fd-e769-4bc6-8645-1fc7d7435e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:16.754574 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dd4fd-e769-4bc6-8645-1fc7d7435e9e service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:16.755720 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dd4fd-e769-4bc6-8645-1fc7d7435e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:16.755720 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dd4fd-e769-4bc6-8645-1fc7d7435e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:16.764233 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6dd4fd-e769-4bc6-8645-1fc7d7435e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:16.765637 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6dd4fd-e769-4bc6-8645-1fc7d7435e9e service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:16.775293 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1438/2848] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:30:17.108013 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e562b4a-9c42-4ef5-8d9c-b3129f5f8e9a None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:17.108535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e562b4a-9c42-4ef5-8d9c-b3129f5f8e9a None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:17.108535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e562b4a-9c42-4ef5-8d9c-b3129f5f8e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:17.133574 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-3e562b4a-9c42-4ef5-8d9c-b3129f5f8e9a None None] MFA Rules not processed for user `efdf21c4f62e44cca32de43efd532418`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:30:17.135120 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-3e562b4a-9c42-4ef5-8d9c-b3129f5f8e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:17.200806 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1411/2849] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:30:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:30:22.450728 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563cf53-b876-4957-8381-dada1fdc891c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:22.451565 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563cf53-b876-4957-8381-dada1fdc891c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:22.452043 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563cf53-b876-4957-8381-dada1fdc891c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:22.482827 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7563cf53-b876-4957-8381-dada1fdc891c None None] MFA Rules not processed for user `6802e5cde5bb48e2958124c88a7501d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:30:22.484033 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7563cf53-b876-4957-8381-dada1fdc891c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:22.576153 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1439/2850] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:30:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:30:22.581832 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e562b4a-9c42-4ef5-8d9c-b3129f5f8e9a None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:22.593715 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e562b4a-9c42-4ef5-8d9c-b3129f5f8e9a None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:22.599208 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829cd32-f515-46cb-8401-976be6b22062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:22.599877 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829cd32-f515-46cb-8401-976be6b22062 admin admin] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:22.600163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829cd32-f515-46cb-8401-976be6b22062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:22.600440 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829cd32-f515-46cb-8401-976be6b22062 admin admin] PATH_INFO: `/v3/projects` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:22.601172 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829cd32-f515-46cb-8401-976be6b22062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:22.603133 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829cd32-f515-46cb-8401-976be6b22062 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:22.715934 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1412/2851] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 10 21:30:22 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:30:22.719917 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563cf53-b876-4957-8381-dada1fdc891c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:22.731781 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563cf53-b876-4957-8381-dada1fdc891c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:22.798219 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949f1ab-91e6-40e6-9cfd-66b5cd92f8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:22.799093 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949f1ab-91e6-40e6-9cfd-66b5cd92f8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:22.799423 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949f1ab-91e6-40e6-9cfd-66b5cd92f8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:22.799757 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949f1ab-91e6-40e6-9cfd-66b5cd92f8d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:22.800477 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949f1ab-91e6-40e6-9cfd-66b5cd92f8d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:22.802647 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949f1ab-91e6-40e6-9cfd-66b5cd92f8d9 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:22.900750 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1440/2852] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 10 21:30:22 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:30:22.904725 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829cd32-f515-46cb-8401-976be6b22062 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:22.918673 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829cd32-f515-46cb-8401-976be6b22062 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:22.923724 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c229c5-860c-4bbd-85e6-4228c84d32a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:22.924398 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c229c5-860c-4bbd-85e6-4228c84d32a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:22.924678 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c229c5-860c-4bbd-85e6-4228c84d32a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:22.924985 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c229c5-860c-4bbd-85e6-4228c84d32a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:22.926226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c229c5-860c-4bbd-85e6-4228c84d32a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:22.928353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c229c5-860c-4bbd-85e6-4228c84d32a7 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:22.942090 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1413/2853] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:30:22.946311 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949f1ab-91e6-40e6-9cfd-66b5cd92f8d9 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:22.957650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949f1ab-91e6-40e6-9cfd-66b5cd92f8d9 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:22.966249 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b4fd8-25ce-4d59-a893-a4592641d0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:22.968213 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b4fd8-25ce-4d59-a893-a4592641d0a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:22.968499 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b4fd8-25ce-4d59-a893-a4592641d0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:22.969134 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b4fd8-25ce-4d59-a893-a4592641d0a8 admin admin] PATH_INFO: `/v3/projects/39b810b37c1a494a994957977fa15020/users/45b5886342d9489da42c2de620c65c88/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:23.005222 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b4fd8-25ce-4d59-a893-a4592641d0a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b810b37c1a494a994957977fa15020, user_id=45b5886342d9489da42c2de620c65c88, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:23.009560 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b4fd8-25ce-4d59-a893-a4592641d0a8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:23.061160 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1441/2854] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:30:22 2022] PUT /identity/v3/projects/39b810b37c1a494a994957977fa15020/users/45b5886342d9489da42c2de620c65c88/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:30:23.067361 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c229c5-860c-4bbd-85e6-4228c84d32a7 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:23.082728 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c229c5-860c-4bbd-85e6-4228c84d32a7 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:23.153383 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ebd49-30a9-495e-a97c-e3e39ec0f698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:23.154476 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ebd49-30a9-495e-a97c-e3e39ec0f698 admin admin] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:23.154783 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ebd49-30a9-495e-a97c-e3e39ec0f698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:23.155064 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ebd49-30a9-495e-a97c-e3e39ec0f698 admin admin] PATH_INFO: `/v3/roles` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:23.156193 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ebd49-30a9-495e-a97c-e3e39ec0f698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:23.157801 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ebd49-30a9-495e-a97c-e3e39ec0f698 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:23.168932 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1414/2855] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 10 21:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:30:23.174192 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b4fd8-25ce-4d59-a893-a4592641d0a8 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:23.188096 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b4fd8-25ce-4d59-a893-a4592641d0a8 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:23.194252 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e82f5b-5f81-4d14-bbe8-a55cf1c69918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:23.195197 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e82f5b-5f81-4d14-bbe8-a55cf1c69918 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:23.195487 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e82f5b-5f81-4d14-bbe8-a55cf1c69918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:23.195767 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e82f5b-5f81-4d14-bbe8-a55cf1c69918 admin admin] PATH_INFO: `/v3/projects/39b810b37c1a494a994957977fa15020/users/45b5886342d9489da42c2de620c65c88/roles/5cd001edc58744738aa57180c0be68a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:23.198144 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e82f5b-5f81-4d14-bbe8-a55cf1c69918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b810b37c1a494a994957977fa15020, user_id=45b5886342d9489da42c2de620c65c88, role_id=5cd001edc58744738aa57180c0be68a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:23.203236 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e82f5b-5f81-4d14-bbe8-a55cf1c69918 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:23.215701 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1442/2856] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 10 21:30:23 2022] PUT /identity/v3/projects/39b810b37c1a494a994957977fa15020/users/45b5886342d9489da42c2de620c65c88/roles/5cd001edc58744738aa57180c0be68a9 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:30:29.455753 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed911b81-5071-43ec-a54c-e8b833ff7039 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:29.456767 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed911b81-5071-43ec-a54c-e8b833ff7039 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:29.457124 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed911b81-5071-43ec-a54c-e8b833ff7039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:29.483714 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-ed911b81-5071-43ec-a54c-e8b833ff7039 None None] MFA Rules not processed for user `45b5886342d9489da42c2de620c65c88`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:30:29.485267 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-ed911b81-5071-43ec-a54c-e8b833ff7039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:29.556405 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1415/2857] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:30:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:30:29.571612 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e82f5b-5f81-4d14-bbe8-a55cf1c69918 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:29.573316 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d7e82f5b-5f81-4d14-bbe8-a55cf1c69918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:29.647066 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e82f5b-5f81-4d14-bbe8-a55cf1c69918 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:29.652868 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1faad-e26b-4209-aba4-742fc5257020 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:29.653523 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1faad-e26b-4209-aba4-742fc5257020 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:29.653808 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1faad-e26b-4209-aba4-742fc5257020 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:29.654085 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1faad-e26b-4209-aba4-742fc5257020 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:29.715033 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1faad-e26b-4209-aba4-742fc5257020 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:29.716664 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1faad-e26b-4209-aba4-742fc5257020 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:29.726866 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1443/2858] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:30:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:30:33.135493 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed911b81-5071-43ec-a54c-e8b833ff7039 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:33.138159 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-ed911b81-5071-43ec-a54c-e8b833ff7039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:33.281891 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed911b81-5071-43ec-a54c-e8b833ff7039 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:33.288101 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be02a8c-e286-4bc1-b955-95a1c7ccfb16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dfa98f420c4c4c845262a78ae75ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:33.289445 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be02a8c-e286-4bc1-b955-95a1c7ccfb16 service cinder] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:33.289954 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be02a8c-e286-4bc1-b955-95a1c7ccfb16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:33.290409 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be02a8c-e286-4bc1-b955-95a1c7ccfb16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:33.304079 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-7be02a8c-e286-4bc1-b955-95a1c7ccfb16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:33.332930 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be02a8c-e286-4bc1-b955-95a1c7ccfb16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:33.345517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be02a8c-e286-4bc1-b955-95a1c7ccfb16 service cinder] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:33.369084 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1416/2859] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:30:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:30:34.681257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1faad-e26b-4209-aba4-742fc5257020 service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:34.683386 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-60f1faad-e26b-4209-aba4-742fc5257020 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:34.752615 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1faad-e26b-4209-aba4-742fc5257020 service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:34.756966 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd62aa-35b6-4cee-a9c8-322b5c64e086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:34.757620 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd62aa-35b6-4cee-a9c8-322b5c64e086 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:34.757903 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd62aa-35b6-4cee-a9c8-322b5c64e086 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:34.758560 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd62aa-35b6-4cee-a9c8-322b5c64e086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:34.760711 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-39fd62aa-35b6-4cee-a9c8-322b5c64e086 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:34.783226 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd62aa-35b6-4cee-a9c8-322b5c64e086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:34.784789 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd62aa-35b6-4cee-a9c8-322b5c64e086 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:34.797606 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1444/2860] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:30:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:30:37.889980 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be02a8c-e286-4bc1-b955-95a1c7ccfb16 service cinder] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:37.923515 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be02a8c-e286-4bc1-b955-95a1c7ccfb16 service cinder] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:37.923515 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a9b21-1d89-4f28-b659-51d762afe632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:37.923515 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a9b21-1d89-4f28-b659-51d762afe632 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:37.923515 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a9b21-1d89-4f28-b659-51d762afe632 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:37.924530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a9b21-1d89-4f28-b659-51d762afe632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:37.924530 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-411a9b21-1d89-4f28-b659-51d762afe632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:37.947117 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a9b21-1d89-4f28-b659-51d762afe632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:37.948665 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a9b21-1d89-4f28-b659-51d762afe632 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:37.959287 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1417/2861] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:30:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:30:48.268640 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249167bb-c279-4e09-95df-7e40010050e1 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:48.269175 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249167bb-c279-4e09-95df-7e40010050e1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:48.269294 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249167bb-c279-4e09-95df-7e40010050e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:48.286561 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-249167bb-c279-4e09-95df-7e40010050e1 None None] MFA Rules not processed for user `6802e5cde5bb48e2958124c88a7501d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:30:48.287730 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-249167bb-c279-4e09-95df-7e40010050e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:48.294375 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1445/2862] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:30:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:30:48.605832 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a9b21-1d89-4f28-b659-51d762afe632 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:48.615013 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a9b21-1d89-4f28-b659-51d762afe632 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:48.618643 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f420c6-ff11-40b7-bac9-69141e8b78b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:48.619285 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f420c6-ff11-40b7-bac9-69141e8b78b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:48.619572 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f420c6-ff11-40b7-bac9-69141e8b78b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:48.619850 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f420c6-ff11-40b7-bac9-69141e8b78b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:48.621596 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-b9f420c6-ff11-40b7-bac9-69141e8b78b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:48.631927 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f420c6-ff11-40b7-bac9-69141e8b78b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:48.633374 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f420c6-ff11-40b7-bac9-69141e8b78b4 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:48.641888 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1418/2863] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:30:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:30:49.314958 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249167bb-c279-4e09-95df-7e40010050e1 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:49.317698 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-249167bb-c279-4e09-95df-7e40010050e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:49.390965 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249167bb-c279-4e09-95df-7e40010050e1 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:49.397120 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23c8e1-cb20-4f17-927b-f6e12f5e57c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a13ad1e10ff44c4b870b45b7416b70f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:49.397816 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23c8e1-cb20-4f17-927b-f6e12f5e57c5 service placement] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:49.398102 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23c8e1-cb20-4f17-927b-f6e12f5e57c5 service placement] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:49.398379 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23c8e1-cb20-4f17-927b-f6e12f5e57c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:49.400236 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3d23c8e1-cb20-4f17-927b-f6e12f5e57c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:49.411769 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23c8e1-cb20-4f17-927b-f6e12f5e57c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:49.413338 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23c8e1-cb20-4f17-927b-f6e12f5e57c5 service placement] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:49.423434 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1446/2864] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:30:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:30:51.353479 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f420c6-ff11-40b7-bac9-69141e8b78b4 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:51.362166 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f420c6-ff11-40b7-bac9-69141e8b78b4 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:51.366220 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f6ecb-65fd-438b-af84-e0c87b994fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:51.369881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f6ecb-65fd-438b-af84-e0c87b994fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:51.369881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f6ecb-65fd-438b-af84-e0c87b994fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:51.369881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f6ecb-65fd-438b-af84-e0c87b994fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:51.369881 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-cf7f6ecb-65fd-438b-af84-e0c87b994fa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:51.433550 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f6ecb-65fd-438b-af84-e0c87b994fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:51.435002 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f6ecb-65fd-438b-af84-e0c87b994fa0 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:51.445388 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1419/2865] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:30:51 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:30:53.533877 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23c8e1-cb20-4f17-927b-f6e12f5e57c5 service placement] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:53.546845 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23c8e1-cb20-4f17-927b-f6e12f5e57c5 service placement] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:53.558381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f6c3d-7da6-453e-8c41-ae984f7a6b52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:53.558381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f6c3d-7da6-453e-8c41-ae984f7a6b52 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:53.558381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f6c3d-7da6-453e-8c41-ae984f7a6b52 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:53.558381 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f6c3d-7da6-453e-8c41-ae984f7a6b52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:53.560239 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4c9f6c3d-7da6-453e-8c41-ae984f7a6b52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:53.577284 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f6c3d-7da6-453e-8c41-ae984f7a6b52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:53.579440 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f6c3d-7da6-453e-8c41-ae984f7a6b52 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:53.592284 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1447/2866] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:30:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:31:03.069053 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f6ecb-65fd-438b-af84-e0c87b994fa0 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:31:03.070500 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-cf7f6ecb-65fd-438b-af84-e0c87b994fa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:31:03.086372 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f6ecb-65fd-438b-af84-e0c87b994fa0 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:31:03.091974 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4496bb-a580-4e12-b523-bd36dacfef13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:31:03.092557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4496bb-a580-4e12-b523-bd36dacfef13 service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:31:03.092842 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4496bb-a580-4e12-b523-bd36dacfef13 service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:31:03.093119 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4496bb-a580-4e12-b523-bd36dacfef13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:31:03.094882 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-9e4496bb-a580-4e12-b523-bd36dacfef13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:31:03.107479 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4496bb-a580-4e12-b523-bd36dacfef13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:31:03.109149 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4496bb-a580-4e12-b523-bd36dacfef13 service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:31:03.119624 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1420/2867] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:31:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:31:05.867600 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f6c3d-7da6-453e-8c41-ae984f7a6b52 service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:31:05.876864 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f6c3d-7da6-453e-8c41-ae984f7a6b52 service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:31:05.881003 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613e45e-d0f1-4991-82c9-7b6804c294f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:31:05.881632 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613e45e-d0f1-4991-82c9-7b6804c294f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:31:05.881915 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613e45e-d0f1-4991-82c9-7b6804c294f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:31:05.882191 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613e45e-d0f1-4991-82c9-7b6804c294f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:31:05.891117 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613e45e-d0f1-4991-82c9-7b6804c294f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:31:05.892514 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613e45e-d0f1-4991-82c9-7b6804c294f1 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:31:05.902390 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1448/2868] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:31:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:33:07.009256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d516c-beac-4279-ab27-7ef337a8f5e0 None None] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:33:07.009803 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d516c-beac-4279-ab27-7ef337a8f5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:33:07.009803 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d516c-beac-4279-ab27-7ef337a8f5e0 None None] PATH_INFO: `/` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:33:07.011201 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1421/2869] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 10 21:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:33:07.018010 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cf8e6-1204-460b-83b8-1d4abefe5ed9 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:33:07.018612 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cf8e6-1204-460b-83b8-1d4abefe5ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:33:07.018871 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cf8e6-1204-460b-83b8-1d4abefe5ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:33:07.098849 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d69cf8e6-1204-460b-83b8-1d4abefe5ed9 None None] MFA Rules not processed for user `2fa7da0ccf954be1a582411cdc617b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:33:07.100073 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d69cf8e6-1204-460b-83b8-1d4abefe5ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:33:07.143650 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1449/2870] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 10 21:33:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:33:07.156642 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d516c-beac-4279-ab27-7ef337a8f5e0 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:33:07.167488 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d516c-beac-4279-ab27-7ef337a8f5e0 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:33:07.171812 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b19ec-b177-490f-82e9-4458a4ac5e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:33:07.172450 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b19ec-b177-490f-82e9-4458a4ac5e6c service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:33:07.172740 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b19ec-b177-490f-82e9-4458a4ac5e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:33:07.173043 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b19ec-b177-490f-82e9-4458a4ac5e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:33:07.180226 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b19ec-b177-490f-82e9-4458a4ac5e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:33:07.181650 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b19ec-b177-490f-82e9-4458a4ac5e6c service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:33:07.189421 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1422/2871] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:33:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:33:07.272577 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f4fc8-e0a6-4dc1-a698-61117ab3c96b None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:33:07.272873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f4fc8-e0a6-4dc1-a698-61117ab3c96b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:33:07.273149 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f4fc8-e0a6-4dc1-a698-61117ab3c96b None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:33:07.274581 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1450/2872] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 10 21:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:33:07.280664 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa3ef2-d976-4953-8059-8274c42cff36 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:33:07.280958 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa3ef2-d976-4953-8059-8274c42cff36 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:33:07.281237 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa3ef2-d976-4953-8059-8274c42cff36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:33:07.328301 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-48aa3ef2-d976-4953-8059-8274c42cff36 None None] MFA Rules not processed for user `c4c16a3b07c64a22bfc3df2a5a90c3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:33:07.329500 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-48aa3ef2-d976-4953-8059-8274c42cff36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:33:07.374683 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1423/2873] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 10 21:33:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:33:07.387061 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f4fc8-e0a6-4dc1-a698-61117ab3c96b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:33:07.398024 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f4fc8-e0a6-4dc1-a698-61117ab3c96b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:33:07.401620 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92605b14-3a79-4b94-acde-7d87f4715abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:33:07.402273 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92605b14-3a79-4b94-acde-7d87f4715abd service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:33:07.402590 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92605b14-3a79-4b94-acde-7d87f4715abd service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:33:07.402916 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92605b14-3a79-4b94-acde-7d87f4715abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:33:07.414843 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92605b14-3a79-4b94-acde-7d87f4715abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:33:07.421243 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92605b14-3a79-4b94-acde-7d87f4715abd service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:33:07.427841 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1451/2874] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:33:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:33:08.235165 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa3ef2-d976-4953-8059-8274c42cff36 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:33:08.247382 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa3ef2-d976-4953-8059-8274c42cff36 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:33:08.255886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2219d-f6a7-403a-a66d-d6045c5e2f89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:33:08.255886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2219d-f6a7-403a-a66d-d6045c5e2f89 service nova] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:33:08.255886 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2219d-f6a7-403a-a66d-d6045c5e2f89 service nova] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:33:08.256346 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2219d-f6a7-403a-a66d-d6045c5e2f89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:33:08.260399 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-3bf2219d-f6a7-403a-a66d-d6045c5e2f89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:33:08.274775 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2219d-f6a7-403a-a66d-d6045c5e2f89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:33:08.276372 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2219d-f6a7-403a-a66d-d6045c5e2f89 service nova] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:33:08.289735 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1424/2875] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:33:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:33:10.121395 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e7cfb-d7f6-4b46-b3ec-ba31cc410f93 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:33:10.121918 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e7cfb-d7f6-4b46-b3ec-ba31cc410f93 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:33:10.122021 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e7cfb-d7f6-4b46-b3ec-ba31cc410f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:33:10.141352 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b71e7cfb-d7f6-4b46-b3ec-ba31cc410f93 None None] MFA Rules not processed for user `6802e5cde5bb48e2958124c88a7501d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:33:10.142719 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b71e7cfb-d7f6-4b46-b3ec-ba31cc410f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:33:10.149764 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1452/2876] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:33:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:33:10.621123 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2219d-f6a7-403a-a66d-d6045c5e2f89 service nova] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:33:10.632419 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2219d-f6a7-403a-a66d-d6045c5e2f89 service nova] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:33:10.637174 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a621f-8a2f-4a03-90aa-b4dfb9cee8e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:33:10.637826 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a621f-8a2f-4a03-90aa-b4dfb9cee8e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:33:10.638112 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a621f-8a2f-4a03-90aa-b4dfb9cee8e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:33:10.638388 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a621f-8a2f-4a03-90aa-b4dfb9cee8e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:33:10.641093 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-bf0a621f-8a2f-4a03-90aa-b4dfb9cee8e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:33:10.651665 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a621f-8a2f-4a03-90aa-b4dfb9cee8e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:33:10.653090 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a621f-8a2f-4a03-90aa-b4dfb9cee8e7 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:33:10.662905 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1425/2877] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:33:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:34:18.235517 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e7cfb-d7f6-4b46-b3ec-ba31cc410f93 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:34:18.237592 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b71e7cfb-d7f6-4b46-b3ec-ba31cc410f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:34:18.273923 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e7cfb-d7f6-4b46-b3ec-ba31cc410f93 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:34:18.278869 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645acbb5-7867-4d4f-b1bf-e0bc708ef305 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a13ad1e10ff44c4b870b45b7416b70f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:34:18.279509 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645acbb5-7867-4d4f-b1bf-e0bc708ef305 service placement] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:34:18.279794 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645acbb5-7867-4d4f-b1bf-e0bc708ef305 service placement] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:34:18.280072 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645acbb5-7867-4d4f-b1bf-e0bc708ef305 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:34:18.281867 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-645acbb5-7867-4d4f-b1bf-e0bc708ef305 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:34:18.292834 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645acbb5-7867-4d4f-b1bf-e0bc708ef305 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:34:18.294391 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645acbb5-7867-4d4f-b1bf-e0bc708ef305 service placement] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:34:18.304196 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1453/2878] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:34:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:34:50.145212 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a621f-8a2f-4a03-90aa-b4dfb9cee8e7 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:34:50.146775 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-bf0a621f-8a2f-4a03-90aa-b4dfb9cee8e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:34:50.242030 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a621f-8a2f-4a03-90aa-b4dfb9cee8e7 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:34:50.247204 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651bad0-42d9-47c9-afb4-f9ead5232d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:34:50.248071 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651bad0-42d9-47c9-afb4-f9ead5232d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:34:50.248353 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651bad0-42d9-47c9-afb4-f9ead5232d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:34:50.248621 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651bad0-42d9-47c9-afb4-f9ead5232d20 admin admin] PATH_INFO: `/v3/users/efdf21c4f62e44cca32de43efd532418` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:34:50.249815 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651bad0-42d9-47c9-afb4-f9ead5232d20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efdf21c4f62e44cca32de43efd532418)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:34:50.251898 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651bad0-42d9-47c9-afb4-f9ead5232d20 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:34:50.415078 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9651bad0-42d9-47c9-afb4-f9ead5232d20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efdf21c4f62e44cca32de43efd532418'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:34:50.415726 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9651bad0-42d9-47c9-afb4-f9ead5232d20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efdf21c4f62e44cca32de43efd532418'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:34:50.427776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9651bad0-42d9-47c9-afb4-f9ead5232d20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efdf21c4f62e44cca32de43efd532418'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:34:50.428407 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9651bad0-42d9-47c9-afb4-f9ead5232d20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efdf21c4f62e44cca32de43efd532418'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:34:50.435138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-9651bad0-42d9-47c9-afb4-f9ead5232d20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efdf21c4f62e44cca32de43efd532418'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:34:50.516044 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1426/2879] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:34:50 2022] DELETE /identity/v3/users/efdf21c4f62e44cca32de43efd532418 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:34:50.774638 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645acbb5-7867-4d4f-b1bf-e0bc708ef305 service placement] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:34:50.789666 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645acbb5-7867-4d4f-b1bf-e0bc708ef305 service placement] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:34:50.842994 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed964e-8ef6-446b-acd0-99f71f32f165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:34:50.843873 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed964e-8ef6-446b-acd0-99f71f32f165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:34:50.844625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed964e-8ef6-446b-acd0-99f71f32f165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:34:50.844625 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed964e-8ef6-446b-acd0-99f71f32f165 admin admin] PATH_INFO: `/v3/projects/419939c78a2449e6a958b430e0e14d04` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:34:50.845599 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed964e-8ef6-446b-acd0-99f71f32f165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=419939c78a2449e6a958b430e0e14d04)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:34:50.847512 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed964e-8ef6-446b-acd0-99f71f32f165 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:34:50.955879 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e7ed964e-8ef6-446b-acd0-99f71f32f165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '419939c78a2449e6a958b430e0e14d04', 'request_id': 'req-e7ed964e-8ef6-446b-acd0-99f71f32f165'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:34:51.041900 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e7ed964e-8ef6-446b-acd0-99f71f32f165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '419939c78a2449e6a958b430e0e14d04', 'request_id': 'req-e7ed964e-8ef6-446b-acd0-99f71f32f165'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:34:51.047780 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e7ed964e-8ef6-446b-acd0-99f71f32f165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '419939c78a2449e6a958b430e0e14d04', 'request_id': 'req-e7ed964e-8ef6-446b-acd0-99f71f32f165'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:34:51.058336 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e7ed964e-8ef6-446b-acd0-99f71f32f165 admin admin] The token cache is being invalidate because project 419939c78a2449e6a958b430e0e14d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:34:51.058649 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e7ed964e-8ef6-446b-acd0-99f71f32f165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:34:51.059355 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e7ed964e-8ef6-446b-acd0-99f71f32f165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:34:51.060887 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1454/2880] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:34:50 2022] DELETE /identity/v3/projects/419939c78a2449e6a958b430e0e14d04 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:34:51.065021 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651bad0-42d9-47c9-afb4-f9ead5232d20 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:34:51.066492 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-9651bad0-42d9-47c9-afb4-f9ead5232d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:34:51.079931 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651bad0-42d9-47c9-afb4-f9ead5232d20 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:34:51.134833 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c66376-e9fd-4d85-a3aa-eb838d568e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:34:51.135380 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c66376-e9fd-4d85-a3aa-eb838d568e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:34:51.135672 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c66376-e9fd-4d85-a3aa-eb838d568e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:34:51.135958 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c66376-e9fd-4d85-a3aa-eb838d568e19 admin admin] PATH_INFO: `/v3/users/e8ba270eb49f499cb948129b85601bfc` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:34:51.137706 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c66376-e9fd-4d85-a3aa-eb838d568e19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8ba270eb49f499cb948129b85601bfc)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:34:51.139639 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c66376-e9fd-4d85-a3aa-eb838d568e19 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:34:51.335556 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e3c66376-e9fd-4d85-a3aa-eb838d568e19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8ba270eb49f499cb948129b85601bfc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:34:51.336191 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e3c66376-e9fd-4d85-a3aa-eb838d568e19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8ba270eb49f499cb948129b85601bfc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:34:51.347988 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e3c66376-e9fd-4d85-a3aa-eb838d568e19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8ba270eb49f499cb948129b85601bfc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:34:51.356005 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e3c66376-e9fd-4d85-a3aa-eb838d568e19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8ba270eb49f499cb948129b85601bfc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:34:51.356005 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e3c66376-e9fd-4d85-a3aa-eb838d568e19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8ba270eb49f499cb948129b85601bfc'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:34:51.441034 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1427/2881] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:34:51 2022] DELETE /identity/v3/users/e8ba270eb49f499cb948129b85601bfc => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:34:51.694466 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed964e-8ef6-446b-acd0-99f71f32f165 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:34:51.698678 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e7ed964e-8ef6-446b-acd0-99f71f32f165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:34:51.708983 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed964e-8ef6-446b-acd0-99f71f32f165 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:34:51.765043 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f089fd5-2786-439d-a07d-632a5a5b85b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:34:51.765991 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f089fd5-2786-439d-a07d-632a5a5b85b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:34:51.766270 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f089fd5-2786-439d-a07d-632a5a5b85b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:34:51.766584 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f089fd5-2786-439d-a07d-632a5a5b85b4 admin admin] PATH_INFO: `/v3/projects/d5242698b26845a0bc9ba1376f8652cd` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:34:51.767756 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f089fd5-2786-439d-a07d-632a5a5b85b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5242698b26845a0bc9ba1376f8652cd)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:34:51.769626 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f089fd5-2786-439d-a07d-632a5a5b85b4 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:34:51.869673 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6f089fd5-2786-439d-a07d-632a5a5b85b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5242698b26845a0bc9ba1376f8652cd', 'request_id': 'req-6f089fd5-2786-439d-a07d-632a5a5b85b4'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:34:51.931783 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6f089fd5-2786-439d-a07d-632a5a5b85b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5242698b26845a0bc9ba1376f8652cd', 'request_id': 'req-6f089fd5-2786-439d-a07d-632a5a5b85b4'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:34:51.937513 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6f089fd5-2786-439d-a07d-632a5a5b85b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5242698b26845a0bc9ba1376f8652cd', 'request_id': 'req-6f089fd5-2786-439d-a07d-632a5a5b85b4'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:34:51.948171 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6f089fd5-2786-439d-a07d-632a5a5b85b4 admin admin] The token cache is being invalidate because project d5242698b26845a0bc9ba1376f8652cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:34:51.949495 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6f089fd5-2786-439d-a07d-632a5a5b85b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:34:51.949495 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6f089fd5-2786-439d-a07d-632a5a5b85b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:34:51.950795 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1455/2882] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:34:51 2022] DELETE /identity/v3/projects/d5242698b26845a0bc9ba1376f8652cd => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:35:20.613265 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c093bf-52c5-477b-ab84-c1896517e654 None None] REQUEST_METHOD: `POST` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:35:20.618725 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c093bf-52c5-477b-ab84-c1896517e654 None None] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:35:20.618725 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c093bf-52c5-477b-ab84-c1896517e654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:35:20.631567 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.auth.core [None req-d2c093bf-52c5-477b-ab84-c1896517e654 None None] MFA Rules not processed for user `6802e5cde5bb48e2958124c88a7501d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:35:20.632798 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-d2c093bf-52c5-477b-ab84-c1896517e654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:35:20.685256 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1428/2883] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 10 21:35:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:35:29.619693 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f089fd5-2786-439d-a07d-632a5a5b85b4 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:35:29.621113 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6f089fd5-2786-439d-a07d-632a5a5b85b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:35:29.691373 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f089fd5-2786-439d-a07d-632a5a5b85b4 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:35:29.696763 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c820ab-47d2-4def-a023-ff4b959740bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c16a3b07c64a22bfc3df2a5a90c3f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:35:29.697407 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c820ab-47d2-4def-a023-ff4b959740bc service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:35:29.697693 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c820ab-47d2-4def-a023-ff4b959740bc service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:35:29.697973 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c820ab-47d2-4def-a023-ff4b959740bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:35:29.699713 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-74c820ab-47d2-4def-a023-ff4b959740bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:35:29.710304 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c820ab-47d2-4def-a023-ff4b959740bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:35:29.711891 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c820ab-47d2-4def-a023-ff4b959740bc service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:35:29.720638 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1456/2884] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:35:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:35:34.488892 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c093bf-52c5-477b-ab84-c1896517e654 None None] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:35:34.490343 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-d2c093bf-52c5-477b-ab84-c1896517e654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:35:34.546753 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c093bf-52c5-477b-ab84-c1896517e654 None None] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:35:34.550297 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ceb483-eb71-4836-973c-29c1747af109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:35:34.550974 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceb483-eb71-4836-973c-29c1747af109 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:35:34.551261 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceb483-eb71-4836-973c-29c1747af109 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:35:34.551540 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceb483-eb71-4836-973c-29c1747af109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:35:34.553306 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-74ceb483-eb71-4836-973c-29c1747af109 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:35:34.566517 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ceb483-eb71-4836-973c-29c1747af109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:35:34.567942 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ceb483-eb71-4836-973c-29c1747af109 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:35:34.579452 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1429/2885] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:35:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:35:35.752314 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c820ab-47d2-4def-a023-ff4b959740bc service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:35:35.754000 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-74c820ab-47d2-4def-a023-ff4b959740bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:35:35.766000 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c820ab-47d2-4def-a023-ff4b959740bc service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:35:35.769543 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5eea95-9ab8-4633-b540-64fa67c0300b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:35:35.770176 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5eea95-9ab8-4633-b540-64fa67c0300b service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:35:35.770489 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5eea95-9ab8-4633-b540-64fa67c0300b service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:35:35.770772 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5eea95-9ab8-4633-b540-64fa67c0300b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:35:35.772481 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-be5eea95-9ab8-4633-b540-64fa67c0300b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:35:35.785972 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5eea95-9ab8-4633-b540-64fa67c0300b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:35:35.787409 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5eea95-9ab8-4633-b540-64fa67c0300b service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:35:35.798191 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1457/2886] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:35:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:35:40.584403 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ceb483-eb71-4836-973c-29c1747af109 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:35:40.593532 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ceb483-eb71-4836-973c-29c1747af109 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:35:40.597163 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307a287-91d7-41c9-a439-4899c816d585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:35:40.597807 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307a287-91d7-41c9-a439-4899c816d585 service neutron] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:35:40.598091 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307a287-91d7-41c9-a439-4899c816d585 service neutron] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:35:40.598370 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307a287-91d7-41c9-a439-4899c816d585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:35:40.600737 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a307a287-91d7-41c9-a439-4899c816d585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:35:40.611288 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307a287-91d7-41c9-a439-4899c816d585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:35:40.612803 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307a287-91d7-41c9-a439-4899c816d585 service neutron] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:35:40.621065 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1430/2887] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:35:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:37:21.745818 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5eea95-9ab8-4633-b540-64fa67c0300b service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:37:21.755337 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5eea95-9ab8-4633-b540-64fa67c0300b service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:37:21.761889 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8021018-7c9b-47b8-bb35-9ceec211f20f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fa7da0ccf954be1a582411cdc617b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:37:21.761889 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8021018-7c9b-47b8-bb35-9ceec211f20f service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:37:21.761889 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8021018-7c9b-47b8-bb35-9ceec211f20f service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:37:21.761889 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8021018-7c9b-47b8-bb35-9ceec211f20f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:37:21.762301 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f8021018-7c9b-47b8-bb35-9ceec211f20f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:37:21.824933 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8021018-7c9b-47b8-bb35-9ceec211f20f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:37:21.826349 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8021018-7c9b-47b8-bb35-9ceec211f20f service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:37:21.836994 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1458/2888] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:37:29.037683 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307a287-91d7-41c9-a439-4899c816d585 service neutron] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:37:29.039293 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-a307a287-91d7-41c9-a439-4899c816d585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:37:29.056593 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307a287-91d7-41c9-a439-4899c816d585 service neutron] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:37:29.061107 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70636d69-ccb2-44fa-8a56-c6ebaf81422a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:37:29.061973 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70636d69-ccb2-44fa-8a56-c6ebaf81422a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:37:29.062254 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70636d69-ccb2-44fa-8a56-c6ebaf81422a admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:37:29.062557 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70636d69-ccb2-44fa-8a56-c6ebaf81422a admin admin] PATH_INFO: `/v3/users/6802e5cde5bb48e2958124c88a7501d9` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:37:29.063781 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70636d69-ccb2-44fa-8a56-c6ebaf81422a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6802e5cde5bb48e2958124c88a7501d9)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:37:29.065651 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70636d69-ccb2-44fa-8a56-c6ebaf81422a admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:37:29.267418 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-70636d69-ccb2-44fa-8a56-c6ebaf81422a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6802e5cde5bb48e2958124c88a7501d9'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:37:29.268244 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-70636d69-ccb2-44fa-8a56-c6ebaf81422a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6802e5cde5bb48e2958124c88a7501d9'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:37:29.280207 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-70636d69-ccb2-44fa-8a56-c6ebaf81422a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6802e5cde5bb48e2958124c88a7501d9'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:37:29.280975 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-70636d69-ccb2-44fa-8a56-c6ebaf81422a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6802e5cde5bb48e2958124c88a7501d9'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:37:29.289138 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-70636d69-ccb2-44fa-8a56-c6ebaf81422a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6802e5cde5bb48e2958124c88a7501d9'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:37:29.385776 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1431/2889] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:37:29 2022] DELETE /identity/v3/users/6802e5cde5bb48e2958124c88a7501d9 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:37:29.636646 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8021018-7c9b-47b8-bb35-9ceec211f20f service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:37:29.649491 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8021018-7c9b-47b8-bb35-9ceec211f20f service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:37:29.707262 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050a791-2893-49ef-9bd2-5a0da6d3eb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:37:29.708677 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050a791-2893-49ef-9bd2-5a0da6d3eb4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:37:29.708984 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050a791-2893-49ef-9bd2-5a0da6d3eb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:37:29.709257 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050a791-2893-49ef-9bd2-5a0da6d3eb4e admin admin] PATH_INFO: `/v3/projects/dd6f673d1cfd41028e5ed60d4d204666` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:37:29.710456 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050a791-2893-49ef-9bd2-5a0da6d3eb4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd6f673d1cfd41028e5ed60d4d204666)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:37:29.712326 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050a791-2893-49ef-9bd2-5a0da6d3eb4e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:37:29.823629 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5050a791-2893-49ef-9bd2-5a0da6d3eb4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd6f673d1cfd41028e5ed60d4d204666', 'request_id': 'req-5050a791-2893-49ef-9bd2-5a0da6d3eb4e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:37:29.899354 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5050a791-2893-49ef-9bd2-5a0da6d3eb4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd6f673d1cfd41028e5ed60d4d204666', 'request_id': 'req-5050a791-2893-49ef-9bd2-5a0da6d3eb4e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:37:29.905405 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5050a791-2893-49ef-9bd2-5a0da6d3eb4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd6f673d1cfd41028e5ed60d4d204666', 'request_id': 'req-5050a791-2893-49ef-9bd2-5a0da6d3eb4e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:37:29.916759 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5050a791-2893-49ef-9bd2-5a0da6d3eb4e admin admin] The token cache is being invalidate because project dd6f673d1cfd41028e5ed60d4d204666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:37:29.917049 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5050a791-2893-49ef-9bd2-5a0da6d3eb4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:37:29.917687 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5050a791-2893-49ef-9bd2-5a0da6d3eb4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:37:29.919267 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1459/2890] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:37:29 2022] DELETE /identity/v3/projects/dd6f673d1cfd41028e5ed60d4d204666 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:37:29.923393 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70636d69-ccb2-44fa-8a56-c6ebaf81422a admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:37:29.924838 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-70636d69-ccb2-44fa-8a56-c6ebaf81422a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:37:29.937754 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70636d69-ccb2-44fa-8a56-c6ebaf81422a admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:37:29.991506 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5c03d-59cf-474c-b7e3-59559c661527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:37:29.992373 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5c03d-59cf-474c-b7e3-59559c661527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:37:29.992653 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5c03d-59cf-474c-b7e3-59559c661527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:37:29.992928 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5c03d-59cf-474c-b7e3-59559c661527 admin admin] PATH_INFO: `/v3/users/45b5886342d9489da42c2de620c65c88` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:37:29.994097 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5c03d-59cf-474c-b7e3-59559c661527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45b5886342d9489da42c2de620c65c88)` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:37:29.996023 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5c03d-59cf-474c-b7e3-59559c661527 admin admin] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:37:30.157379 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e4e5c03d-59cf-474c-b7e3-59559c661527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45b5886342d9489da42c2de620c65c88'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:37:30.158039 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e4e5c03d-59cf-474c-b7e3-59559c661527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45b5886342d9489da42c2de620c65c88'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:37:30.169695 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e4e5c03d-59cf-474c-b7e3-59559c661527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45b5886342d9489da42c2de620c65c88'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:37:30.170329 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e4e5c03d-59cf-474c-b7e3-59559c661527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45b5886342d9489da42c2de620c65c88'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:37:30.177627 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.notifications [None req-e4e5c03d-59cf-474c-b7e3-59559c661527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45b5886342d9489da42c2de620c65c88'} {{(pid=80455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:37:30.241865 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1432/2891] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 10 21:37:29 2022] DELETE /identity/v3/users/45b5886342d9489da42c2de620c65c88 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:37:30.461173 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050a791-2893-49ef-9bd2-5a0da6d3eb4e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:37:30.462635 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5050a791-2893-49ef-9bd2-5a0da6d3eb4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:37:30.475039 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050a791-2893-49ef-9bd2-5a0da6d3eb4e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:37:30.529689 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a3760-0dbf-4dc7-8513-eba615b7d284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94be445c202a4e67aef3505af25af405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ea6acf0b7844ccca48ba57f57c13860', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:37:30.530831 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a3760-0dbf-4dc7-8513-eba615b7d284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:37:30.531113 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a3760-0dbf-4dc7-8513-eba615b7d284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:37:30.531384 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a3760-0dbf-4dc7-8513-eba615b7d284 admin admin] PATH_INFO: `/v3/projects/39b810b37c1a494a994957977fa15020` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:37:30.532544 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a3760-0dbf-4dc7-8513-eba615b7d284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b810b37c1a494a994957977fa15020)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:37:30.534623 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a3760-0dbf-4dc7-8513-eba615b7d284 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:37:30.641180 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a62a3760-0dbf-4dc7-8513-eba615b7d284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b810b37c1a494a994957977fa15020', 'request_id': 'req-a62a3760-0dbf-4dc7-8513-eba615b7d284'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:37:30.693518 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a62a3760-0dbf-4dc7-8513-eba615b7d284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b810b37c1a494a994957977fa15020', 'request_id': 'req-a62a3760-0dbf-4dc7-8513-eba615b7d284'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:37:30.700057 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a62a3760-0dbf-4dc7-8513-eba615b7d284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b810b37c1a494a994957977fa15020', 'request_id': 'req-a62a3760-0dbf-4dc7-8513-eba615b7d284'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:37:30.710803 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a62a3760-0dbf-4dc7-8513-eba615b7d284 admin admin] The token cache is being invalidate because project 39b810b37c1a494a994957977fa15020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:37:30.711092 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a62a3760-0dbf-4dc7-8513-eba615b7d284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:37:30.711712 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a62a3760-0dbf-4dc7-8513-eba615b7d284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:37:30.713263 dv-cinder-836083-6-iscsi devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1460/2892] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 10 21:37:30 2022] DELETE /identity/v3/projects/39b810b37c1a494a994957977fa15020 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:39:21.693113 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5c03d-59cf-474c-b7e3-59559c661527 admin admin] Authenticating user token {{(pid=80455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:39:21.694633 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-e4e5c03d-59cf-474c-b7e3-59559c661527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:39:21.762106 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5c03d-59cf-474c-b7e3-59559c661527 admin admin] Validating token access rules against request {{(pid=80455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:39:21.818318 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb886a11-08ae-4c56-a836-13aa7fec412c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a13ad1e10ff44c4b870b45b7416b70f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385eeb55a9ae42eba674de1e83d96e0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:39:21.819003 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb886a11-08ae-4c56-a836-13aa7fec412c service placement] REQUEST_METHOD: `GET` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:39:21.819292 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb886a11-08ae-4c56-a836-13aa7fec412c service placement] SCRIPT_NAME: `/identity` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:39:21.819576 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb886a11-08ae-4c56-a836-13aa7fec412c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:39:21.821342 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.fernet_utils [None req-eb886a11-08ae-4c56-a836-13aa7fec412c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:39:21.832535 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb886a11-08ae-4c56-a836-13aa7fec412c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:39:21.834114 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb886a11-08ae-4c56-a836-13aa7fec412c service placement] RBAC: Authorization granted {{(pid=80455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:39:21.844271 dv-cinder-836083-6-iscsi devstack@keystone.service[80455]: [pid: 80455|app: 0|req: 1433/2893] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 10 21:39:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)